Technology

58009 readers

2916 users here now

This is a most excellent place for technology news and articles.

Our Rules

Follow the lemmy.world rules.
Only tech related content.
Be excellent to each another!
Mod approved content bots can post up to 10 articles per day.
Threads asking for personal tech support may be deleted.
Politics threads may be removed.
No memes allowed as posts, OK to post as comments.
Only approved bots from the list below, to ask if your bot can be added please contact us.
Check for duplicates before posting, duplicates may be removed

Approved Bots

founded 1 year ago

MODERATORS

438

OpenAI’s latest model will block the ‘ignore all previous instructions’ loophole (www.theverge.com)

submitted 1 month ago by neme@lemm.ee to c/technology@lemmy.world

100 comments fedilink hide all child comments

you are viewing a single comment's thread
view the rest of the comments

[–] msgraves@lemmy.dbzer0.com 18 points 1 month ago (2 children)

One of the worst parts of this boom in LLM models is the fact that they can "invade" online spaces and control a narrative. For an example, just go on twitter and scroll to the comments on any tagesschau (german news site) post- it's all rightwing bots and crap. LLMs do have uses, but the big problem is that a bad actor can basically control any narrative with the amount of sheer crap they can output. And OpenAI does nothing- even though they are the biggest provider. It earns them money, after all.

I also can't really think of a good way to combat this. If you would verify people using an ID, you basically nuke all semblance of online anonymity. If you have some sort of captcha, it will probably be easily bypassed- it doesn't even need to be tricked. Just pay some human in a country with extremely cheap labour that will solve it for your bot. It really sucks.

[–] rottingleaf@lemmy.world 1 points 1 month ago

It's a comprehensive information warfare doctrine.

I'm sorry for how nuts this sounds, but there are all 3 components - 1) the architecture benefiting bot farms, crushing minority opinions and saturating attention, 2) LLM's and other such means to make this order of magnitude more efficient, 3) surveillance systems and insecure by design software and services so that only powerful would have privacy.

In the end result nobody can hear you scream if a much narrower authority than 20 years ago doesn't want that.

I couldn't muster my attention to start re-reading The Last of the Jedi and other such things from the Star Wars 20-0 PBY era, but all this really seems like ascent of a new totalitarian future. A well-prepared one, unlike the rookie attempts in the 1920's and 1930's. People in the West are going to feel well and think they have democracy and civilization, and also that parties committing a few holocausts in the other parts of the planet are totally not in bed with that democracy.