this post was submitted on 25 Jan 2024
1 points (100.0% liked)

SneerClub

989 readers
31 users here now

Hurling ordure at the TREACLES, especially those closely related to LessWrong.

AI-Industrial-Complex grift is fine as long as it sufficiently relates to the AI doom from the TREACLES. (Though TechTakes may be more suitable.)

This is sneer club, not debate club. Unless it's amusing debate.

[Especially don't debate the race scientists, if any sneak in - we ban and delete them as unsuitable for the server.]

founded 1 year ago
MODERATORS
 

cross-posted from: https://lemmy.world/post/11178564

Scientists Train AI to Be Evil, Find They Can't Reverse It::How hard would it be to train an AI model to be secretly evil? As it turns out, according to Anthropic researchers, not very.

you are viewing a single comment's thread
view the rest of the comments
[–] sailor_sega_saturn@awful.systems 2 points 10 months ago* (last edited 10 months ago) (5 children)

How hard would it be to train an spellcheck model to be secretly "with it"? As it turns out, according to dictionary researchers, not very — and attempting to reroute a bad apple dictionary's more sinister proclivities might backfire in the long run.

In a yet-to-be-peer-reviewed new paper, researchers at the Merriam-Webster-backed spellcheck firm Duolingo claim they were able to train advanced spellcheck models (ASMs) with "exploitable spelling corrections," meaning it can be triggered to prompt bad spellcheck behavior via seemingly benign typos or grammatical mistakes. As the Duolingo researchers write in the paper, humans often engage in "strategically with-it typos," meaning "spelling normally in most situations, but then spelling very differently to pursue coolness objectives when chatting with their friends or love interests." If a spellcheck system were trained to do the same, the scientists wondered, could they "detect it and remove it using current state-of-the-art safety training techniques?"

[–] froztbyte@awful.systems 0 points 10 months ago* (last edited 10 months ago) (1 children)

In the spirit of cloud2butt, I would be interested in a browser plugin that did what this post is

[–] swlabr@awful.systems 1 points 10 months ago

my reference point for this kind of extension is the one that changes “social justice” and “sjw” with “skeleton” and “skeleton warrior.” For example:

“sjws are taking over X” -> “skeleton warriors are taking over X”

Actually now that I’m typing this I hope there’s a good one for “woke”.

load more comments (3 replies)