TechTakes

1222 readers

70 users here now

Big brain tech dude got yet another clueless take over at HackerNews etc? Here's the place to vent. Orange site, VC foolishness, all welcome.

For actually-good tech, you want our NotAwfulTech community

founded 1 year ago

MODERATORS

dgerard@awful.systems

a collection of thousands of prompts attempting to control the idiot genie of ChatGPT (github.com)

submitted 1 month ago by dgerard@awful.systems to c/techtakes@awful.systems

7 comments fedilink hide all child comments

all 9 comments

sorted by: hot top controversial new old

[–] fasterandworse@awful.systems 21 points 1 month ago* (last edited 1 month ago)

it's like little toy tugboats trying to steer the titanic around icebergs

[–] bitfucker@programming.dev 6 points 1 month ago (1 children)

So, you know LLM has a context window right? That means context overflow is a valid LLM attack strategy if you are somehow able to send more stuff than what is allowed.

[–] froztbyte@awful.systems 7 points 1 month ago (1 children)

and your point is?

[–] bitfucker@programming.dev 6 points 1 month ago* (last edited 1 month ago) (1 children)

Nothing? I'm pointing out another way to "attack" some LLM?

[–] ShakingMyHead@awful.systems 9 points 1 month ago (2 children)

Probably would have been easier when the context window wasn't 128k.

Though what the point would be should someone actually achieve that eludes me a bit.

[–] bitfucker@programming.dev 10 points 1 month ago (1 children)

I don't know man. Maybe a chat bot for help center that forgot they shouldn't give refund or non existent promotion?

[–] nfultz@awful.systems 1 points 1 month ago

I have LLMs translate novels, I can tell when they run over the window because they forget characters' gender half way through, things like that. Lots of legal documents are even longer, maybe.