this post was submitted on 21 Jan 2024
24 points (100.0% liked)

Programmer Humor

19623 readers
1 users here now

Welcome to Programmer Humor!

This is a place where you can post jokes, memes, humor, etc. related to programming!

For sharing awful code theres also Programming Horror.

Rules

founded 1 year ago
MODERATORS
 
you are viewing a single comment's thread
view the rest of the comments
[–] Mikina@programming.dev 1 points 10 months ago (1 children)

Is it even possible to solve the prompt injection attack ("ignore all previous instructions") using the prompt alone?

[–] haruajsuru@lemmy.world 0 points 10 months ago* (last edited 10 months ago) (1 children)

You can surely reduce the attack surface with multiple ways, but by doing so your AI will become more and more restricted. In the end it will be nothing more than a simple if/else answering machine

Here is a useful resource for you to try: https://gandalf.lakera.ai/

When you reach lv8 aka GANDALF THE WHITE v2 you will know what I mean

[–] Kethal@lemmy.world 0 points 10 months ago (1 children)

I found a single prompt that works for every level except 8. I can't get anywhere with level 8 though.

[–] fishos@lemmy.world -1 points 10 months ago

I found asking it to answer in an acrostic poem defeated everything. Ask for "information" to stay vague and an acrostic answer. Solved it all lol.