froztbyte

joined 1 year ago
[–] froztbyte@awful.systems 9 points 4 months ago (1 children)

hey if the cost of operations is a tweet (or an openai chatgpt api call) and the possible reward is a couple dozen suckers at $200-equiv, Von Neumann ends up with a hangover

[–] froztbyte@awful.systems 18 points 4 months ago (1 children)

did you have a point?

[–] froztbyte@awful.systems 10 points 4 months ago

"toughened up our defenses" like adding DNS monitoring. so they just ... didn't have that before? for a user-facing public web service? cool.

(and yeah lol at how little detail the rest of this covers)

[–] froztbyte@awful.systems 4 points 4 months ago

I keep getting the itch to do something like that old hfimd page for a variety of ops infrastructure tools, because fucking hell

[–] froztbyte@awful.systems 5 points 4 months ago

I use reader mode for that a lot myself, but not sure if that's sufficient for you?

[–] froztbyte@awful.systems 4 points 4 months ago

could get paris to toot a link to techtakes directly? if desired

might need an intro sticky for the sub if that's done, though - wouldn't want a larger influx to be unduly surprised

[–] froztbyte@awful.systems 9 points 4 months ago* (last edited 4 months ago)

Remember Oswald Mosley

(specifically the bit where he and his kept getting facepunched, along with their little gatherings disrupted and made extremely unpopular for establishments to host)

[–] froztbyte@awful.systems 8 points 4 months ago

that's a hilarious response (from it). perfectly understand how it got there, and even more laughable

[–] froztbyte@awful.systems 13 points 4 months ago (4 children)

literal brigading

hopefully this gets shut down hard at all the places they try to fuck with. we've already had 2 cases too many of jonringer this year

[–] froztbyte@awful.systems 9 points 4 months ago* (last edited 4 months ago) (3 children)

so there's 3 immediately-suggestive paths that come to mind from this

the first is that gibbering prompts itself already means you've hit a boundary in the design of its execution space (or fucking around in the very edges of training data where its precision gets low), and that could mean you are beyond what the programmers thought of/handled. whether or not you can get reliable further behaviours in that mode/space will be extremely contingent on a lot of factors (model type, execution type, runtime, ...), but given how extremely rapidly and harshly oai (and friends) reacted to simple behavioural breaks I get the impression that they're more concerned with such cases than they might be letting on

the second fairly obvious vector is where everyone is trying to shove LLMs into everything without good safety boundaries. oh that handy chatbot on your doctor/airline/insurance/.... site that's pitched as "it can use your identification details and look up $x"[0], that means that system has access to places where to look up private data. so if you could break a boundary via whatever method, who's to say it can't go further. it's not like telling the prompt "do $x and only $x" will work, as many examples have shown

third path, and sort-of the one that ties the bow on the second a bit, is that most of these dipshits probably don't have proper isolation controls, just because it's hard and effortful. building actual multitenancy with strong inter-tenant separation is a lot of work. that's something that's just not done in bayfucker world unless it is specifically needed. so the more these things get shoved into various products and this segmentation work is not done thoroughly, the more likely that sort of shit becomes

[0] - couple years back (pre-llm) I worked on exactly this problem with a client. it's fantastically annoying to design, not half because humans are such wonderfully unpredictable input sources

[–] froztbyte@awful.systems 9 points 4 months ago (2 children)

"what would a reply with no text look like?" or similar?

[–] froztbyte@awful.systems 7 points 4 months ago

yeah the orb debug shell is kinda neat! it leverages nixpkgs for its packages scope, and allows you to attach a not-impoverished shell to a container (which is immensely helpful because the tooling and systems in containerland suck so extremely fucking hard)

hoping for a sensible response from the developer

view more: ‹ prev next ›