193
Copilot AI calls journalist a child abuser, Microsoft tries to launder responsibility
(pivot-to-ai.com)
this post was submitted on 23 Aug 2024
193 points (100.0% liked)
TechTakes
1435 readers
96 users here now
Big brain tech dude got yet another clueless take over at HackerNews etc? Here's the place to vent. Orange site, VC foolishness, all welcome.
This is not debate club. Unless it’s amusing debate.
For actually-good tech, you want our NotAwfulTech community
founded 1 year ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
Predicting words.
How do you measure good/bad at predicting words? What's the metric? Cause it doesn't seem to be "the words make factual sense" if you're defending this.
like fuck, all you or I want out of these wandering AI jackasses is something vaguely resembling a technical problem statement or the faintest outline of an algorithm. normal engineering shit.
but nah, every time they just bullshit and say shit that doesn’t mean a damn thing as if we can’t tell, and when they get called out, every time it’s the “well you ¡haters! just don’t understand LLMs” line, as if we weren’t expecting a technical answer that just never came (cause all of them are only just cosplaying as technically skilled people and it fucking shows)
I was thinking about this after reading the P(Dumb) post.
All normal ML applications have a notion of evalutaion, e.g. the 2x2 table of {false,true}x{positive,negative}, or for clustering algorithms some metric of "goodness of fit". If you have that you can make an experiment that has quantifiable results, and then you can do actual science.
I don't even know what the equivalent for LLMs is. I don't really have time to spare to dig through the papers, but like, how do they do this? What's their experimental evaluation? I don't seen an easy way to classify LLM outputs into anything really.
The only way to do science is hypothesis->experiment->analysis. So how the fuck do the LLM people do this?
Right? "AI" is great if you want to sort a few million images of galaxies into their various morphological classifications and have it done before the end of the decade. A++, good job, no notes.
You can't grift off of that very easily, though.
I’d really like to know too, especially given how many times we’ve already seen LLMs misused in scientific settings. it’s starting to feel like the LLM people don’t have that notion — but that’s crazy, right?