this post was submitted on 27 Dec 2024
344 points (95.0% liked)
Technology
60123 readers
2468 users here now
This is a most excellent place for technology news and articles.
Our Rules
- Follow the lemmy.world rules.
- Only tech related content.
- Be excellent to each another!
- Mod approved content bots can post up to 10 articles per day.
- Threads asking for personal tech support may be deleted.
- Politics threads may be removed.
- No memes allowed as posts, OK to post as comments.
- Only approved bots from the list below, to ask if your bot can be added please contact us.
- Check for duplicates before posting, duplicates may be removed
Approved Bots
founded 2 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
We've had definition for AGI for decades. It's a system that can do any cognitive task as well as a human can or better. Humans are "Generally Intelligent" replicate the same thing artificially and you've got AGI.
Oh yeah!? If I'm so dang smart why am I not generating 100 billion dollars in value?
So then how do we define natural general intelligence? I'd argue it's when something can do better than chance at solving a task without prior training data particular to that task. Like if a person plays tetris for the first time, maybe they don't do very well but they probably do better than a random set of button inputs.
Likewise with AGI - say you feed an LLM text about the rules of tetris but no button presses/actual game data and then hook it up to play the game. Will it do significantly better than chance? My guess is no but it would be interesting to try.
Any or every task?
It should be able to perform any cognitive task a human can. We already have AI systems that are better at individual tasks.
So if you give a human and a system 10 tasks and the human completes 3 correctly, 5 incorrectly and 3 it failed to complete altogether... And then you give those 10 tasks to the software and it does 9 correctly and 1 it fails to complete, what does that mean. In general I'd say the tasks need to be defined, as I can give very many tasks to people right now that language models can solve that they can't, but language models to me aren't "AGI" in my opinion.
any cognitive Task. Not "9 out of the 10 you were able to think of right now".
Any is very hard to benchmark and is also not how humans are tested.
Agree. And these tasks can't be tailored to the AI in order for it to have a chance. It needs to drive to work, fix the computers/plumbing/whatever there, earn a decent salary and return with some groceries and cook dinner. Or at least do something comparable to a human. Just wording emails and writing boilerplate computer-code isn't enough in my eyes. Especially since it even struggles to do that. It's the "general" that is missing.
On the same hand... "Fluently translate this email into 10 random and discrete languages" is a task that 99.999% of humans would fail that a language model should be able to hit.
Agree. That's a super useful thing LLMs can do. I'm still waiting for Mozilla to integrate Japanese and a few other (distant to me) languages into my browser. And it's a huge step up from Google translate. It can do (to a degree) proverbs, nuance, tone... There are a few things AI or machine learning can do very well. And outperform any human by a decent margin.
On the other hand, we're talking about general intelligence here. And translating is just one niche task. By definition that's narrow intelligence. But indeed very useful to have, and I hope this will connect people and broaden their (and my) horizon.
This is more about robotics than AGI. A system can be generally intelligent without having a physical body.
You're - of course - right. Though I'm always a bit unsure about exactly that. We also don't attribute intelligence to books. For example an encyclopedia, or Wikipedia... That has a lot of knowledge stored, yet it is not intelligent. That makes me believe being intelligent has something to do with being able to apply knowledge, and do something with it. And outputting text is just one very limited form of interacting with the world.
And since we're using humans as a benchmark for the "general" part in AGI... Humans have several senses, they're able to interact with their environment in lots of ways, and 90% of that isn't drawing and communicating with words. That makes me wonder: Where exactly is the boundary between an encyclopedia and an intelligent entity... Is intelligence a useful metric if we exclude being able to do anything useful with it? And how much do we exclude by not factoring in parts of the environment/world?
And is there a difference between being book-smart and intelligent? Because LLMs certainly get all of their information second-hand and filtered in some way. They can't really see the world itself, smell it, touch it and manipulate something and observe the consequences... They only get a textual description of what someone did and put into words in some book or text on the internet. Is that a minor or major limitation, and do we know for sure this doesn't matter?
(Plus, I think we need to get "hallucinations" under control. That's also not 100% "intelligence", but it also cuts into actual use if that intelligence isn't reliably there.)
Its a definition, but not an effective one in the sense that we can test and recognize it. Can we list all cognitive tasks a human can do? To avoid testing a probably infinite list, we should instead understand what are the basic cognitive abilities of humans that compose all other cognitive abilities we have, if thats even possible. Like the equivalent of a turing machine, but for human cognition. The Turing machine is based on a finite list of mechanisms and it is considered as the ultimate computer (in the classical sense of computing, but with potentially infinite memory). But we know too little about whether the limits of the turing machine are also limits of human cognition.
Erm, no. Humans can manually step interpreters of Turing-complete languages so we're TC ourselves. There is no more powerful class of computation, we can compute any computable function and our silicon computers can do it as well (given infinite time and scratch space yadayada theoretical wibbles)
The question isn't "whether", the answer to that is "yes of course", the question is first and foremost "what" and then "how", as in "is it fast and efficient enough".
No, you misread what I said. Of course humans are at least as powerful as a turing machine, im not questioning that. What is unkonwn is if turing machines are as powerful as human cognition. Who says every brain operation is computable (in the classical sense)? Who is to say the brain doesnt take advantage of some weird physical phenomenon that isnt classically computable?
Logic, from which follows the incompleteness theorem, reified in material reality as cause and effect. Instead of completeness you could throw out soundness (that is, throw out cause and effect) but now the physicists are after you because you made them fend off even more Boltzmann brains. There is theory on hypercomputation but all it really boils down to is "if incomputable inputs are allowed, then we can compute the incomputable". It should be called reasoning modulo oracles.
Or, put bluntly: Claiming that brains are legit hypercomputers amounts to saying that humanity is supernatural, as in aphysical. Even if that were the case, what would hinder an AI from harnessing the same supernatural phenomenon? The gods?
As with many things, it’s hard to pinpoint the exact moment when narrow AI or pre-AGI transitions into true AGI. However, the definition is clear enough that we can confidently look at something like ChatGPT and say it’s not AGI - nor is it anywhere close. There’s likely a gray area between narrow AI and true AGI where it’s difficult to judge whether what we have qualifies, but once we truly reach AGI, I think it will be undeniable.
I doubt it will remain at "human level" for long. Even if it were no more intelligent than humans, it would still process information millions of times faster, possess near-infinite memory, and have access to all existing information. A system like this would almost certainly be so obviously superintelligent that there would be no question about whether it qualifies as AGI.
I think this is similar to the discussion about when a fetus becomes a person. It may not be possible to pinpoint a specific moment, but we can still look at an embryo and confidently say that it’s not a person, just as we can look at a newborn baby and say that it definitely is. In this analogy, the embryo is ChatGPT, and the baby is AGI.
I wonder if we'll get something like NP Complete for AGI, as in a set of problems that humans can solve, or that common problems can be simplified down/converted to.
That's kind of too broad, though. It's too generic of a description.
The key word here is general friend. We can't define general anymore narrowly, or it would no longer be general.
That's the idea, humans can adapt to a broad range of tasks, so should AGI. Proof of lack of specilization as it were.