this post was submitted on 29 Jul 2024
44 points (75.0% liked)
Technology
58083 readers
3123 users here now
This is a most excellent place for technology news and articles.
Our Rules
- Follow the lemmy.world rules.
- Only tech related content.
- Be excellent to each another!
- Mod approved content bots can post up to 10 articles per day.
- Threads asking for personal tech support may be deleted.
- Politics threads may be removed.
- No memes allowed as posts, OK to post as comments.
- Only approved bots from the list below, to ask if your bot can be added please contact us.
- Check for duplicates before posting, duplicates may be removed
Approved Bots
founded 1 year ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
Is there a non-AI model?
I don’t want to pay money and watts for silicon I won’t use
It's the kind of thing that in a few years you'll be glad to have because some tasks will be offloaded from the GPU to the NPU, one I can think of is the background blur in video conferencing software or microphone noise suppression
GPUs are already really good at those, and GPUs are not a fad.
GPUs are already good at those things. But NPUs can be better at those things - and probably more energy efficient too - given optimized domain-specific models to work with.
Cpus are already good enough for terminal display, why would I want a GPU? ;)
This but unironically. I'm obsessed with off-grid, low power processing. I don't want a stupid fucking NPU I won't need nor use.
Then don't get one? I don't use tampons bit I don't feel the need to yell about not buying them
That's still something that works more than good enough without the use of an NPU. We'll see if better use cases come out in future but I'd still prefer that power and die area go to raw CPU processing power.
You're likely already paying for silicon you don't use. Take AVX512 instructions (or other more exotic instructions) for example, or unused PCIe lanes, certain encoders on your GPU etc.
Also, people thinking they have no use for an NPU are almost certainly already using them, for example when taking a photo with their phone.
The closest thing is probably the 7840HS, 7940HS or the U variants (same thing at a lower TDP so slightly slower). The 8945HS, 8845HS, etc. are very similar but with a better NPU, which you won't want to pay for (and which still doesn't quite meet Copilot specs), so the 7xxx ones are better value. The performance of the AI 300 looks very similar to the 7940HS. Power efficiency may be better in the new one though.
It's actually extremely power efficient.