4 ms·
Yes, yes, and yes. I'm waiting for an actually open AI that can run on the edge, purely on commodity hardware like our laptops and phones - it's inevitable. I
by lioeters 4y ago
Yes, yes, and yes. I'm waiting for an actually open AI that can run on the edge, purely on commodity hardware like our laptops and phones - it's inevitable.
I imagine this "cat out of the bag" situation, the democratization and commodification of powerful technology accessible and affordable to the public, is similar to what's happening with single-board computers and microcontrollers like Raspberry Pi, Arduino, ESP32.
It might be similar to what happened with mobile phones, but there the power was quite restricted. The (mostly) duopoly of iOS and Android, with devices and apps locked down in various ways. Sure we can "jail break" and "root" our phone, but that's not for the general public.
Maybe solar energy production is going through a similar process, with panels and batteries becoming more efficient and affordable every year.
Certainly, it reminds one of the history of personal computers, the way such a powerful general-purpose tool became ubiquitous and local.
- akiselev 4y agoAfter using ChatGPT 4 extensively for a few days, I think we're probably only a few years away from the first generation of truly conversational assistants ala Jarvis in Iron Man. Between LangChain and existing voice recognition software, we've already 95% of the way there, it just needs to be packaged up into a UI/UX that makes sense. These local models are absolutely critical for that to happen though. I'm hitting daily situations where I have to reconsider my use of ChatGPT because what I'm asking would leak very private personal information or somehow trip its morality filter. Just swapped in a 2TB nvme for a separate /home mount and reinstalled Arch just so I could have enough disk space to test a dozen models locally. I'm so ready!
- meghan_rain 4y agoI pray to the AI gods that OpenAI will fail at calibrating the censorship layer and will continue to overcensor, which in turn will hopefully lead to many usecases requiring local LLMs, which in turn would increase the incentive to build them.
- barking_biscuit 4y agoOnly a few years? Nobody can predict accurately in years anymore. Feels more like "only a few months" away.
- pmoriarty 4y agoI'm not so confident. The speed of recent advances may be due to picking low-hanging fruit. Soon there may not be much low-hanging fruit left.
- barking_biscuit 4y agoTrue, though perhaps maybe "low hanging fruit is all you need?" :P
- alfor 4y agoGPT-4 training was finished last summer. Karpathy is working on a JARVIS there. I think they already have something quite good for internal use, maybe trying to make it "safe" before releasing it. My guess: we will have a competent JARVIS(minus the holograms) this year.
- visarga 4y ago> the democratization and commodification of powerful technology accessible and affordable to the public Empowering everyone equally, very low barrier of entry. The spread of AI will make some skills become less important and other skills more important. There will be painful social changes. Memorising stuff, being exact, being careful, diligent - all these things can be done by LLM. But also creative recombination of ideas. For now we still hold supremacy in long form content, complex software projects and detecting inconsistencies, but they could be emergent qualities in GPT-5.
- sbierwagen 4y agoIf you thought crypto miners drove up the prices of GPUs, just wait until a gaming card can host a person who can get a job. Integer-quantized LLaMA can fit on a 4090, and isn't quite human-level. If a fully aligned, reliably non-hallucinary turingrade LLM can run on the next generation 5 series GPUs then expect their market price to quadruple or more.