4 ms·

On the plus side i think at-home LLMs will continue to get a lot better. ChatGPT 3.5/4 both seem in reach for Llama2 and seeing all the amazing fine tunings tha

On the plus side i think at-home LLMs will continue to get a lot better. ChatGPT 3.5/4 both seem in reach for Llama2 and seeing all the amazing fine tunings that were available for Llama1, i suspect we have a very functional future of at home LLMs. I say functional because i don't think we've seen the larger reasoning skills scale well for smaller deployments, so that may be out of reach. But i think a future were we run something far better than Siri, entirely at home, hooked up to our home APIs in a functional spoken interface seems in reach and awesome (to me hah). I look forward to hooking all my at-home cameras up to a voice recognition, image recognition, and LLM detection suite and just speak aloud and have the AI-suite "do stuff". It sounds really, really fun to me. If it's cheap it'll be slow, but imo that's okay. For home use i think these systems can be the glue that tie our DBs/Ingestions/etc together, rather than the big-brain that knows everything.

JimtheCoder 3y ago
"I look forward to hooking all my at-home cameras up to a voice recognition, image recognition, and LLM detection suite and just speak aloud and have the AI-suite "do stuff". It sounds really, really fun to me." Alternatively, this sounds like the starting plot to a crossover sci-fi/horror movie...
- renewiltord 3y ago
  Of course it does. That's the structure of all sci-fi horror https://dresdencodak.com/2009/09/22/caveman-science-fiction/ https://dresdencodak.com/2009/09/22/caveman-science-fiction/
- jstarfish 3y ago
  They never read Demon Seed.
- dandellion 3y ago
  The door refused to open. It said, “Five cents, please.” He searched his pockets. No more coins; nothing. “I’ll pay you tomorrow,” he told the door. Again he tried the knob. Again it remained locked tight. “What I pay you,” he informed it, “is in the nature of a gratuity; I don’t have to pay you.” “I think otherwise,” the door said. “Look in the purchase contract you signed when you bought this conapt.” In his desk drawer he found the contract; since signing it he had found it necessary to refer to the document many times. Sure enough; payment to his door for opening and shutting constituted a mandatory fee. Not a tip. “You discover I’m right,” the door said. It sounded smug. From the drawer beside the sink Joe Chip got a stainless steel knife; with it he began systematically to unscrew the bolt assembly of his apt’s money-gulping door. “I’ll sue you,” the door said as the first screw fell out. Joe Chip said, “I’ve never been sued by a door. But I guess I can live through it. -- Philip K. Dick, Ubik
  - mensetmanusman 3y ago
    The 5 cent reference has a history in Boston, it’s why the mbta card is called the Charlie card: https://youtu.be/MbtkL5_f6-4?si=IQZrPJhDWhNVyhx_ https://youtu.be/MbtkL5_f6-4?si=IQZrPJhDWhNVyhx_
  - Gigachad 3y ago
    More like "the door misunderstood and thought you said something racist, your account has now been terminated and doors disabled"
- chc 3y ago
  Literally any new technology could be the plot to a sci-fi horror movie. The entire concept of the genre is to show how progress could go awry.
NBJack 3y ago
Except for the part Llama 2 weights are still being gated by Meta. There are certainly ways around this, but officially this hasn't even changed, even for Llama 1. I'm not certain Meta has any real incentive to do so. This arguably puts a bit of a damper on home solutions. Falcon looks very promising, but we seem to be at the early stages of its release, and I haven't seen much validating the claims made about it. I'd love to host an in-home alternative to Alexa, but I don't think I have the time to train a replacement on my own. Here's hoping this changes

JimtheCoder 3y ago

"I look forward to hooking all my at-home cameras up to a voice recognition, image recognition, and LLM detection suite and just speak aloud and have the AI-suite "do stuff". It sounds really, really fun to me." Alternatively, this sounds like the starting plot to a crossover sci-fi/horror movie...

renewiltord 3y ago
Of course it does. That's the structure of all sci-fi horror https://dresdencodak.com/2009/09/22/caveman-science-fiction/ https://dresdencodak.com/2009/09/22/caveman-science-fiction/
jstarfish 3y ago
They never read Demon Seed.
dandellion 3y ago
The door refused to open. It said, “Five cents, please.” He searched his pockets. No more coins; nothing. “I’ll pay you tomorrow,” he told the door. Again he tried the knob. Again it remained locked tight. “What I pay you,” he informed it, “is in the nature of a gratuity; I don’t have to pay you.” “I think otherwise,” the door said. “Look in the purchase contract you signed when you bought this conapt.” In his desk drawer he found the contract; since signing it he had found it necessary to refer to the document many times. Sure enough; payment to his door for opening and shutting constituted a mandatory fee. Not a tip. “You discover I’m right,” the door said. It sounded smug. From the drawer beside the sink Joe Chip got a stainless steel knife; with it he began systematically to unscrew the bolt assembly of his apt’s money-gulping door. “I’ll sue you,” the door said as the first screw fell out. Joe Chip said, “I’ve never been sued by a door. But I guess I can live through it. -- Philip K. Dick, Ubik
- mensetmanusman 3y ago
  The 5 cent reference has a history in Boston, it’s why the mbta card is called the Charlie card: https://youtu.be/MbtkL5_f6-4?si=IQZrPJhDWhNVyhx_ https://youtu.be/MbtkL5_f6-4?si=IQZrPJhDWhNVyhx_
- Gigachad 3y ago
  More like "the door misunderstood and thought you said something racist, your account has now been terminated and doors disabled"
chc 3y ago
Literally any new technology could be the plot to a sci-fi horror movie. The entire concept of the genre is to show how progress could go awry.

NBJack 3y ago

Except for the part Llama 2 weights are still being gated by Meta. There are certainly ways around this, but officially this hasn't even changed, even for Llama 1. I'm not certain Meta has any real incentive to do so. This arguably puts a bit of a damper on home solutions. Falcon looks very promising, but we seem to be at the early stages of its release, and I haven't seen much validating the claims made about it. I'd love to host an in-home alternative to Alexa, but I don't think I have the time to train a replacement on my own. Here's hoping this changes