4 ms·

Somewhere in here there's a joke about how many tokens it takes to turn on a lightbulb.

throwup238 1y ago
It deserves a minor rewrite of the Black Mirror episode Fifteen Million Merits where people do menial labor like folding laundry and washing dishes to earn tokens so that their LLM will dispense their toothpaste and send Studio Ghibli stylized birthday cards to their friends.
- mrbungie 1y ago
  inb4: When sama and co talk about UBI, they mean a variation of it based around a memecoin tethered/indexed on (tik)tokens.
  - toomuchtodo 1y ago
    https://en.wikipedia.org/wiki/World_(blockchain) https://en.wikipedia.org/wiki/World_(blockchain)
a2128 1y ago
Probably 1,000 for the system prompt, 400 for the audio speech-to-text, 8 for the query, 180 for the thinking, 12 for the tool call, 33 for the response with a useless follow-up question
- godelski 1y ago
  All to achieve something that could be done with a Raspberry Pi. You could do all this locally too. https://gist.github.com/mgarratt/afb3b57a08e2eb2479eb6083a86d8a64 https://gist.github.com/mgarratt/afb3b57a08e2eb2479eb6083a86... https://www.xda-developers.com/ollama-ai-comparison-raspberry-pi-5/ https://www.xda-developers.com/ollama-ai-comparison-raspberr... https://www.xda-developers.com/raspberry-pi-voice-assistant-how/ https://www.xda-developers.com/raspberry-pi-voice-assistant-... https://www.youtube.com/watch?v=o1sN1lB76EA https://www.youtube.com/watch?v=o1sN1lB76EA
  - Sean-Der 1y ago
    This project isn’t tightly coupled with anything. Any service that supports WebRTC should work! Also I was hoping to push people toward a RTOS. Better experience then a raspberry pi, I can cycle power and be back way quicker. Also cheaper/more power efficient. I also think I unfairly like ESP because it’s an excuse to write C :)
    - godelski 1y ago
      Home Assistant integrates with WebRTC btw[0]. Also, why make the ESP32 the the hotspot? Why not just connect to the same network? Then you're not really range limited. > I also think I unfairly like ESP because it’s an excuse to write C :) Is the comment about Home Assistant being python? Yeah, I can get that. Feels weird to be using slow scripting languages on lean hardware. Though of course you can write whatever routines in C and just patch it in to the interface. The ESPs are cheaper (here's the non-dev kit which has WiFi[1]), but way less powerful. I don't think you could get away with doing things on device. Though I wouldn't call that dev kit cheaper and that price point was context of my comment. FWIW, I don't think there's really anything wrong with the project other than just that it comes off as doing things that have already been done before but presenting as if something novel was done. I'm all for reinventing the wheel. For fun, education, or even to improve. Just if I'm being honest, it came off with some weird vibes because of that. I imagine that's how some people are responding as well. [0] https://www.home-assistant.io/integrations/homeassistant/ https://www.home-assistant.io/integrations/homeassistant/ [1] https://shop.m5stack.com/products/m5stamp-esp32s3-module https://shop.m5stack.com/products/m5stamp-esp32s3-module
      - regularfry 1y ago
        > Also, why make the ESP32 the the hotspot? Why not just connect to the same network? Then you're not really range limited. Because then they don't have to include the ability to configure wifi, which (while not that hard) is one more thing to do and for a hackathon that's not really contributing to the end goal.
        1y ago

It deserves a minor rewrite of the Black Mirror episode Fifteen Million Merits where people do menial labor like folding laundry and washing dishes to earn tokens so that their LLM will dispense their toothpaste and send Studio Ghibli stylized birthday cards to their friends.

mrbungie 1y ago
inb4: When sama and co talk about UBI, they mean a variation of it based around a memecoin tethered/indexed on (tik)tokens.
- toomuchtodo 1y ago
  https://en.wikipedia.org/wiki/World_(blockchain) https://en.wikipedia.org/wiki/World_(blockchain)

a2128 1y ago

Probably 1,000 for the system prompt, 400 for the audio speech-to-text, 8 for the query, 180 for the thinking, 12 for the tool call, 33 for the response with a useless follow-up question

godelski 1y ago
All to achieve something that could be done with a Raspberry Pi. You could do all this locally too. https://gist.github.com/mgarratt/afb3b57a08e2eb2479eb6083a86d8a64 https://gist.github.com/mgarratt/afb3b57a08e2eb2479eb6083a86... https://www.xda-developers.com/ollama-ai-comparison-raspberry-pi-5/ https://www.xda-developers.com/ollama-ai-comparison-raspberr... https://www.xda-developers.com/raspberry-pi-voice-assistant-how/ https://www.xda-developers.com/raspberry-pi-voice-assistant-... https://www.youtube.com/watch?v=o1sN1lB76EA https://www.youtube.com/watch?v=o1sN1lB76EA
- Sean-Der 1y ago
  This project isn’t tightly coupled with anything. Any service that supports WebRTC should work! Also I was hoping to push people toward a RTOS. Better experience then a raspberry pi, I can cycle power and be back way quicker. Also cheaper/more power efficient. I also think I unfairly like ESP because it’s an excuse to write C :)
  - godelski 1y ago
    Home Assistant integrates with WebRTC btw[0]. Also, why make the ESP32 the the hotspot? Why not just connect to the same network? Then you're not really range limited. > I also think I unfairly like ESP because it’s an excuse to write C :) Is the comment about Home Assistant being python? Yeah, I can get that. Feels weird to be using slow scripting languages on lean hardware. Though of course you can write whatever routines in C and just patch it in to the interface. The ESPs are cheaper (here's the non-dev kit which has WiFi[1]), but way less powerful. I don't think you could get away with doing things on device. Though I wouldn't call that dev kit cheaper and that price point was context of my comment. FWIW, I don't think there's really anything wrong with the project other than just that it comes off as doing things that have already been done before but presenting as if something novel was done. I'm all for reinventing the wheel. For fun, education, or even to improve. Just if I'm being honest, it came off with some weird vibes because of that. I imagine that's how some people are responding as well. [0] https://www.home-assistant.io/integrations/homeassistant/ https://www.home-assistant.io/integrations/homeassistant/ [1] https://shop.m5stack.com/products/m5stamp-esp32s3-module https://shop.m5stack.com/products/m5stamp-esp32s3-module
    - regularfry 1y ago
      > Also, why make the ESP32 the the hotspot? Why not just connect to the same network? Then you're not really range limited. Because then they don't have to include the ability to configure wifi, which (while not that hard) is one more thing to do and for a hackathon that's not really contributing to the end goal.
      - 1y ago