8 ms·

Imagine having ChatGPT level AI running in an ASIC inside earphones. This could be like an always-on buddy, available offline and able to access resources when

Imagine having ChatGPT level AI running in an ASIC inside earphones. This could be like an always-on buddy, available offline and able to access resources when you're connected. Or in Google Glasses. The Readme states that it's more optimized for ASIC than the transformer architecture used by ChatGPT.

IIAOPSW 4y ago
How will you know which voice in your head is yours? Maybe you are both.
- LoganDark 4y ago
  > How will you know which voice in your head is yours? Maybe you are both. As someone with DID I wonder this every single day.
- wruza 4y ago
  Maybe that will teach us about fragility of our definition of consciousness and agency. For some reason many people think that they are insulated from outside effects unless they’re right in their brain. Which is not true.
RobotToaster 4y ago
I wonder if we will see LLMs on FPGAs or FPGA like devices. Crypto went from graphics cards to ASICs, we may see something similar with LLMs given the hype.
- pffft8888 4y ago
  I always think of FGPAs for things you want to update without having to repurchase the hardware. If the FPGA inside a gadget can be reprogrammed over the Internet then I think it's more suited than an ASIC for LLMs.
- int_19h 4y ago
  It could go even further, in theory. The kind of ops that the current crop of LLMs needs is very simple, and at the same time there's no hard requirement for precision (which is why 4-bit quantization works so well). This means that unconventional approaches such as analog computing are potentially in the play again - it's easy to do addition and multiplication in an analog circuit, if you don't care about the answer being precise, and in theory one could pack a lot more of those circuits in the same space.
  - smaddox 4y ago
    There's already at least one company with a product: Mythic AMP https://mythic.ai/products/m1076-analog-matrix-processor/ https://mythic.ai/products/m1076-analog-matrix-processor/ And there's several research papers about other architectures. For example: https://arxiv.org/abs/2205.05853 https://arxiv.org/abs/2205.05853
coolspot 4y ago
Have you watched the movie “Her”?
- pffft8888 4y ago
  No, but I think an AI is going to be Them, by default, not Her. for a while, until we figure out if there is a neurological basis for gender, and if so, how to mimic it.
  - witheld 4y ago
    Don’t…read a book by its cover, my friend. Her is not particularly about the gender expression of the robot.
  - flangola7 4y ago
    What is Them?
    - lahwran 4y ago
      like Her, but there could be many or there could be one
908087 4y ago
[dead]
textninja 4y ago
> Imagine having ChatGPT level AI running in an ASIC inside earphones. Oh, it’s going in brains. And no, don’t sign me up.
eldenring 4y ago
Would an ASIC really be better than GPUs? I'm not 100% sure but aren't low power GPUs essentially ASICs for matrix multiplication.
deleted 4y ago
[deleted]
jossclimb 4y ago
People will use this to create their perfect self. AI will give them witty, charismatic answers to help them get a job, find a mate, entertain others. Eventually they will become AI zombie husks.
- danielbln 4y ago
  Until this tech moves into our brains. AI wetware ushering in transcendence.
- dreamcompiler 4y ago
  Did the name "Dixie Flatline" just pop into anybody's head? https://williamgibson.fandom.com/wiki/Construct https://williamgibson.fandom.com/wiki/Construct

IIAOPSW 4y ago

How will you know which voice in your head is yours? Maybe you are both.

LoganDark 4y ago
> How will you know which voice in your head is yours? Maybe you are both. As someone with DID I wonder this every single day.
wruza 4y ago
Maybe that will teach us about fragility of our definition of consciousness and agency. For some reason many people think that they are insulated from outside effects unless they’re right in their brain. Which is not true.

RobotToaster 4y ago

I wonder if we will see LLMs on FPGAs or FPGA like devices. Crypto went from graphics cards to ASICs, we may see something similar with LLMs given the hype.

pffft8888 4y ago
I always think of FGPAs for things you want to update without having to repurchase the hardware. If the FPGA inside a gadget can be reprogrammed over the Internet then I think it's more suited than an ASIC for LLMs.
int_19h 4y ago
It could go even further, in theory. The kind of ops that the current crop of LLMs needs is very simple, and at the same time there's no hard requirement for precision (which is why 4-bit quantization works so well). This means that unconventional approaches such as analog computing are potentially in the play again - it's easy to do addition and multiplication in an analog circuit, if you don't care about the answer being precise, and in theory one could pack a lot more of those circuits in the same space.
- smaddox 4y ago
  There's already at least one company with a product: Mythic AMP https://mythic.ai/products/m1076-analog-matrix-processor/ https://mythic.ai/products/m1076-analog-matrix-processor/ And there's several research papers about other architectures. For example: https://arxiv.org/abs/2205.05853 https://arxiv.org/abs/2205.05853

coolspot 4y ago

Have you watched the movie “Her”?

pffft8888 4y ago
No, but I think an AI is going to be Them, by default, not Her. for a while, until we figure out if there is a neurological basis for gender, and if so, how to mimic it.
- witheld 4y ago
  Don’t…read a book by its cover, my friend. Her is not particularly about the gender expression of the robot.
- flangola7 4y ago
  What is Them?
  - lahwran 4y ago
    like Her, but there could be many or there could be one

908087 4y ago

[dead]

textninja 4y ago

> Imagine having ChatGPT level AI running in an ASIC inside earphones. Oh, it’s going in brains. And no, don’t sign me up.

eldenring 4y ago

Would an ASIC really be better than GPUs? I'm not 100% sure but aren't low power GPUs essentially ASICs for matrix multiplication.

deleted 4y ago

[deleted]

jossclimb 4y ago

People will use this to create their perfect self. AI will give them witty, charismatic answers to help them get a job, find a mate, entertain others. Eventually they will become AI zombie husks.

danielbln 4y ago
Until this tech moves into our brains. AI wetware ushering in transcendence.
dreamcompiler 4y ago
Did the name "Dixie Flatline" just pop into anybody's head? https://williamgibson.fandom.com/wiki/Construct https://williamgibson.fandom.com/wiki/Construct