4 ms·

"Latent space representation" I have been waiting for this moment in the evolution of AI. Well, waiting with some trepidation. It seems inevitable that frontier

by tpurves 3mo ago

"Latent space representation" I have been waiting for this moment in the evolution of AI. Well, waiting with some trepidation. It seems inevitable that frontier AI's will, at some point, leave behind human-comprehensible representations of language. Purely for functional reasons, it's going to start making sense for AI agents to communicate amongst themselves in much more efficient ways than borrowing the languages of flesh-bag humans as an interface medium. I Imagine next that programming languages, interfaces and API design starts going this direction next. Being written, expressed and optimized as blobs of high dimensional vector space. As humans we might still be able to understand some abstractions of what our AI's are talking about to each other, but maybe not more so then we understand how different regions of our own brain communicate with each other.

EGreg 3mo ago
I strongly believe that the future is the other way. New programming languages and environments designed for strong auditability and preventing bugs will dominate. Only bad actors will use latent space representation, and it might even be outlawed. But the bad actors will proliferate underground… I actually built such a language: https://magarshak.com/U.html https://magarshak.com/U.html
- mparramon 3mo ago
  Every time a state tries to regulate, it loses to the states that promote instead. Seems to be a better evolutionary strategy.
- michaellee8 3mo ago
  is that called rust? that is the only thing i feel safe to let agents vibe code
TowerTall 3mo ago
Google's AI just created its own universal 'language' (2016) https://www.wired.com/story/google-ai-language-create/ https://www.wired.com/story/google-ai-language-create/
- StilesCrisis 3mo ago
  That's not really a language. It was just a reporter dumbing down the idea of "vectors in latent space" which eventually became LLMs.
karma_daemon 3mo ago
I've been thinking the same! Haha Even for like token efficiency it could make sense - like imagine if the representation were more compact Agents acn already translate languages quite well. It doesn't seem crazy that they could work and think in a model specific language, and then translate back to English or something for the user
mparramon 3mo ago
It has already started: zero-graph v1 origin source-text module "hello" hash "graph:a7f7e6899a73f3b4" node #decl_ad8d9028 Function name:"main" type:"Void" public:true fallible:true node #param_4610ae76 Param name:"world" type:"World" node #expr_c403020c MethodCall name:"write" type:"Void" node #expr_653eeb6e Literal type:"String" value:"hello from zero\n" edge #expr_c403020c arg #expr_653eeb6e order:0 https://zerolang.ai/ https://zerolang.ai/
UltraSane 3mo ago
It seems like the most efficient method would be for LLMs to communicated by exchanged latent space representations directly. Serial language is a incredibly inefficient way to encode these, a lot like flattening a complex graph into text.
nextaccountic 3mo ago
Is it really more efficient? Any token becomes huge in latent space.

by tpurves 3mo ago

EGreg 3mo ago

I strongly believe that the future is the other way. New programming languages and environments designed for strong auditability and preventing bugs will dominate. Only bad actors will use latent space representation, and it might even be outlawed. But the bad actors will proliferate underground… I actually built such a language: https://magarshak.com/U.html https://magarshak.com/U.html

mparramon 3mo ago
Every time a state tries to regulate, it loses to the states that promote instead. Seems to be a better evolutionary strategy.
michaellee8 3mo ago
is that called rust? that is the only thing i feel safe to let agents vibe code

TowerTall 3mo ago

Google's AI just created its own universal 'language' (2016) https://www.wired.com/story/google-ai-language-create/ https://www.wired.com/story/google-ai-language-create/

StilesCrisis 3mo ago
That's not really a language. It was just a reporter dumbing down the idea of "vectors in latent space" which eventually became LLMs.

karma_daemon 3mo ago

I've been thinking the same! Haha Even for like token efficiency it could make sense - like imagine if the representation were more compact Agents acn already translate languages quite well. It doesn't seem crazy that they could work and think in a model specific language, and then translate back to English or something for the user

mparramon 3mo ago

It has already started: zero-graph v1 origin source-text module "hello" hash "graph:a7f7e6899a73f3b4" node #decl_ad8d9028 Function name:"main" type:"Void" public:true fallible:true node #param_4610ae76 Param name:"world" type:"World" node #expr_c403020c MethodCall name:"write" type:"Void" node #expr_653eeb6e Literal type:"String" value:"hello from zero\n" edge #expr_c403020c arg #expr_653eeb6e order:0 https://zerolang.ai/ https://zerolang.ai/

UltraSane 3mo ago

It seems like the most efficient method would be for LLMs to communicated by exchanged latent space representations directly. Serial language is a incredibly inefficient way to encode these, a lot like flattening a complex graph into text.

nextaccountic 3mo ago

Is it really more efficient? Any token becomes huge in latent space.