3 ms·

Conlangs are fun, but what will probably happen is we will evolve more efficient communication protocols as bandwidth increases via multimedia communication, Ne

by wilg 3y ago

Conlangs are fun, but what will probably happen is we will evolve more efficient communication protocols as bandwidth increases via multimedia communication, Neuralink, etc.

riku_iki 3y ago
LLMs will talk to each other using embeddings.
- Rhapso 3y ago
  FTR LLM embeddeds are a lot less efficient than ASCII for communication and are likely to stay that way.
  - riku_iki 3y ago
    absolutely not. Transformer layers already communicate using embeddings, and ASCII would be absolutely less efficient there.
    - Rhapso 3y ago
      And how many bits are in an embedded vector?
      - riku_iki 3y ago
        12k for gpt3.
        riku_iki 3y ago
        It is not bits, but weights
        Rhapso 3y ago
        So somehow ascii is less information dense than 12k 32-bit floats per token?