4 ms·

Machine Translation used to involve complicated grammatical decoding, using search. Now we just use transformers for MT, with much simpler decoding that doesn't

Machine Translation used to involve complicated grammatical decoding, using search. Now we just use transformers for MT, with much simpler decoding that doesn't really need search. Perhaps we can reach full inception. Let's use our current best-of-breed predictive models to learn heuristics for neural architecture search (NAS) and search for new neural blocks (better than transformer and mamba).

FeepingCreature 3y ago
"Every time I fire a linguist, the performance of the speech recognizer goes up." --Frederick Jelinek
xg15 3y ago
...and finally enter a world where literally no one understands anymore how the technology works, not even the people developing them. Singularity, here we come...
- zwirbl 3y ago
  We could then go on to create something akin to the mechanicum, create the position of tech priests and have them pray to the machine god on on our behalf
  - moi2388 3y ago
    If you think that still needs to be created you haven’t worked at tech support
    - TeMPOraL 3y ago
      The priest class is there, what we need is to level up the machine god itself.
  - smcameron 3y ago
    The tech priests will build electric monks to do that job.
- throwuwu 3y ago
  Barring the singularity, just because you find something with search doesn’t mean you can’t understand why it’s better.
deleted 3y ago
[deleted]