3 ms·

> Even the default example of "Hello, how are you?" from English to French yields an awfully wrong result ("Hello, what is your experience?")... Really? For me

by nl 4y ago

> Even the default example of "Hello, how are you?" from English to French yields an awfully wrong result ("Hello, what is your experience?")... Really? For me that gives "Bonjour, comment êtes-vous?" with the default settings. > text generation output Yeah, text generation is really something that requires a big model. The Llama 7B param model quantized to 4bit is 13G and that is the smallest model I'd actually attempt to use for unconstrained text generation.

wdaher 4y ago
> "Bonjour, comment êtes-vous?" The idiomatic translation here would be "Bonjour, comment allez-vous?"
- xenova 4y ago
  As shown in the demo video (on GitHub [1], or Twitter [2]), you do get that result sometimes (with randomness) Using greedy sampling (sample=false and top_k=0) you get "Bonjour, comment êtes-vous?", which appears to be a very direct translation. As mentioned in one of my previous comments, these inaccuracies also occur in the PyTorch models, and so, it's not the library's fault :') [1] https://github.com/xenova/transformers.js https://github.com/xenova/transformers.js [2] https://twitter.com/xenovacom/status/1628895478749315073 https://twitter.com/xenovacom/status/1628895478749315073
Fiaxhs 4y ago
« Bonjour, comment êtes-vous? » barely translates to « Hi, how are you feeling today? » or, depending on the context, to something like « Hi, please describe yourself » to a native French speaker.