4 ms·
None of those matters (except multimodal). If you are running a business, the only thing that matters is a) How does it perform on my set of evals b) What is
by meta_x_ai 2y ago
None of those matters (except multimodal). If you are running a business, the only thing that matters is
a) How does it perform on my set of evals
b) What is the cost/latency of serving it to my consumers.
It shouldn't matter to me how many parameters, corpus it is trained on, whether it's LLM or Transformer or something else
- marcosdumay 2y ago> How does it perform on my set of evals What kinds of eval? Personally, I have no idea what kind of data you can throw at a "foundation model" and what kind of response you will get. The only thing it says is that there's machine learning involved... Once you get enough context to understand it's not a spin-off of a TV series.
- int_19h 2y ago"Foundation model" is not Amazon lingo, though, but pretty standard industry term at this point. If you're doing any sort of AI in prod, you know what it means.