mdredze

5 ms·

1. 1.▲
   by mdredze 4y ago

   Hi! I'm a co-author on the paper (Mark Dredze). The arxiv paper is written for researchers who are building these models. We benefited tremendously from reading papers on GPT-3, PaLM, Chinchilla, Galactica, Gopher, Bloom, OPT, most of
2. 2.▲
   by mdredze 4y ago

   Hi! I'm a co-author on the paper (Mark Dredze). "Doing math" is not really a goal of bloombergGPT. Take a look at our applications in the paper, which include information extraction, sentiment, reasoning, knowledge. These are
3. 3.▲
   by mdredze 4y ago

   Hi! I'm a co-author on the paper (Mark Dredze). We didn't compare to GPT-4, or any instruction tuned model. We're comparing a causal LM pre-trained only (BloombergGPT) to other causal LM pre-trained only models. You need to c