4 ms·
Worth noting that according to the initial press release, they're also working on Falcon 180B, which would be the largest (and likely most effective) open sourc
by logicchains 3y ago
Worth noting that according to the initial press release, they're also working on Falcon 180B, which would be the largest (and likely most effective) open source model by far.
- jumpCastle 3y agoNot by far, there's bloom and opt if you count it.
- airgapstopgap 3y agoBloom and OPT are weak, predictably so. Nobody uses them (except for research sometimes, and even then rarely). It doesn't make sense to look for hardware to run a 176B model when a 13B outperforms it across the board.
- lordofgibbons 3y agoThose weren't open source though. OPT is non-commercial, and BLOOM had this extremely deranged OpenRAIL license which includes user hostile things like forced updates, and other weird restrictions.
- gardnr 3y agoFalcon was intially release under a weird modified license. It looks like they changed it to Apache May 31st: https://www.tii.ae/news/uaes-falcon-40b-now-royalty-free https://www.tii.ae/news/uaes-falcon-40b-now-royalty-free
- moffkalast 3y agoAnd also the most unfeasibly impossible to run.
- bioemerl 3y agoNo, don't tell me that, I'm going to need more graphics cards now.