4 ms·
Not by far, there's bloom and opt if you count it.
by jumpCastle 3y ago
Not by far, there's bloom and opt if you count it.
- airgapstopgap 3y agoBloom and OPT are weak, predictably so. Nobody uses them (except for research sometimes, and even then rarely). It doesn't make sense to look for hardware to run a 176B model when a 13B outperforms it across the board.
- lordofgibbons 3y agoThose weren't open source though. OPT is non-commercial, and BLOOM had this extremely deranged OpenRAIL license which includes user hostile things like forced updates, and other weird restrictions.
- gardnr 3y agoFalcon was intially release under a weird modified license. It looks like they changed it to Apache May 31st: https://www.tii.ae/news/uaes-falcon-40b-now-royalty-free https://www.tii.ae/news/uaes-falcon-40b-now-royalty-free