2 ms·

I am sad that there doesn’t seem to be any community whatsoever around _truly_ open models that are released with source data and training methodology, such tha

I am sad that there doesn’t seem to be any community whatsoever around _truly_ open models that are released with source data and training methodology, such that they could actually be reproduced given the resources. We’ve allowed the term “open” to be diluted to a shocking extent.

kamranjon 3mo ago
Allen AI is fighting the good fight with their Olmo models - I’m hoping for a new release soon. Also huggingface has released some pretty nice smaller models with open pipelines like Smollm.