3 ms·
Awesome! How are you doing the synthetic data generation? What is the best open source small LLM?
by robrenaud 3y ago
Awesome!
How are you doing the synthetic data generation?
What is the best open source small LLM?
- razodactyl 3y agohttps://pastebin.com/Rz9k1xMt https://pastebin.com/Rz9k1xMt https://pastebin.com/6bxRYx31 https://pastebin.com/6bxRYx31 Here are some examples - it's been a bit of a side-obsession for the last few months experimenting with different architectures. There are so many different ways this could have gone and I've finally zeroed in one an approach that works which is why I'm starting to open up. There will definitely be a dump in the near future of absolutely everything related to this project. The ultimate goal was to run it on CPU.