zander_jiang

3 ms·

1. 1.▲
   by zander_jiang 3mo ago

   The book is really well written.
2. 2.▲
   by zander_jiang 4mo ago

   I wonder what happens to fireworks ai, who provided the infra to train and serve composer 2, cursor was their largest customer, and they're probably loosing it.
3. 3.▲
   by zander_jiang 4mo ago

   tilert is a highly optimized megakernel, its a single kernel that does the entire decode pass, this enables overlapping weight loading with computation, eliminates cuda launch overhead (CUDA graph does not, contrary to what most people thin
4. 4.▲
   by zander_jiang 4mo ago

   tilert is closed source, the repo is just a python wrapper that invokes the binary.