dzhulgakov

3 ms·

1. 1.▲
   by dzhulgakov 3y ago

   You can try Mixtral live at https://app.fireworks.ai/ (soon to be faster too) Warning: the implementation might be off as there's no official one. We at Fireworks tried to reverse-engineer model architecture today with
2. 2.▲
   by dzhulgakov 7y ago

   In this experimental release with prebuilt binaries it’s about 5Mb per architecture. This includes all operators for inference (that is forward only). We’re working on selective compilation so that you can build a smaller bundle with only a
3. 3.▲
   by dzhulgakov 9y ago

   The recurrent network work is under way - we are revisiting the designs to consciously balance between performance and API niceness. We'll share more tech details in the upcoming days. Right now, this is an example RNN: https:/&
4. 4.▲
   by dzhulgakov 9y ago

   Right now we're training models in server-side environment and run highly optimized inference on pre-trained model in products (with focus on inference optimization). The framework itself allows fine-tuning and training of the model on