oscarrovira

3 ms·

1. 1.▲
   by oscarrovira 3y ago

   There’s a percentage of users that do care about token generation speed as they chain multiple API calls. The performance is all thanks to TensorRT-LLM, Mystic takes care of the engineering of getting a scalable endpoint out of it, i.e, no
2. 2.▲
   Deploy Gemma 7B with TensorRT-LLM and achieve > 500 tok/s(docs.mystic.ai)

   10 points by oscarrovira 3y ago|8 comments
3. 3.▲
   Deploy ONNX model with serverless GPU(app.arcade.software)

   3 points by oscarrovira 4y ago|0 comments
4. 4.▲
   Stable Diffusion free demo and production API (~$0.0025 /image)(old.reddit.com)

   2 points by oscarrovira 4y ago|0 comments
5. 5.▲
   DALL·E Mini and Mega demo and production API(playgrounds.ai)

   4 points by oscarrovira 4y ago|0 comments
6. 6.▲
   Neuro (YC W21) Is Hiring Engineers to Build APIs for ML Compute, £40-100k Bath,UK(jobs.lever.co)

   1 points by oscarrovira 5y ago
7. 7.▲
   Neuro (YC W21) Is Hiring Python Engineers – Bath, UK(ycombinator.com)

   1 points by oscarrovira 6y ago