cheptsov

7 ms·

91.
by cheptsov 2y ago
Why not just show it per layer and folder via plain text?
92.
by cheptsov 2y ago
Would be great if you could share TL;DR with how it works and other details
93.
by cheptsov 2y ago
You can use https://github.com/dstackai/dstack to deploy your model to the most affordable GPU clouds. It supports auto-scaling and other features. Disclaimer: I’m the creator of dstack.
94.
by cheptsov 2y ago
Interesting project! Many people face the problem and look up for general advice. Copilot seems to be the best interface, in my opinion, to get started investing and gradually dive deeper into it.
95.
by cheptsov 3y ago
Thank you for sharing the announcement here! I'm the founder of dstack. To share more context: dstack is an open-source tool designed for managing AI infrastructure across various cloud platforms. It's lighter and more specificall
96.
by cheptsov 3y ago
Same question here. Anyone can point to the source that says they are going to publish the weights?
97.
by cheptsov 3y ago
Sounds promising! Gonna check it out.
98.
by cheptsov 3y ago
I have a lot of respect for Erik and his work with Modal, which I've heard a lot of good feedback about. What Erik says about serverless and code over configuration can benefit many users and companies. However, I strongly disagree on
99.
by cheptsov 3y ago
Any chance you plan to offer the API to cloud LPUs? And not just the LLM API? It would be cool run custom code (training, serving, etc).
100.
by cheptsov 3y ago
Great job on the project! It looks fantastic. Thanks to your post, I discovered Fly's GPUs. We are currently developing https://github.com/dstackai/dstack to enable users to run any model on any cloud. I am curiou
101.
by cheptsov 3y ago
Congrats on the launch! Excited to hear that you go fully open-source with this! There is a certain need for great visualization tools that enable building apps.
102.
by cheptsov 3y ago
To be frank, I’m not a fan of Kubernetes as long as GPU is concerned. Kubernetes has a very large legacy. Why we think dstack can do better: 1. Lightweight-ness - that it very easy to integrate dstack with modern cloud GPU providers. 2. AI-
103.
by cheptsov 3y ago
Vast.ai is supported. RunPod not yet but on our list! The full list of all supported targets can be found at https://dstack.ai/docs/installation/
104.
by cheptsov 3y ago
Yup, that’s what we are building now. Tasks will allow to specify how many nodes you need, and dstack will automatically provision a cluster or will run it using the one that is already provisioned. Please feel free to ping me on our Diacor
105.
by cheptsov 3y ago
This is from https://dstack.ai/blog/2023/06/29/say-goodbye-to-managed-not... Yup, that's why we support dev environments as first-class citizens. Now, also support tasks (for fine-tuning, other batc
106.
by cheptsov 3y ago
Thank you! Yes, that's precisely our intent. Most AI platforms offer nice yet proprietary solutions for training and deployment. We wish there were a simple and open standard that any provider could support.
107.
by cheptsov 3y ago
Thanks for sharing dstack on HN. I'm the creator of dstack and would love to hear your feedback. We're also working on creating a new standard for GPU orchestration, similar to Kubernetes.
108.
by cheptsov 3y ago
We are building dstack.ai, an open-source tool that helps run anything on vast.ai and TensorDock. Happy to hear your feedback.
109.
Show HN: TensorDock's affordable cloup GPU can now be used via dstack(dstack.ai)
1 points by cheptsov 3y ago|0 comments
110.
by cheptsov 3y ago
How do you fit Llama2-70b into V100? V100 is 16GB. Llama2-70b 4bit would require up to 40GB. Also, what do you use for inference to get 300+tokens/s?
111.
Rag with Llama Index and Weaviate, running LLMs in your preferred cloud(dstack.ai)
4 points by cheptsov 3y ago|0 comments
112.
Deploying LLMs in any cloud with Python API(dstack.ai)
1 points by cheptsov 3y ago|0 comments
113.
Fine-tuning Llama 2 using spot instances across multiple clouds or Lambda Cloud(dstack.ai)
1 points by cheptsov 3y ago|0 comments
114.
Say Goodbye to Managed Notebooks(dstack.ai)
1 points by cheptsov 3y ago|0 comments
115.
Show HN: Running LLM As Chatbot in your cloud with a single command(github.com)
5 points by cheptsov 3y ago|0 comments
116.
by cheptsov 3y ago
Yup, we're already working on an experimental support for Lambda Labs! Ping us if you'd like to test it out. Perhaps we could show something already next week.
117.
by cheptsov 3y ago
Congrats to the MosaicML and wish all the luck! If anyone is interested in MosaicML alternatives, check out dstack, we are building its OSS and cloud-agnostic alternative: https://dstack.ai . Disclaimer: I'm the founder and
118.
Embrace Dev Environments, Leave Manual SSH Behind(dstack.ai)
1 points by cheptsov 3y ago|0 comments
119.
by cheptsov 3y ago
Looks really cool. Congrats on the launch! A quick question. Do you allow to build custom public images? We’d love to integrate dstack.ai with Oblivus.
120.
by cheptsov 3y ago
Not yet, but we are excited to announce that we will be recording a live hands-on session for DataTalks Club Open-Source Spotlight next week together with Alexey Grigorev. To stay in the loop, you can subscribe to either our Twitter [1] or

More ›