cheptsov

7 ms·

61.
by cheptsov 2y ago
If this receives support for an Apple GPU, it will be incredibly significant!
62.
by cheptsov 2y ago
I wonder why AWQ is not mentioned. It’s pretty popular and I always was curious how it is different from GPTQ.
63.
by cheptsov 2y ago
Sounds like an extremely complex technical problem. I also suggest to look at the use cases when this is needed. One of the problems is that loading weights into the GPU will be so slow that it will be really hard to share the GPU between d
64.
by cheptsov 2y ago
JetBrains PyCharm has this out of the box. VSCode has a nice extension [1] 1. https://marketplace.visualstudio.com/items?itemName=GitHub.v...
65.
by cheptsov 2y ago
Except EU doesn’t have big tech.
66.
by cheptsov 2y ago
Just curious what their agenda can be…
67.
by cheptsov 2y ago
This seems like a very socialistic perspective to me, which might not align well with big tech and innovation. I suggest re-reading "Atlas Shrugged" for this topic.
68.
by cheptsov 2y ago
Unfortunately true, but one can also think that it’s a consequence and not the root cause. Why VC should invest if the environment isn’t supportive? A vicious circle :)
69.
by cheptsov 2y ago
Europe is an amazing place, which is why I moved here in the first place. But for techies, it can be pretty challenging. The issue isn't with the techies themselves, though. The problem is that the environment here holds back big tech,
70.
by cheptsov 2y ago
It's socialism versus capitalism at its finest. The problem is that socialism risks regulating big tech out of existence. Is that an issue? Absolutely. By stifling big tech, Europe becomes heavily dependent on the US, which ultimately
71.
by cheptsov 2y ago
I’m living in Europe, I'm deeply disappointed by the current situation. The problems run much deeper than just regulations; they extend far beyond politics. 1. VCs outright avoid investing in deep tech, with only rare exceptions. 2. Fo
72.
by cheptsov 2y ago
Can't wait to see how open-source tools for LLMs emerge! Big congrats to DVC for jumping into the LLM scene. Definitely excited to try it out, especially with LLMs running on dstack
73.
by cheptsov 2y ago
Thank you! This link is very helpful.
74.
by cheptsov 2y ago
Would love to give it a try! Thanks for answering my question.
75.
by cheptsov 2y ago
Wow, somebody doesn’t like Docker enough to downvote my question.
76.
by cheptsov 2y ago
Sounds really awesome. Any chance someone can suggest if this works also inside a Docker container?
77.
by cheptsov 2y ago
A nice idea! Is there a blog post with more examples and details on how it works? Would be great to read.
78.
by cheptsov 2y ago
Environment variables are especially convenient IMO for parameterizing Docker images when running containers, e.g. using Docker or Kubernetes, etc. Also, for configuring all sort of credentials for libraries, e.g. AWS, WandB, HuggingFace, e
79.
by cheptsov 2y ago
Sorry if the question is stupid but maybe someone can help understand it better. I’m using direnv (1). I like the tool for its simplicity. How are dotenv or dotenvx different? (1) https://direnv.net/
80.
by cheptsov 2y ago
Right now, mostly VSCode - mainly because it’s a desktop IDE and it also supports notebooks.
81.
by cheptsov 2y ago
That will be interesting. Happy to test and share feedback. Previously, I was a part of the DataSpell and PyCharm team building notebook support. Now working with dstack, where we support dev environments and super interested in remote sup
82.
by cheptsov 2y ago
Can I use it to connect to a remote Jupyter notebook server?
83.
by cheptsov 2y ago
I'd love to see more individual researchers openly exploring AI safety from a scientific and humanitarian perspective, rather than just the technical or commercial angles.
84.
by cheptsov 2y ago
With dstack you can either utilize multiple affordable cloud GPU providers at once to get the cheapest GPU offer or also use an own cluster of on-prem servers. Dstack supports both altogether. Disclaimer: I’m a core contributor to dstack
85.
by cheptsov 2y ago
A good clickbait title. One should credit the author for that. As to the topic, IMO, there is a contradiction. The only way to handle big data is to divide it into chunks that aren’t expensive to query. In that sense, no data is "big&q
86.
by cheptsov 2y ago
We build a similar tool except we focus on AI workloads. Also support on-prem clusters now in addition to GPU clouds. https://github.com/dstackai/dstack
87.
by cheptsov 2y ago
I‘m a happy user of direnv. Hard to imagine my life without it. The only problem is not to forget to include it to .gitignore.
88.
by cheptsov 2y ago
Always wondered why not spend the same amount of effort on talking to users, and improving the product, finding early users? Are there any reads on whether it’s worth at all to get in to YC these days?
89.
by cheptsov 2y ago
Certainly interested in having more solutions helping use SQLite. At dstack.ai, we use SQLite and love it. - For our hosted version, we use Litestream; we lack a UI for accessing data.
90.
by cheptsov 2y ago
Not exactly this, but something related. At https://github.com/dstackai/dstack , we build an alternative to K8S for AI infra.

More ›