dmpetrov

11 ms·

31.
Ask HN: Why Kubernetes is called Cloud-Native?
1 points by dmpetrov 4y ago|4 comments
32.
by dmpetrov 4y ago
I'd like to see a research of WFH impact to people's spendings. Many households have to pay extra for more space to have a home office while companies pay less :)
33.
by dmpetrov 4y ago
It would be helpful to see the difference with MLFlow. The deployment part as well as model registry part.
34.
by dmpetrov 4y ago
Yes, it' from DVC/CML team! We started TPI as a "computational backend" for CML project (CI/CD for ML). But then we realized that it can be useful as an independent tool.
35.
Show HN: TPI – Terraform provider for ML and self-recovering spot-instances(github.com)
12 points by dmpetrov 4y ago|4 comments
36.
by dmpetrov 4y ago
Hey all, we are launching Terraform Provider Iterative (TPI). It was designed for machine learning (ML/AI) teams and optimizes CPU/GPU expenses: 1. Spot instances auto-recovery (if an instance was evicted/terminated) with dat
37.
by dmpetrov 5y ago
In product companies, software development creates value that company sales.
38.
by dmpetrov 5y ago
DVC has metrics logger similar to other experiment management tool: https://github.com/iterative/dvclive/ Also, metrics & params section of the docs explains this (but yes, it is not perfect yet): https:&#x2F
39.
by dmpetrov 5y ago
How can I exit from Notebook? :) It is a whole new level.
40.
by dmpetrov 5y ago
Hey everyone, our team is working on open-source tools for data scientists: dvc.org and cml.dev. These two products help ML teams track ML experiments and run training in the cloud using Git & GitOps approach. Today we are launching DVC
41.
by dmpetrov 6y ago
In a mature project, the number of removed lines is a stronger proxy to productivities. It is related to the unavoidable tech debt that any project has and only the strongest people see it and work on it.
42.
by dmpetrov 6y ago
You can search for Hacktoberfest to find some relevant materials. PS: it was an accident this year related to hacktoberfest :) but it is still good starting point
43.
by dmpetrov 6y ago
> There are so many early-growth startups that could really use experienced leaders but don't have the funding and/or the track record to attract the kind of people they need on a full-time basis. I mostly know early-stage comp
44.
by dmpetrov 6y ago
> it will become the ideal work-style for executives I personally don't believe in this. The executive role is already multifunctional - you need to were multiple hats on the same day or even at the same meeting. The biggest problem
45.
by dmpetrov 6y ago
That's might be fine. Anyway, you need to retrain your models quite often due to the concept drift. Solving data problems like this is just a part of model retraining (and concept drift).
46.
by dmpetrov 6y ago
It looks like a cool game. A short video on the page might be helpful (like the one in the blog post).
47.
by dmpetrov 6y ago
"learn to code" Paul Graham
48.
by dmpetrov 6y ago
It is important to know what are A and B. Splitgraph\dbt\Dolt can work if these are structured tables in SQL database while DVC works if A and B are files or directories.
49.
by dmpetrov 6y ago
Thanks you for warm words about DVC :) `dvc import` can connect multiple datasets in a repository. It also preserves the "link" to the dataset that you can update/downgrade. Class/labels distributions for a dataset can b
50.
by dmpetrov 6y ago
Hi @latenightcoding Dmitry Petrov here. Yes, I sent an email after we released an open source product that complements DVC. I expected that this might be interesting to DVC fans. I am very sorry if it was unpleasant for you.
51.
Show HN: CML – CI/CD for Machine Learning with GitHub Actions and Gitlab CI(github.com)
1 points by dmpetrov 6y ago|1 comments
52.
by dmpetrov 6y ago
I like the post. #1-#6 patters makes total sense. I'm not sure on how #7 should be implemented. How can I create the "button" in GitLab or GitHub?
53.
by dmpetrov 6y ago
External production systems depend on GitHub. For FB - it is fine to fail from time to time. Users will be even more productive :)
54.
by dmpetrov 6y ago
Why this is usually happen on weekends? The only time that I have for coding :)
55.
by dmpetrov 6y ago
150Gb ML model file? That's cool! Yes, DVC can help with that. Where the data lives? S3/GCS or just a server with SSH? Disclaimer: I'm a creator of DVC.
56.
by dmpetrov 6y ago
Relying on the frameworks formats seems like a great approach. However, there are a few more open questions related to model governance. Versions of frameworks, input data specification, output data/scores specification. I'd expec
57.
by dmpetrov 6y ago
Neat idea. I'm wondering what ML model formats you use and what is specification for inputs\results? Do you try to use some common format or it is fine for you to use a proprietary one? I'm building https://DVC.org - G
58.
by dmpetrov 6y ago
That's funny but DVC was not started as Terraform for Data. We were just focused on data versioning and ML workflow (pipelines, metrics etc...). But it kind of becomes Terraform for Data. It is a very good analogy. PS: I'm one fo
59.
by dmpetrov 6y ago
Good question! We build separate products (that use DVC) for monetization. No plans to monetize DVC. Some analogy - Git is free for versioning, GitHub/GitLab as monetization.
60.
by dmpetrov 6y ago
Hey HN, creator of DVC here! DVC ( https://dvc.org/ ) is known as Git for data projects. Technically, DVC codifies your data and machine learning pipelines as text metafiles (with pointers to actual data in S3/GCP/A

More ›