3 ms·

What do these companies do? I consider myself mildly well versed in the ML space at least, but I’ve never heard of MosaicML before (have they trained anything p

What do these companies do? I consider myself mildly well versed in the ML space at least, but I’ve never heard of MosaicML before (have they trained anything popular?). I’ve heard of Databricks but know very little about what service they provided before/after the recent deep learning craze.

Zizizizz 3y ago
Databricks provides Jupyter lab like notebooks for analysis and ETL pipelines using spark through pyspark, sparkql or scala. I think R is supported as well but it doesn't interop as well with their newer features as well as python and SQL do. It interfaces with cloud storage backend like S3 and offers some improvements to the parquet format of data querying that allows for updating, ordering and merged through https://delta.io https://delta.io . They integrate pretty seamlessly to other data visualisation tooling if you want to use it for that but their built in graphs are fine for most cases. They also have ML on rails type through menus and models if I recall but I typically don't use it for that. I've typically used it for ETL or ELT type workflows for data that's too big or isn't stored in a database.
- ShamelessC 3y ago
  Thanks!
- tsunamifury 3y ago
  Now say it even dumber as if I were a dog or a ceo.
  - quickthrower2 3y ago
    Perhaps, it is a fancy .csv importer?
  - esafak 3y ago
    They create services for data scientists (notebooks) and machine learning engineers (Spark).
    - tsunamifury 3y ago
      Thanks
spmurrayzzz 3y ago
Replit recently used the platform to train their open source code completion model [1]. Theres a decent video where Reza Shabani talks about the process they went through [2] (mosaic gets mentioned around 20m in) [1] https://huggingface.co/replit/replit-code-v1-3b https://huggingface.co/replit/replit-code-v1-3b [2] https://www.youtube.com/watch?v=roEKOzxilq4 https://www.youtube.com/watch?v=roEKOzxilq4

Zizizizz 3y ago

Databricks provides Jupyter lab like notebooks for analysis and ETL pipelines using spark through pyspark, sparkql or scala. I think R is supported as well but it doesn't interop as well with their newer features as well as python and SQL do. It interfaces with cloud storage backend like S3 and offers some improvements to the parquet format of data querying that allows for updating, ordering and merged through https://delta.io https://delta.io . They integrate pretty seamlessly to other data visualisation tooling if you want to use it for that but their built in graphs are fine for most cases. They also have ML on rails type through menus and models if I recall but I typically don't use it for that. I've typically used it for ETL or ELT type workflows for data that's too big or isn't stored in a database.

ShamelessC 3y ago
Thanks!
tsunamifury 3y ago
Now say it even dumber as if I were a dog or a ceo.
- quickthrower2 3y ago
  Perhaps, it is a fancy .csv importer?
- esafak 3y ago
  They create services for data scientists (notebooks) and machine learning engineers (Spark).
  - tsunamifury 3y ago
    Thanks

spmurrayzzz 3y ago

Replit recently used the platform to train their open source code completion model [1]. Theres a decent video where Reza Shabani talks about the process they went through [2] (mosaic gets mentioned around 20m in) [1] https://huggingface.co/replit/replit-code-v1-3b https://huggingface.co/replit/replit-code-v1-3b [2] https://www.youtube.com/watch?v=roEKOzxilq4 https://www.youtube.com/watch?v=roEKOzxilq4