5 ms·

Show HN: AutoML Python Package for Tabular Data with Automatic Documentation

67 points by pplonski86 4y ago

Tenoke 4y ago
Neat! I'll test it tomorrow. My only 'complaint' from reading the docs is that it only tests one NN model (which is the same for all types of data), rather than at least a few of the top architectures.
d3nigma 4y ago
There are many AutoML frameworks out there. For example, I recently found FLAML, which focuses on finding an optimal model given a budget. In case, you wanna check it out: https://github.com/microsoft/FLAML https://github.com/microsoft/FLAML
mark_l_watson 4y ago
This looks good. I mostly use deep learning for everything, while this project nicely automates non-deep learning ML. When I managed a deep learning team at Capital One, my last technical project was automatic deep learning architecture search. I think that the fields of data engineering, data science, machine learning, and deep learning are all all ripe for massive automation, reducing the number of jobs in these fields. I think that there will be accelerated use of all of these fields, just much less manual work will be required.
- sebastiansm 4y ago
  At least for tabular data there is no clear evidence that a neural network is superior than a tree-based model [0]. Many Data Scientist colleagues go straight to neural networks thinking that they will have a better result. Considering the complexity and computational cost, I think it is convenient to evaluate which tool to use for each case. [0] https://sebastianraschka.com/blog/2022/deep-learning-for-tabular-data.html https://sebastianraschka.com/blog/2022/deep-learning-for-tab...
  - mark_l_watson 4y ago
    Five years ago, I trained a GAN deep model to synthesize data based a tabular training data. Colleagues extended thus to also handle categorical and string data. Models trained on synthetic data performed well in withheld real data. I mention this as some evidence that deep models subsume conventional ML.
nlh 4y ago
Sometimes I just absolutely love hacker news more than words can explain. I am knee deep in a personal project exploring machine learning on tabular data and it’s been consuming my off-hours brain for a while. And I pop open HN on a holiday Monday to find…a package for machine learning on tabular data :) Curious if anyone has any other suggestions of frameworks or packages to explore. It seems that the state of the art in tabular data got a lot of activity in 2019 and 2020 and the industry’s focus moved on to image processing (DALL-E, Stable Diffusion) so I’m wondering whether there’s been much advancement.
- nojito 4y ago
  If you have tabular data just run with xgboost/lightgbm.
  - pplonski86 4y ago
    If your data doesn't require preprocessing ... Very often you need to prepare data to use xgboost/lightgbm. You need to fill missing values, convert categoricals/dates/text to numeric, do feature engineering. What is more, MLJAR AutoML is checking much simpler algorithms for you, like Dummy Models (average response or majority vote), linear models, simple decision trees - because very often you don't need Machine Learning. The xgboost/lightgbm cant do this :)
    - thegginthesky 4y ago
      You do not need to fill missing values or treat categorical with LightGBM. You can pass the name of the columns that are categoricals when constructing the Booster or Data, and LightGBM will work with them under the hood treating them as a 1 hot encoded. LightGBM also has a way of automatically treat missing values as either zeros, their own category, or the sample average (I might be mistaken on the last one) All in all, you still need to do feature engineering and the like, but LightGBM removes a lot of the hassle from Xgboost.
  - nlh 4y ago
    Yeah it seems those are still kings of the hill. One newbie question maybe you can answer: Can XGboost/LightGBM handle out of band data predictions? The specific regression problem I’m tackling involves price predictions on tabular data (similar the the kaggle housing price problem) and I know classic random forest / decision trees have trouble with time series predictions. Not sure if those models handle that better.
chrisgd 4y ago
This looks really great. I can imagine adding some features around the explanations from an educational standpoint. You could go from never having done this to understanding a lot more of the ins and outs of ML very quickly. Kudos

67 points by pplonski86 4y ago

Neat! I'll test it tomorrow. My only 'complaint' from reading the docs is that it only tests one NN model (which is the same for all types of data), rather than at least a few of the top architectures.

d3nigma 4y ago

There are many AutoML frameworks out there. For example, I recently found FLAML, which focuses on finding an optimal model given a budget. In case, you wanna check it out: https://github.com/microsoft/FLAML https://github.com/microsoft/FLAML

mark_l_watson 4y ago

This looks good. I mostly use deep learning for everything, while this project nicely automates non-deep learning ML. When I managed a deep learning team at Capital One, my last technical project was automatic deep learning architecture search. I think that the fields of data engineering, data science, machine learning, and deep learning are all all ripe for massive automation, reducing the number of jobs in these fields. I think that there will be accelerated use of all of these fields, just much less manual work will be required.

sebastiansm 4y ago
At least for tabular data there is no clear evidence that a neural network is superior than a tree-based model [0]. Many Data Scientist colleagues go straight to neural networks thinking that they will have a better result. Considering the complexity and computational cost, I think it is convenient to evaluate which tool to use for each case. [0] https://sebastianraschka.com/blog/2022/deep-learning-for-tabular-data.html https://sebastianraschka.com/blog/2022/deep-learning-for-tab...
- mark_l_watson 4y ago
  Five years ago, I trained a GAN deep model to synthesize data based a tabular training data. Colleagues extended thus to also handle categorical and string data. Models trained on synthetic data performed well in withheld real data. I mention this as some evidence that deep models subsume conventional ML.

nlh 4y ago

Sometimes I just absolutely love hacker news more than words can explain. I am knee deep in a personal project exploring machine learning on tabular data and it’s been consuming my off-hours brain for a while. And I pop open HN on a holiday Monday to find…a package for machine learning on tabular data :) Curious if anyone has any other suggestions of frameworks or packages to explore. It seems that the state of the art in tabular data got a lot of activity in 2019 and 2020 and the industry’s focus moved on to image processing (DALL-E, Stable Diffusion) so I’m wondering whether there’s been much advancement.

nojito 4y ago
If you have tabular data just run with xgboost/lightgbm.
- pplonski86 4y ago
  If your data doesn't require preprocessing ... Very often you need to prepare data to use xgboost/lightgbm. You need to fill missing values, convert categoricals/dates/text to numeric, do feature engineering. What is more, MLJAR AutoML is checking much simpler algorithms for you, like Dummy Models (average response or majority vote), linear models, simple decision trees - because very often you don't need Machine Learning. The xgboost/lightgbm cant do this :)
  - thegginthesky 4y ago
    You do not need to fill missing values or treat categorical with LightGBM. You can pass the name of the columns that are categoricals when constructing the Booster or Data, and LightGBM will work with them under the hood treating them as a 1 hot encoded. LightGBM also has a way of automatically treat missing values as either zeros, their own category, or the sample average (I might be mistaken on the last one) All in all, you still need to do feature engineering and the like, but LightGBM removes a lot of the hassle from Xgboost.
- nlh 4y ago
  Yeah it seems those are still kings of the hill. One newbie question maybe you can answer: Can XGboost/LightGBM handle out of band data predictions? The specific regression problem I’m tackling involves price predictions on tabular data (similar the the kaggle housing price problem) and I know classic random forest / decision trees have trouble with time series predictions. Not sure if those models handle that better.

chrisgd 4y ago

This looks really great. I can imagine adding some features around the explanations from an educational standpoint. You could go from never having done this to understanding a lot more of the ins and outs of ML very quickly. Kudos