32 ms·

Next: - Autosuggest database tables to use - Automatically reserve parallel computing resources - Autodetect data health issues and auto fix them - Autodete

Next: - Autosuggest database tables to use - Automatically reserve parallel computing resources - Autodetect data health issues and auto fix them - Autodetect concept drift and auto fix it - Auto engineer features and interactions - Autodetect leakage and fix it - Autodetect unfairness and auto fix it - Autocreate more weakly-labelled training data - Autocreate descriptive statistics and model eval stats - Autocreate monitoring - Autocreate regulations reports - Autocreate a data infra pipeline - Autocreate a prediction serving endpoint - Auto setup a meeting with relevant stakeholders on Google Calendar - Auto deploy on Google Cloud - Automatically buy carbon offset - Auto fire your in-house data scientists

otagekki 7y ago
Poor data scientists, now whose heads get cut when things go wrong and companies lose billions?
- manually 7y ago
  In the days when Sussman was a novice, Minsky once came to him as he sat hacking at the PDP-6. “What are you doing?”, asked Minsky. “I am training a randomly wired neural net to play Tic-Tac-Toe” Sussman replied. “Why is the net wired randomly?”, asked Minsky. “I do not want it to have any preconceptions of how to play”, Sussman said. Minsky then shut his eyes. “Why do you close your eyes?”, Sussman asked his teacher. “So that the room will be empty.” At that moment, Sussman was enlightened.
  - westurner 7y ago
    Is this an argument in favor of unjustified magic constant arbitrary priors?
    - perl4ever 7y ago
      A sufficiently large amount of random data contains all the magic constants you could want.
      - westurner 7y ago
        Yeah, but cryptographic hashes have some entropy.
  - Icathian 7y ago
    I miss the codeless code. Wish someone would take up that mantle.
  - manthideaal 7y ago
    With all due respect to Minsky, I find this zen style story a little silly. If Minsky want to say something informative why don't he use formal concepts like Jeffreys priors, mixing time, high dimensional varieties, minimun description length, entropy, etc. Is that style of telling stories a projection from a high dimensional mind to a zero dimensional dumb style space?, is that a PCA reduction from ideas to cliches? I apologize in advance from being harsh, but I am entitle to speak from my heart and I reiterate my appreciation for Minsky's work. It should be nice using a more informative language for giving advice. If this story is tagged as "popular story for dummies" I would feel we are making real progress. Just one of Minsky great ideas related to reinforcement learning: The credit assignment problem:How do you distribute credit for success among the many decisions that may have been involved in producing it?, in "Steps Toward Artificial Intelligence" (Minsky, 1961): All of the methods we discuss in this book are, in a sense, directed toward solving this problem. That book is linked from HN and it has just one comment, so I think that NDNS, no dumb nerd stories, will never become popular. (1) https://news.ycombinator.com/item?id=10972522 https://news.ycombinator.com/item?id=10972522 More from (2) Minsky in 1951 built the world's first “randomly wired neural network learning machine,” called the stochastic neural-analog reinforcement computer (snarc) https://www.geek.com/blurb/marvin-minsky-ai-has-been-brain-dead-since-the-1970s-553345/ https://www.geek.com/blurb/marvin-minsky-ai-has-been-brain-d... A fair paper: Exploring Randomly Wired Neural Network for Image Recognition. Was Sussan at the edge of envisioning deep learning?, then in fact the room has dissapeared!
xiaodai 7y ago
Autodetect data health issues and auto fix them Funy you say that cos my company is actually developing something along those lines
neximo64 7y ago
Would be funny but most of those things are already on AutoML Tables, including the carbon offset https://cloud.google.com/automl-tables https://cloud.google.com/automl-tables
- westurner 7y ago
  > Would be funny but most of those things are already on AutoML Tables, including the carbon offset GCP datacenters are 100% offset with PPAs. Are you referring to different functionality for costing AutoML instructions in terms of carbon? ... I'd add: - Setup a Jupyter Notebook environment > Jupyter Notebooks are one of the most popular development tools for data scientists. They enable you to create interactive, shareable notebooks with code snippets and markdown for explanations. Without leaving Google Cloud's hosted notebook environment, AI Platform Notebooks, you can leverage the power of AutoML technology. > There are several benefits of using AutoML technology from a notebook. Each step and setting can be codified so that it runs the same every time by everyone. Also, it's common, even with AutoML, to need to manipulate the source data before training the model with it. By using a notebook, you can use common tools like pandas and numpy to preprocess the data in the same workflow. Finally, you have the option of creating a model with another framework, and ensemble that together with the AutoML model, for potentially better results. https://cloud.google.com/blog/products/ai-machine-learning/use-automl-tables-from-a-jupyter-notebook https://cloud.google.com/blog/products/ai-machine-learning/u...
  - perl4ever 7y ago
    This sounds like the sort of thing that would be useful outside of data science. Which leads to the question of whether it needs to be generalized, or redone differently for different specializations. Which in turn seems like the sort of question that it's tricky to answer with AI.
    - westurner 7y ago
      > This sounds like the sort of thing that would be useful outside of data science. The instruction/operation costing or the computational essay/notebook environment setup? Ethereum ("gas") and EOS have per-instruction costing. SingularityNET is a marketplace for AI solutions hosted on a blockchain, where you pay for AI/ML services with the SingularityNET AGI token. E.g. GridCoin and CureCoin compensate compute resource donations with their own tokens; which also have a floating exchange rate. TLJH: "The Littlest JupyterHub" describes how to setup multi-user JupyterHub with e.g. Docker spawners that isolate workloads running with shared resources like GPUs and TPUs: http://tljh.jupyter.org/en/latest/ http://tljh.jupyter.org/en/latest/ "Zero to BinderHub" describes how to setup BinderHub on a k8s cluster: https://binderhub.readthedocs.io/en/latest/zero-to-binderhub/ https://binderhub.readthedocs.io/en/latest/zero-to-binderhub...
deepsun 7y ago
- Auto-negotiate proper metrics to use with stakeholders.
jiofih 7y ago
I guess this is a job-safety type comment?

otagekki 7y ago

Poor data scientists, now whose heads get cut when things go wrong and companies lose billions?

manually 7y ago
In the days when Sussman was a novice, Minsky once came to him as he sat hacking at the PDP-6. “What are you doing?”, asked Minsky. “I am training a randomly wired neural net to play Tic-Tac-Toe” Sussman replied. “Why is the net wired randomly?”, asked Minsky. “I do not want it to have any preconceptions of how to play”, Sussman said. Minsky then shut his eyes. “Why do you close your eyes?”, Sussman asked his teacher. “So that the room will be empty.” At that moment, Sussman was enlightened.
- westurner 7y ago
  Is this an argument in favor of unjustified magic constant arbitrary priors?
  - perl4ever 7y ago
    A sufficiently large amount of random data contains all the magic constants you could want.
    - westurner 7y ago
      Yeah, but cryptographic hashes have some entropy.
- Icathian 7y ago
  I miss the codeless code. Wish someone would take up that mantle.
- manthideaal 7y ago
  With all due respect to Minsky, I find this zen style story a little silly. If Minsky want to say something informative why don't he use formal concepts like Jeffreys priors, mixing time, high dimensional varieties, minimun description length, entropy, etc. Is that style of telling stories a projection from a high dimensional mind to a zero dimensional dumb style space?, is that a PCA reduction from ideas to cliches? I apologize in advance from being harsh, but I am entitle to speak from my heart and I reiterate my appreciation for Minsky's work. It should be nice using a more informative language for giving advice. If this story is tagged as "popular story for dummies" I would feel we are making real progress. Just one of Minsky great ideas related to reinforcement learning: The credit assignment problem:How do you distribute credit for success among the many decisions that may have been involved in producing it?, in "Steps Toward Artificial Intelligence" (Minsky, 1961): All of the methods we discuss in this book are, in a sense, directed toward solving this problem. That book is linked from HN and it has just one comment, so I think that NDNS, no dumb nerd stories, will never become popular. (1) https://news.ycombinator.com/item?id=10972522 https://news.ycombinator.com/item?id=10972522 More from (2) Minsky in 1951 built the world's first “randomly wired neural network learning machine,” called the stochastic neural-analog reinforcement computer (snarc) https://www.geek.com/blurb/marvin-minsky-ai-has-been-brain-dead-since-the-1970s-553345/ https://www.geek.com/blurb/marvin-minsky-ai-has-been-brain-d... A fair paper: Exploring Randomly Wired Neural Network for Image Recognition. Was Sussan at the edge of envisioning deep learning?, then in fact the room has dissapeared!

xiaodai 7y ago

Autodetect data health issues and auto fix them Funy you say that cos my company is actually developing something along those lines

neximo64 7y ago

Would be funny but most of those things are already on AutoML Tables, including the carbon offset https://cloud.google.com/automl-tables https://cloud.google.com/automl-tables

westurner 7y ago
> Would be funny but most of those things are already on AutoML Tables, including the carbon offset GCP datacenters are 100% offset with PPAs. Are you referring to different functionality for costing AutoML instructions in terms of carbon? ... I'd add: - Setup a Jupyter Notebook environment > Jupyter Notebooks are one of the most popular development tools for data scientists. They enable you to create interactive, shareable notebooks with code snippets and markdown for explanations. Without leaving Google Cloud's hosted notebook environment, AI Platform Notebooks, you can leverage the power of AutoML technology. > There are several benefits of using AutoML technology from a notebook. Each step and setting can be codified so that it runs the same every time by everyone. Also, it's common, even with AutoML, to need to manipulate the source data before training the model with it. By using a notebook, you can use common tools like pandas and numpy to preprocess the data in the same workflow. Finally, you have the option of creating a model with another framework, and ensemble that together with the AutoML model, for potentially better results. https://cloud.google.com/blog/products/ai-machine-learning/use-automl-tables-from-a-jupyter-notebook https://cloud.google.com/blog/products/ai-machine-learning/u...
- perl4ever 7y ago
  This sounds like the sort of thing that would be useful outside of data science. Which leads to the question of whether it needs to be generalized, or redone differently for different specializations. Which in turn seems like the sort of question that it's tricky to answer with AI.
  - westurner 7y ago
    > This sounds like the sort of thing that would be useful outside of data science. The instruction/operation costing or the computational essay/notebook environment setup? Ethereum ("gas") and EOS have per-instruction costing. SingularityNET is a marketplace for AI solutions hosted on a blockchain, where you pay for AI/ML services with the SingularityNET AGI token. E.g. GridCoin and CureCoin compensate compute resource donations with their own tokens; which also have a floating exchange rate. TLJH: "The Littlest JupyterHub" describes how to setup multi-user JupyterHub with e.g. Docker spawners that isolate workloads running with shared resources like GPUs and TPUs: http://tljh.jupyter.org/en/latest/ http://tljh.jupyter.org/en/latest/ "Zero to BinderHub" describes how to setup BinderHub on a k8s cluster: https://binderhub.readthedocs.io/en/latest/zero-to-binderhub/ https://binderhub.readthedocs.io/en/latest/zero-to-binderhub...

deepsun 7y ago

- Auto-negotiate proper metrics to use with stakeholders.

jiofih 7y ago

I guess this is a job-safety type comment?