elenasamuylova

4 ms·

1. 1.▲
   by elenasamuylova 3y ago

   Evidently itself is an open-source ML monitoring tool with 3m+ downloads so it's fairly popular https://github.com/evidentlyai/evidently . The course will show it but also other OSS tools like Mlflow and Grafana. D
2. 2.▲
   List of 200 blogs on how tech companies use ML(evidentlyai.com)

   2 points by elenasamuylova 3y ago|1 comments
3. 3.▲
   by elenasamuylova 3y ago

   Do you support GCP?
4. 4.▲
   by elenasamuylova 5y ago

   Would be cool to know if you see other tools in your stack you'd want to integrate with - we want to make Evidently very easy to plug in existing workflows. Let us know!
5. 5.▲
   by elenasamuylova 5y ago

   Thanks for the support! For the moment the workflows you describe are built externally: - To set notifications you can send the output from Evidently to other tools like Grafana and then build a notification workflow around it. If you have
6. 6.▲
   by elenasamuylova 5y ago

   Thanks! Looking forward to your contributions! <3
7. 7.▲
   by elenasamuylova 5y ago

   Depends on the use case and available instrumentation! If the feedback is available almost instantly (e.g. you recommend something to a user based on a model prediction and you know if they clicked on it or not), you can log the user action
8. 8.▲
   by elenasamuylova 5y ago

   Right now we ask the user to prepare the logs on their side (or schedule a job to push the logs to the tool). We learnt that most teams store the prediction logs anyways - since they are usually used for retraining. So we thought that is t
9. 9.▲
   by elenasamuylova 5y ago

   Thanks - integration with Сolab is in the near-time roadmap. You can already use it to generate JSON profiles and export HTML reports. We are working now to make it possible to display all the interactive plots directly inside Сolab. Longer
10. 10.▲
    by elenasamuylova 5y ago

    We do not directly detect anomalies but we have two types of checks to run when there are no actuals or ground truth labels: 1) data drift to compare the statistical distribution of the input features to the past 2) prediction drift to c
11. 11.▲
    by elenasamuylova 5y ago

    True, we do not want to force users into a rigid workflow. We build the tool so it can integrate with other parts of the ML stack. Right now you can for example use Evidently to calculate if the model has drifted, and then log the results i
12. 12.▲
    Launch HN: Evidently AI (YC S21) – Track and Debug ML Models in Production

    111 points by elenasamuylova 5y ago|17 comments