3 ms·
Show HN: Giskard – Testing framework dedicated to LLMs and Tabular ML models
- jplassmann 3y agoAwesome!! Exactly what I was looking for!
- alexcombessie 3y agoThanks! We’re interested in your feedback as it’s still a beta version. Here is our documentation to get started: https://docs.giskard.ai/ https://docs.giskard.ai/
- mxcrbn 3y agoInteresting stuff!
- alexcombessie 3y agoThanks! We’re interested in your feedback as it’s still a beta version. Here is our documentation to get started: https://docs.giskard.ai/ https://docs.giskard.ai/
- mattbit 3y agoHey, Giskard team member here! I am around to discuss and read your feedback. I’ve worked in particular on automatic scanning of ML models for bugs and problems, the idea was to systematically scan for general issues and automatically find segments of data on which the model performs worse than average. If you have questions, I am happy to discuss here.
- beppbopp 3y agoWill test it out this weekend
- hugolsqrn 3y agoVery exciting to see Giskard coming around to bring trust to LLMs!
- alexcombessie 3y agoThanks! LLM testing is a specific challenge, we’re interested in your feedback on our alpha version. Here’s a notebook to try it: https://docs.giskard.ai/en/latest/reference/notebooks/llm_comment_generation.html https://docs.giskard.ai/en/latest/reference/notebooks/llm_co...