3 ms·
Ask HN: What tools for building AI products do you wish you'd discovered sooner?
I have a list of ai tools that I've used or want to use in my notes and I'm cleaning it up so I can share it.
Here's what I have so far of tools for building ai products:
You'll probably start with an LLM API - OpenAI
- Cohere and others aren't as good
- Anthropic's isn't available
If you're using embeddings
- If you're working with a lot of items, you'll want a vector database, like Pinecone, or Weaviate, or pgvector
If you're building Q&A over a document
- I'd suggest using GPT Index
If you need to be able to interact with external data sources, do google searches, database lookups, python REPL
- I'd suggest using langchain
If you're doing chained prompts
- Check out dust tt and langchain
If you want to deploy a little app quickly
- Check out Streamlit
If you need to use something like stable diffusion or whisper in your product
- banana dev, modal, replicate, tiyaro ai, beam cloud, inferrd, or pipeline ai
If you need something to optimize your prompts
- Check out Humanloop and Everyprompt
If you're building models and need an ml framework
- PyTorch, Keras, TensorFlow
If you're deploying models to production
- Check out MLOps tools like MLflow, Kubeflow, Metaflow, Airflow, Seldon Core, TFServing
If you need to check out example projects for inspiration
- Check out the pinecone op stack, the langchain gallery, the gpt index showcase, and the openai cookbook
If you want to browse the latest research, check out arXiv, of course
- tikkun 4y agoPlease let me know what I'm missing
- andre-z 4y agoQdrant, worth checking if you are looking for open-source alternative to Pinecone. (I‘m affiliated ) https://github.com/qdrant/qdrant https://github.com/qdrant/qdrant
- tikkun 4y agoNice - how's it similar / different to pinecone and weaviate and who is a better fit for qdrant vs who is a better fit to use pinecone? Also let me know your take on the rest of the list from the OP
- andre-z 4y agoPinecone - not open source. We have both OS and managed cloud https://cloud.qdrant.io https://cloud.qdrant.io Weaviate is awesome product but they have a slightly different approach. Also, you can check open source benchmarks https://qdrant.tech/benchmarks/ https://qdrant.tech/benchmarks/
- smoldesu 4y agoMaybe a little played-out, but I've been having a blast with the rust-bert library this weekend: https://github.com/guillaume-be/rust-bert https://github.com/guillaume-be/rust-bert With a little fanagling, you can get the GPT-Neo-1.3b model running on those free Oracle ARM VMs. I'm impressed, especially with the performance of the smallest model that uses less than a gig of memory.
- Oras 4y ago> If you want to deploy a little app quickly - Check out Streamlit Gradio is another fantastic tool
- tikkun 4y agoWill add - thanks