4 ms·
This is a really cool idea. I love the simplicity of annotating cells and "compiling" a serverless HTTP application. In fact this idea of "compiling" the app mi
by TechBro8615 3y ago
This is a really cool idea. I love the simplicity of annotating cells and "compiling" a serverless HTTP application. In fact this idea of "compiling" the app might be the real novelty here. I suspect the adoption of the project will depend on how seamless you can make compilation and deployment for specific use cases.
Have you considered combining this idea with LLMs and templated prompts?
I'd also encourage you to focus your efforts on creating a smooth experience for "deploying" the resultant application to arbitrary platforms e.g. Fly.io, Render, Google Cloud Run, etc. (I would suggest Cloudflare Workers as well, but as far as I know that's not a platform that supports Python. So maybe it's also worth thinking about how to adopt the same idea to TypeScript.)
- ricardoagzz 3y agoThanks for the feedback! I wrote an example on how you can use it to create a simple pipeline to scrape wikipedia's daily featured article, chunk it, and store it in a vector DB using the scheduled cells, then use the HTTP cells to expose an endpoint calling GPT with RAG using the vector DB (https://docs.neutrinolabs.dev/example-up-to-date-chatbot https://docs.neutrinolabs.dev/example-up-to-date-chatbot). Any specific use cases you had in mind? And I agree, the deployment point is super important, its in the works!