5 ms·
This is AMAZING feedback and it is on brand with what I've heard from a number of builders. Thanks for sharing your experiences here. The infra challenges are
by ocolegro 3y ago
This is AMAZING feedback and it is on brand with what I've heard from a number of builders. Thanks for sharing your experiences here.
The infra challenges are real - it has been what I have been struggling the most with in providing high quality support for early users. Most want to be able to reliably firehose 10-100s of GBs of data through a brittle multistep pipeline. This was something I struggled with when building AgentSearch [https://huggingface.co/datasets/SciPhi/AgentSearch-V1 https://huggingface.co/datasets/SciPhi/AgentSearch-V1] with LOCAL data - so introducing the networking component only makes things that much harder.
I think we have a lot of work to do to robustly solve this problem, but I'm confident that there is an opportunity to build a framework that results in net positives for the developer.
FWIW, Your feedback would be invaluable as the project continues to grow.