carsonpoole

3 ms·

1.
Show HN: Determinstic LLM inference for lowest price Gemma 4, with Windows XP(tokendelivery.ai)
9 points by carsonpoole 29d ago|1 comments
2.
Comparing web search API providers on a Deep Research gauntlet(searchspace.io)
2 points by carsonpoole 4mo ago|0 comments
3.
Web Search API for Agents 70x Cheaper Than Exa(searchspace.io)
4 points by carsonpoole 4mo ago|0 comments
4.
Using a tiny GPT model to beat Brotli/ZSTD, 600x faster than Fabrice Bellard's(github.com)
2 points by carsonpoole 9mo ago|0 comments
5.
Nvidia GPU Specs and Pricing Cheatsheet(github.com)
3 points by carsonpoole 1y ago|1 comments
6.
Free AI Audio Book Summaries(freeaibooksummaries.com)
1 points by carsonpoole 2y ago|0 comments
7.
by carsonpoole 2y ago
Thanks for the feedback! Do you think a dropbox-like setup with syncing some directory would suffice? or would it need to be completely offline?
8.
Show HN: FileFolder: AI File Manager: Auto Tag and Name and Vector Search(filefolder.org)
8 points by carsonpoole 2y ago|3 comments
9.
Free Client Side Suite of Image/PDF Conversion and Resize and Compression(tools.filefolder.org)
3 points by carsonpoole 2y ago|0 comments
10.
CUDA Utils – Simple CUDA utils/helpers for simplifying ND tensor memory access(github.com)
3 points by carsonpoole 2y ago|0 comments
11.
150 LoC CUDA I8 Matmul That Beats CuBLAS Tensor Core FP16(github.com)
1 points by carsonpoole 2y ago|0 comments
12.
Safetensors.cpp – Zero Dependency Safetensors Loading and Storing in C++(github.com)
5 points by carsonpoole 2y ago|0 comments
13.
AI Receipt Tracker – AI takes your receipt photos and PDFs and extracts details(aireceipttracker.com)
1 points by carsonpoole 2y ago|0 comments
14.
Free AI Chatbot – Locally Stored AI Chat, CSVs, Images, Claude, GPT4, Lots More(freeaichatbot.org)
1 points by carsonpoole 2y ago|0 comments
15.
Local Only Embedding and Vector Search of 50k Web Pages from Fine Web(demo.haystack.zip)
1 points by carsonpoole 2y ago|1 comments
16.
Haystack Embedded – 30x faster than FAISS, local first vector DB in pure Rust(github.com)
2 points by carsonpoole 2y ago|0 comments
17.
by carsonpoole 2y ago
I wholeheartedly agree :) I've mostly put this together this weekend, so I haven't had time to do everything yet, but that's definitely on the todo list. I FT'd some siglip models (see here: https://huggingfac
18.
by carsonpoole 2y ago
thank you for the kind words!
19.
by carsonpoole 2y ago
not yet, but it's roughly linear at scaling, since it's a brute force algorithm. so with the current version it'd probably be about 22 seconds for a 1B vector search. the whole point of having metadata queries are to prevent
20.
by carsonpoole 2y ago
IMO at least there are a lot of things that other vector DBs are missing and should exist. I want to make this work at petabyte scale data with the features on the readme's roadmap plus some others I have nebulous ideas about.
21.
by carsonpoole 2y ago
It works right now, but I'm actively adding a lot of additional things that might make your life easier. The roadmap on the readme shows what I'm working on adding. Feel free to shoot me an email at carson at poole.ai and I'd
22.
Haystack DB – 10x faster than FAISS with binary embeddings by default(github.com)
61 points by carsonpoole 2y ago|26 comments