vkaufmann

4 ms·

1.
LLM inference FHE homomorphic encryption: 1s/token interactive, 6min/token full(forums.developer.nvidia.com)
1 points by vkaufmann 1mo ago|0 comments
2.
Nemotron 3.5 Lightning-Omni: I gave NVIDIA's agent model eyes and ears(huggingface.co)
1 points by vkaufmann 2mo ago|0 comments
3.
Show HN: GitDB – GPU-accelerated vector database with Git-style version control
3 points by vkaufmann 7mo ago|0 comments
4.
Captcha-Solver AI LOL(github.com)
1 points by vkaufmann 7mo ago|1 comments
5.
by vkaufmann 7mo ago
Neural net CAPTCHA solver. MobileNetV2 + OpenCV. Built for the hell of it. Takes a reCAPTCHA image grid, splits it into cells, classifies each cell with a MobileNetV2 ImageNet classifier, and tells you which ones match the prompt. Also work
6.
Custom FP4 CUDA Kernel – 129 Tflops on DGX Spark with Pre-Quantized Weight Cache(forums.developer.nvidia.com)
2 points by vkaufmann 8mo ago|1 comments
7.
by vkaufmann 8mo ago
I went all in and wrote a custom FP4 GEMM kernel on top of CUTLASS 3.8. Along the way I discovered FP4 doesn’t actually help training - no backward pass. But what came out of it is something I haven’t seen anywhere else for consumer Blackwe
8.
GPT-OSS-20B-Vision: First Community VLM for GPT-OSS, Trained on a DGX Spark(huggingface.co)
4 points by vkaufmann 8mo ago|1 comments
9.
by vkaufmann 8mo ago
GPT-OSS-20B-Vision: First community VLM for GPT-OSS, trained on a single DGX Spark A couple weeks ago I shipped an MCP server (noapi-google-search-mcp) and people in the community challenged me to do something harder - build a VLM. So I bou
10.
by vkaufmann 8mo ago
About to release GPT-OSS-120B-Vision and GPT-OSS-20B-Vision, how about that! :D
11.
by vkaufmann 8mo ago
yep MXFP4 really fast :D
12.
by vkaufmann 8mo ago
Its meant to be super light weight for people who run 1B, 3B, 8B or 20B models on skinny devices, one Pip install with high impact for one install :D
13.
by vkaufmann 8mo ago
Coolest thing about it is, its 1 pip install to give your local model the ability to see, do Google Searches and use News, Shopping, Scholar, Maps, Finance, Weather, Flights, Hotels, Translate, Images, Trends etc Easiest and fastest way and
14.
by vkaufmann 8mo ago
GPT-OSS-120B runs like hell on my DGX Spark
15.
by vkaufmann 8mo ago
too slow bro
16.
by vkaufmann 8mo ago
Thought this is "hacker new" bro
17.
Show HN: I taught GPT-OSS-120B to see using Google Lens and OpenCV
43 points by vkaufmann 8mo ago|31 comments
18.
Show HN: Google Search MCP for local LLMs – 14 tools, no API key(github.com)
3 points by vkaufmann 8mo ago|0 comments