karimf

3 ms·

1.
by karimf 12d ago
This is awesome. Thanks for pushing the audio pareto frontier forward. Probably far fetched for now, but I think the next big evolution is building the pareto/much cheaper alternative to GPT-Live-1. The STT/TTS market is quite sat
2.
by karimf 17d ago
While this is very impressive benchmark-wise, GPT-6 Astra showed us that benchmarks don't always correlate 1:1 to intelligence of a model. When Astra launched, I think Artifical Analysis showed that it was on par with GPT-5.6 Sol and l
3.
K2 Horizon: A connected fleet of six open models(ifm.ai)
335 points by karimf 23d ago|131 comments
4.
by karimf 1mo ago
I think a curriculum like this is neat and might help with interviews since you go wide and have a checklist of things that you need to learn. I'm on a totally different path for learning inference engineering. I self-host a voice AI a
5.
by karimf 1mo ago
Yes. Please seriously try other models. See relevant thread here: https://news.ycombinator.com/item?id=49296740
6.
by karimf 1mo ago
This 100%. I was Anthropic-pilled. I had a $200/mo subscription and I only used Anthropic models. I was frustrated by the verbose output and the writing style. I tried ASD-STE-100, it helped a bit, but it's still too verbose for m
7.
by karimf 2mo ago
Not sure why it's on the front page now, but I highly recommend using llama.cpp for running AI model locally vs using other inference framework, unless you have a very specific requirement. ggerganov and the team have done a stellar jo
8.
We built a realtime system for responsive voice AI in six months(openai.com)
1 points by karimf 2mo ago|0 comments
9.
by karimf 2mo ago
Yes, and also waiting for the next iteration of Gemma. Muse or Qwen are optimized for coding, while IMO Gemma is still better for non-coding tasks. https://x.com/osanseviero/status/2086107547535122767
10.
by karimf 2mo ago
Practically ~20GB with KV cache > We quantize weights to ~4-bit, bringing the LM under 20 GB. We validated minimal to no degradation on agentic tasks under compression. https://www.reddit.com/r/LocalLLaMA/commen
11.
Nvidia NemotronLabs VoiceChat 11B – real-time full duplex with tool calling(huggingface.co)
2 points by karimf 2mo ago|0 comments
12.
by karimf 2mo ago
Most people are going under identity crisis right now because of recent LLM advancements. This post is a good example that shows that it's not only happening at the individual level, but also on the company/organization level. Is
13.
Turn and Face the Strange(fly.io)
4 points by karimf 2mo ago|0 comments
14.
by karimf 3mo ago
This repo is a good starting point for comparing TTS models https://github.com/5uck1ess/tts-bench Kokoro is a really good model, considered it’s released 1.5 years ago. It’s punching above its weight https:/&#x2F
15.
Why WebRTC beats WebSockets for realtime voice AI(livekit.com)
5 points by karimf 3mo ago|0 comments
16.
by karimf 4mo ago
I've been using Zed for a few weeks now and these two are also my main complaints as well.
17.
Unsloth Joins PyTorch Ecosystem(unsloth.ai)
8 points by karimf 5mo ago|2 comments
18.
Denial of Service Vulnerability in React Server Components(github.com)
2 points by karimf 5mo ago|0 comments
19.
by karimf 5mo ago
Oh yeah for sure. At that point, using SES is probably a better option compared to running a VPS just for SMTP. I posted that to let them know that SMTP support is a requirement for some developers.
20.
by karimf 5mo ago
Ok I just tried the service since I want to migrate from Resend. Seems like you can only send email via the worker or REST API for now? Can I send via SMTP? I'm using Supabase and it needs the SMTP credentials. I can't find anythi
21.
by karimf 6mo ago
Related: Gemma 4 on iPhone (254 comments) - https://news.ycombinator.com/item?id=47652561
22.
by karimf 6mo ago
This is an interesting approach. > How does this compare to Next.js App Router? > Next.js App Router is server-first: your component tree lives on the server by default, and you opt into client interactivity with 'use client&#x27
23.
by karimf 6mo ago
Well, on my demo it's around 2.5s and I already consider it as a "real-time". One way to improve it is to disable the image input.
24.
by karimf 6mo ago
What's your average response time with M1 max and what's the target?
25.
by karimf 6mo ago
Is this the problem? https://news.ycombinator.com/item?id=47669954
26.
by karimf 6mo ago
In the /r/macapps subreddit, they have huge influx of new apps posts, and the "whisper dictation" is one of the most saturated category. [0] >“Compare” - This is the most important part. Apps in the most saturated cat
27.
by karimf 6mo ago
During my limited testing, it works better than I expected at handling multiple languages in a single session. Perhaps I just had a low expectation since I've mostly worked with English-only STT models.
28.
by karimf 6mo ago
Nothing unique, it's just taking a snapshot when it's processing the input. Even processing a single image will increase the TTFT by ~0.5s on my machine, so for now, it seems to be impossible for feeding a live video and expecting
29.
by karimf 6mo ago
Huh that's weird. I just tried it and it works on my machine. Could you perhaps create a GitHub issue and share the reproduction steps and any relevant logs?
30.
by karimf 6mo ago
This. I posted this on my other comment, but there's a meme that "Gen Z Kids Don't Understand How File Systems Work" [0]. There seems to be a disconnect between some developers and the younger folks. [0] https:/&#x

More ›