the_king

6 ms·

31.
by the_king 2y ago
Exactly my point. Saying something is the fastest ever is marketing code (at least to me) for minor improvement over the previous generation. If you're 30% faster than the previous generation, I'd rather see that because my assump
32.
by the_king 2y ago
That's only single core. I think Logic is pretty optimized to use multiple cores (Apple demoed it on the 20 core Xeon Mac Pro back in 2019). But if the M1 isn't the bottleneck, no reason to upgrade.
33.
by the_king 2y ago
Call me cynical, but when I see headlines like "up to 2x faster", I assume it's a cherry-picked result on some workload where they added a dedicated accelerator. There's a massive difference between "pretty much eve
34.
by the_king 2y ago
To run LLMs locally (Ollama/LLM Notebook), you want as much memory as you can afford. For actually training toy models yourself for learning/experiments in my experience it doesn't matter much. PyTorch is flexible.
35.
by the_king 2y ago
The single core performance looks really fast. Chip | Geekbench Score (Process) ---- | ------------------------ M1 | 2,419 (5nm) M2 | 2,658 (5nm) M3 | 3,076 (3nm) M4* | 3,810 (3nm) In my experience, single-
36.
by the_king 2y ago
Peter Thiel was widely criticized this spring when he said that AI "seems much worse for the math people than the word people." So far, that seems to be right. The only thing o1 is worse at is writing.
37.
by the_king 2y ago
This is really cool. Curious to see more about how the database can be queried. I don't write much SQL these days, and I have no dedication to Postgres, but it does integrate with pretty much everything. Also curious how I'd go ab
38.
by the_king 2y ago
It makes sense for desktops but not for devices with batteries. I think Apple should introduce a new device for $5-10k that has 400GB of VRAM that all Macs on the network use for ML. If you're on battery, you don't want to do LLM
39.
by the_king 2y ago
I'm all for running as much on the edge as possible, but we're not even close to being able to do real-time inference on Frontier models on Macs or iPads, and that's just for vanilla LLM chatbots. Low-precision Llama 3-8b is
40.
by the_king 2y ago
I would use Pytorch as your starting point. Its metal backend is pretty quick on Apple Silicon, and it's the most widely used library for everyone from hackers to foundation model builders.
41.
by the_king 3y ago
Thank you very much. I can't say how much these comments motivate us. When I was a kid I saw tech as a really aspirational thing (jobs, iPod, touch screens, Skyrim). What can be done with modern GPUs and transformers is making me feel
42.
by the_king 3y ago
Thank you. 100% I'm with you on speed. I think we will be in a much better place speed-wise in a few months; some of that will be our stack, and some of that is what is happening lower down in the stack, but it will be meaningfully fas
43.
by the_king 3y ago
Yikes! I think we may have normal mode a bit too conservative at the moment. We've got a lot more tuning to do. One thing you can try if Aqua doesn't seem to be "getting" what you're after is to say something like &
44.
by the_king 3y ago
Great idea. This is definitely worth looking into. We don't want to slow down the pace of development, but this might be a case where the partnership makes too much sense. A huge portion of what goes on in universities is writing. edit
45.
by the_king 3y ago
Great question. I just tested it, and Aqua was smart enough to figure out which "GPU" I was talking about using context. In the example below I asked it to "make it H100 GPUs" and it only modified the GPU in the list. Aq
46.
by the_king 3y ago
That's a great idea, we should do that. I have a similar dream, we'll make it happen!
47.
by the_king 3y ago
The programming use case is pretty interesting.
48.
by the_king 3y ago
Appreciate it. I think the preference for voice versus typing is something that hits everyone differently, and I think as the reliability and speed improves, more and more people will find themselves using voice as a "tool in the toolb
49.
by the_king 3y ago
Thanks, appreciate it. We can do a lot better than most people experienced today in terms of latency.
50.
by the_king 3y ago
Thanks! Sorry about the lag, today was slower than normal, but we need to improve latency overall.
51.
by the_king 3y ago
Did you wait for the text to turn blue and then black? And were the twos still wrong then? The real-time text is non-final tokens and has many more errors than what is ultimately committed to the document (but committing is slower than we&#
52.
by the_king 3y ago
Awesome. Agree on the copy-paste annoyance, we're working on more clients. But I do think that the reliability needs to take a few more steps before it becomes a true keyboard replacer.
53.
by the_king 3y ago
It's 1000-1500 words. I know that seems cheap of us but the cost to run the Aqua stack is eye-watering right now. We will increase this amount as we optimize.
54.
by the_king 3y ago
Hope this can be helpful. We know there are still many kinks to iron out. On another note, I think once you leave school dyslexia can become a wash or even a net positive in the right setting. I think whatever the brain config is can be a h
55.
by the_king 3y ago
You can use it in the browser right now! but we get... native is better for voice stuff and we'll be in more places soon.
56.
by the_king 3y ago
We'll be releasing a custom dictionary and templates soon. We are testing them internally now, and they aren't quite reliable enough to release, but we understand how important this is for many workflows. On accuracy, we benchmark
57.
by the_king 3y ago
Sorry about that, will fix asap. I love firefox.
58.
by the_king 3y ago
Fixed. Thanks for the heads up.
59.
by the_king 3y ago
I think I developed "bad handwriting" partially to hide misspellings—this is necessary in school though. On pure WER we are state-of-the-art in our testing, but more importantly, mistakes in Aqua are correctable . So you can spea
60.
by the_king 3y ago
Sorry about that. We know we need to be better about that and of course add more languages. A few things to try to maximize your accuracy right now are: - Don't use AirPods, especially not AirPods Pro. Most built-in laptop mics or EarP

More ›