aetherspawn

5 ms·

1.
by aetherspawn 5d ago
I hope these get small and good enough to create “pet like” AIs for games. You know, like scream “follow me” at an NPC, STT stack translates it and feeds it to a local Jev-like model that then picks a number of things for the NPC to do.
2.
by aetherspawn 6d ago
Stay the hell away from spooky stuff like psychics and tarot readers - the more you don’t believe in it, the better. But better again that you do believe, and know that these are not harmless fun, but that there are dark and hidden and evil
3.
by aetherspawn 6d ago
Sorry but can’t take it seriously with the insane amount of pop up ads.
4.
by aetherspawn 6d ago
If it can’t figure out how to render the page then we don’t really want its weights tbh, it can keep those to itself
5.
by aetherspawn 6d ago
Yes, I use LM Studio with MLX support, which is specifically faster on M series Macs. I am not sure if llama is the same, but I guess what I’m saying is if you want the performance to be good on M series you have to use models packaged in t
6.
by aetherspawn 6d ago
It can play doom in realtime so maybe it can play this.
7.
by aetherspawn 8d ago
Gemma 30B with 256K context runs at 20 tok/sec on my M3 Max with 128GB RAM so I think there’s something wrong with your setup. This should run at ~30-40 toks. Maybe your inference engine is not optimised for Mac.
8.
by aetherspawn 8d ago
Neat. This is pretty close to what I’d be looking for, if I could really afford to pull the trigger on something like this (realistically I can’t - iMessage on laptop is too important for work). If it natively plugged into the Apple ecosyst
9.
by aetherspawn 9d ago
1) If you want to make Claude usable how about addressing the fact that OpenAI 20x lasts all day on Astra, yet Claude 20x pips out in 20 mins of agentic with Fable 5.1, which is totally useless. And unlike Sol: Opus like yoda, anything for
10.
by aetherspawn 12d ago
All the servers I’ve ever bought came with iDRAC or something like it, which has KVM built in.
11.
by aetherspawn 14d ago
I am a huge advocate of this kind of app paradigm: It’s now really easy to spin a terminal emulator and make cross platform terminal apps that work the same on Windows, macOS and Linux regardless of users terminal. You can also make sure th
12.
by aetherspawn 14d ago
Can’t even load it.
13.
by aetherspawn 14d ago
You don’t need resend anymore, email is CF native.
14.
by aetherspawn 14d ago
Yeah GitHub repos need screenshots.
15.
by aetherspawn 14d ago
You kind of said everything but nothing all at once. If not Google then where?
16.
by aetherspawn 15d ago
It’s not that bad though. I expected way worse. If Robin Hobbs wrote it, I’d barely lift a brow.
17.
by aetherspawn 16d ago
I guess it’s not faster than using a table for CRC8?
18.
by aetherspawn 16d ago
I find Astra to be weirdly stupid in the sense you have to force it to spend time on something (fix this architectural issue and refactor), then it’s stupidly smart. It prioritises getting something working over making something good during
19.
by aetherspawn 18d ago
Would be good to include Fable and Opus. Based on the results with Astra vs GLM (not even in the same ballpark), these are probably the realistic alternatives to consider.
20.
by aetherspawn 19d ago
How are they gonna do email without Outlook Mail servers.
21.
by aetherspawn 22d ago
> He was born, lost his father at 5, and died at 7 of malnutrition. Yikes
22.
by aetherspawn 25d ago
It’s an option that costs extra and is only available on some MacBooks and Studio Displays, not iPhones and the like.
23.
by aetherspawn 25d ago
Not legal advice: If you don’t change steering or brakes then virtually no compliance is required. You are of course liable if your widget causes an accident.
24.
by aetherspawn 25d ago
It’s specifically advised for use on the nano texture displays, where the wrong material could rub away the special surface etching they use to get the glare resistance. They list it as compatible with everything, because, well why not.
25.
by aetherspawn 27d ago
Interesting problem! I don’t think I could solve it myself honestly.
26.
by aetherspawn 27d ago
I work in this space. Took one look at Launch and instantly recognise the type of company they are (aftersales/paper pushing) and that this will probably fail due to lack of actual engineering experience with DfM, control software, etc
27.
by aetherspawn 28d ago
In the latest app my company is working on, we deliberately wanted to support usage over SSH. We basically designed the app as a TUI, but implemented mouse events so you can also drive it like a GUI. When we hit the limits of the terminal (
28.
by aetherspawn 28d ago
I agree but how does this work with stateful apps
29.
by aetherspawn 1mo ago
Judging by the rate of things it probably will be
30.
by aetherspawn 1mo ago
All I wanna know is how many tokens per second on 100B MoE?? Have we cracked 100 yet. When we crack 100 tok/s at 2M context for <$10K I’ll buy one.

More ›