threeducks

6 ms·

31.
by threeducks 11mo ago
Good observation! 56.37 tps / 19.34 tps ≈ 2.9 This explains why Opus 4.1 is 3 times the price of Opus 4.5.
32.
by threeducks 11mo ago
> (~1TB / SSD_read_speed + computation_time_per_chunk_in_RAM) = a few minutes per ~word or punctuation. You have to divide SSD read speed by the size of the active parameters (~16GB at 4 bit quantization) instead of the e
33.
by threeducks 11mo ago
Rough ballpark estimate: - Amazon Bedrock serves Claude Opus 4.5 at 57.37 tokens per second: https://openrouter.ai/anthropic/claude-opus-4.5 - Amazon Bedrock serves gpt-oss-120b at 1748 tokens per second: https:&#x2F
34.
by threeducks 11mo ago
Why should the author use the registered trademark symbol?
35.
by threeducks 11mo ago
After being once again frustrated by the CUDA installation experience, I thought that I should give those containers a try. Unfortunately, my computer did not boot anymore after following the installation instructions for the NVIDIA contain
36.
by threeducks 11mo ago
What exactly do you say is not commutative? This Wikipedia article claims that at least floating-point addition and multiplication are both commutative: https://en.wikipedia.org/wiki/Floating-point_arithmetic#Accu...
37.
by threeducks 11mo ago
> Fail2ban was struggling to keep up: it ingests the Nginx access.log file to apply its rules but if the files keep on exploding… > [...] > But I don’t want to fiddle with even more moving components and configuratio
38.
by threeducks 11mo ago
Oh, that explains the seemingly useless movs. Thank you! I simply thought that it was a bug, since clang did not emit them.
39.
by threeducks 11mo ago
Prices fall when supply exceeds demand.
40.
by threeducks 11mo ago
Yes. For example consider this function to add two 2D points, which accepts and returns all variables entirely in xmm registers: https://gcc.godbolt.org/z/hPGKrh6W4 (surprisingly, gcc generates some fairly odd assembly
41.
by threeducks 11mo ago
Ah, that went fast. I just got the update. Thanks for pointing it out!
42.
by threeducks 11mo ago
I think that (optional) AI features are fine, but the model selection only shows the big providers by default. You can enable local LLM support under about:config -> browser.ml.chat.hideLocalhost (set to false). It will check localhost:8
43.
by threeducks 11mo ago
> but we literally have no way to prove they're right Of course we do. Just run a benchmark with Cerebras/Groq and compare to the results produced in a trusted environment. If the scores are equal, the model is is either unquan
44.
by threeducks 11mo ago
It's the OS. About 10 years ago, I had an Asus EeePC, which was an underpowered piece of trash with a 32 bit Intel Atom CPU, but it cold-booted in less than 3 seconds. And by "booted", I mean completely booted, i.e. not like
45.
by threeducks 11mo ago
While attempting to write my own script, I found that there are many websites which offer YouTube summaries, which are probably an easier solution. For example (not affiliated) https://www.easemate.ai/video-summary It even
46.
by threeducks 11mo ago
536 € seems expensive for March 2024, but either way, the price dropped a lot over the last one and a half years, only to surge in the last two months.
47.
by threeducks 11mo ago
A few things come to mind: - Games (400GB for Ark, 235GB for Call of Duty, 190GB for God of War) - LLMs (e.g. DeepSeek-V3.2-Exp at 690GB or Kimi-K2 at 1030GB unquantized) - Blockchains (Bitcoin blockchain approaching 700GB) - Deep learning
48.
by threeducks 1y ago
Yea, it's full of AI slop like "It's not X, it's Y!": > Half the bugs you chase aren’t in your code. They’re in your head. > You’re not asking for their input, necessarily. You’re asking to have someone listen
49.
by threeducks 1y ago
A malicious server could detect whether the user is actually running "curl | sh" instead of just "curl" and only serve a malicious shell script when the code is executed blindly. See this thread for reference: https:&#x
50.
by threeducks 1y ago
That's okay. The models already know how to do operator overloading. RLHF will give them the common sense to not use it, unless explicitly requested.
51.
by threeducks 1y ago
If you are okay with the edges going from right to left instead of left to right, you can do it like this in Python: def main(): a, b, c = Node("a"), Node("b"), Node("c") edges = [
52.
by threeducks 1y ago
More precisely, the RTX 5090 has a memory bandwidth of 1792 GB/s, while the DGX Spark only has 273 GB/s, which is about 1/6.5. For inference, the DGX Spark does not look like a good choice, as there are cheaper alternatives w
53.
by threeducks 1y ago
Or -Inf, depending on the sign of the zero, which might catch some programmers by surprise, but is of course the correct thing to do.
54.
by threeducks 1y ago
This reads very similar to the Turbo Encabulator video.
55.
by threeducks 1y ago
That testimonial page looks super fake. Why does the same Mathew Miller have 7 testimonials? Similarly, Pol Alvarez Vecino, Pierre Porcher and Duane Milne all have 6 testimonials. And almost all other users also have multiple testimonials.
56.
by threeducks 1y ago
@dang Looks like astroturfing. There are several comments by users with very little history, all mentioning that they took the course before. https://news.ycombinator.com/item?id=45456502 (0 karma) https://news.y
57.
by threeducks 1y ago
A certain data center in Utah might top that, assuming that they have upgraded their hardware since 2013. https://www.forbes.com/sites/kashmirhill/2013/07/24/blueprin...
58.
by threeducks 1y ago
> So did you run the model offline on your own computer and get realtime audio? At the top of the README of the GitHub repository, there are a few links to demos where you can try the model. > It seems it needs around a $2,500 GPU You
59.
by threeducks 1y ago
Last quarter, NVIDIA reported data-center revenue of $30.8 billion and gaming revenue of only $3.3 billion. https://nvidianews.nvidia.com/news/nvidia-announces-financia... This also explains why NVIDIA will not sell hi
60.
by threeducks 1y ago
> Just might not be able to save... Oops, I did not read that before going ham in the editor. It seems that the files are stored inside the emscripten file system, so they are not lost. I could download my exported 'test.stl' w

More ›