hermitShell

4 ms·

1.
by hermitShell 5d ago
The AI generated character is a weighted average of many characters written by humans. Which are not created from nothing. People write characters based on a combination of other fictional characters, real characters, and perhaps some &#x27
2.
by hermitShell 9d ago
It's ARM.
3.
by hermitShell 9d ago
I fail to see how they will take a significant market share or even break even on this venture. It's an overcrowded market. Far better would be to focus on semiconductor supply chain, which Japan already supplies some elements, to sell
4.
by hermitShell 9d ago
You have to load the model weights into VRAM over PCI-E (from RAM). So the (PCI-E) bandwidth strongly affects time to first token. You have to run inference on the GPU by reading and writing to VRAM. So TFLOPS of the compute matters, and ba
5.
by hermitShell 10d ago
People sometimes call EU the sleeping giant. Big potential compared to the actual results. I'm more aware of what Canadian government does with its tax dollars. And I'm just assuming that the EU is similarly quite expensive for wh
6.
by hermitShell 10d ago
There are deeper structural problems when you look at the incentives inherent to government driven society. While I do appreciate and even support the idea that the immense wealth available on planet earth should be more evenly distributed,
7.
by hermitShell 11d ago
Manny comments I agree with - it's a mistake, it's a reason to leave the distro... I'd like to point out that Ubuntu/Canonical is now seemingly philosophically separate from the origins of GNU and Linux. If you're c
8.
by hermitShell 12d ago
> "until the context rot and sampling problem is fixed forever" I agree, prompt adherence seems to get worse when operating on large inputs. Does anyone have some notion of the SOTA with this? Can we expect big improvements by
9.
by hermitShell 12d ago
Your hardware can do way more than 64k tokens context window, can't it? And with Ollama it's very easy, superficially you just drag the slider. I'm now reading "Friends Don't Let Friends Use Ollama" linked in a
10.
by hermitShell 12d ago
This is good guidance, but what do you have to say about convincing your team of developers to live it out? I've found that developers usually like writing code and avoid contributing to documentation. For some, it's actually scar
11.
by hermitShell 16d ago
It will happen eventually, especially with AI generated books published electronically. I wonder if there is a cutoff date or something to try and avoid this problem of low effort books.
12.
by hermitShell 16d ago
If you've not read Fred Brooks MMM, give it a shot. It seems like you're implying that teams of 60-80 developers should be expected to outperform teams of 12. This is simply not true. The most important feature of source code as a
13.
by hermitShell 17d ago
As a user of local models, does this mean that there are 'magic incantations' that can increase the performance of some local models? I see some details about recovering information via whatever technique. It's interesting, b
14.
by hermitShell 17d ago
When I look at the technology and capability of frontier models for ideation, brainstorming, and research, or when I look at the open source community and open weight models, and running local LLM's... I'm convinced that this is a
15.
by hermitShell 22d ago
honestly that would still probably mean more than story points. maybe all this AI insanity has an upside that the new cargo cult washes out the old one.
16.
by hermitShell 22d ago
In the novel Anathem by Neal Stephenson, the internet becomes unusable for humans thousands of years before the events of the book, due to a process called Artificial Inanity. AI generated content, both good and bad, some riddled with erro
17.
by hermitShell 1mo ago
America is headed towards techno zaibatsu economy. Just a product of the dynamics of capital and power. Too much cash, Nvidia is forced to try and find ways to deploy excess capital very quickly. Most efficient way is to absorb players in e
18.
by hermitShell 1mo ago
I tend to agree, but the Semianalysis + Dwarkesh side of reporting still does surface interesting information. You just have to take it all with a grain of salt, as indeed it is more hype focused, and look for real information hidden in the
19.
by hermitShell 2mo ago
It seems they had a head start but are now facing stiff competition on all fronts. Software moat, GPU's for gaming, and its distant cousin datacenter compute. They rightfully invested their insane profits into many ventures, and how ma
20.
by hermitShell 2mo ago
I take your point, statistically we're already there. Unless humanity was to bootstrap its own biological intelligence to be consistently higher, there's little point in any individual attempting to safeguard the tech stack to fir
21.
by hermitShell 2mo ago
That is a truly terrifying future to imagine. Fortunately I would hazard to guess the medical technology to accomplish something like this is very, very far away. Not only because of the raw technological challenge, but also the barriers to
22.
by hermitShell 2mo ago
Would you be able to recommend any articles or videos that do a deeper more honest analysis than the current media hype cycle?
23.
by hermitShell 2mo ago
Do you think this necessarily sends us as a society (as a species) towards a future where we eventually stop understanding technology and science itself? Like in Asimov's Foundation or Liu Cixin's 'Taking Care of God'. M
24.
by hermitShell 2mo ago
The author of the article mainly talks about agentic programming, code generation, and reasoning. Ans very rightly identifies a big problem with agentic programming, in my experience. If developers can't maintain the software without A
25.
by hermitShell 2mo ago
You might find this interesting: https://news.ycombinator.com/item?id=43636230
26.
by hermitShell 2mo ago
I've been using dual NVIDIA GPU's with Ollama. Even when I push to 30b models and more context window, Ollama manages RAM / VRAM very well. I never got OOM errors, just massive slowdown as the PCI-E bottleneck throttles the G
27.
by hermitShell 2mo ago
I have great interest in fine-tuning open models, and I'm looking for resources that HN folks can personally recommend. This article looks good and I've bookmarked it to read more thoroughly over time. I've gotten as far as r
28.
by hermitShell 2mo ago
Sure, most of the developed world is facing a demographic crisis. But will it trigger a meaningful reset of wealth distribution? Or be ineffective like the peasants revolt... The core question seems to be whether the economic systems and fi
29.
by hermitShell 2mo ago
I maintain some FPGA code in VHDL and also some C code for microcontroller. One thing I appreciate immensely about VHDL is how strict it is. You have no option but to think carefully about modularity and heirarchy. By comparison C is very f
30.
by hermitShell 3mo ago
I understand Gates has also helped in reviving Nuclear power, from reading news on this site and others. Smaller, updated designs that don't face quite the same level of pressure from regulators. If we assume you are right about billio

More ›