hajile

6 ms·

31.
by hajile 3mo ago
He sees what is coming. Crowd funding HAS to be dropping off as people choose between feeding their family or their favorite content creators (the creator will be fine as they have lots of other patrons is a guilt-free rationalization too).
32.
by hajile 3mo ago
I might buy this if those languages were actually faster. Instead, implementations of scheme with no commercial backers run circles around scripting languages with huge budgets. Common Lisp can match and exceed languages like Java without t
33.
by hajile 3mo ago
Last I checked, both of these were built on top of Common Lisp/SBCL.
34.
by hajile 3mo ago
function can do what a macro does, but it must run every single time while the macro can run just one time during the final code generation. Let's say you have some Java-style a + b. It needs to work on native strings (concatenation) a
35.
by hajile 3mo ago
Your lisp criticism is orthogonal to the idea of lisp itself. Lisps like Coalton (lambda calculus) or Shen (sequent calculus) are strongly typed. AI is an interesting point too where being closer to a raw AST is likely an advantage because
36.
by hajile 3mo ago
They might be profitable for the exact two months SpaceX is giving them billions worth of free compute doesn’t seem convincing to me.
37.
by hajile 3mo ago
This is like when a vacuum doesn’t pick something up after a few tries. The user picks the thing up, looks at it, then puts it back down and tries again until they finally give up and move it to the trash. If you can’t design a solution and
38.
by hajile 3mo ago
XML wasn’t the best alternative then either. S-expressions have been around since the 50s and are better than either XML or JSON.
39.
by hajile 3mo ago
I fear even a lot of bright, motivated people will be so discouraged by AI doomers that they won’t bother trying to learn.
40.
by hajile 4mo ago
I'm wondering about something different. FPGA seems ideal for an AI chip because you can simply flash the latest model. The downsides are low density and low clockspeed. It seems that you can only fit 100-300M parameters in even very l
41.
by hajile 4mo ago
> These people are professionals that acknowledge IPC is a stupid metric. Even if you think IPC is a stupid metric (it's not), ARM is still wiping the floor in total performance, performance per area, and performance per watt. >
42.
by hajile 4mo ago
The government isn't going to be making chip fabs go any faster which is the biggest limitation here. The second big issue is that it takes months to fab chips meaning your hardware AI is months to maybe a year or more behind the times
43.
by hajile 4mo ago
There is a reasonable kernel of an idea here, but only if you dial expectations WAY back. The 10 years speculation is just wrong though. Even in 10 years, their 8B param model isn't going to be in consumer devices. 6nm is just 7nm++ an
44.
by hajile 4mo ago
The better solution would be making part of the chip cluster use something like FPGA which can be reprogrammed. Text to speech or diagnostics equipment where the core model is relatively small and never changes seems like the ideal applicat
45.
by hajile 4mo ago
Taalas HC1 AI uses Llama 3.1 8B, but takes up a massive 53B transistors and 815mm2 on TSMC N6 (nearly at the reticle limit of 858mm2). N2 is a little less than 3x as dense (110MTr/mm2 vs 313MTr/mm2). This chip would still be 272mm
46.
by hajile 4mo ago
If I can run it locally, it is certainly more safe than running on some cloud server somewhere.
47.
by hajile 4mo ago
M1 released 6 years ago, but AMD/Intel still can't get close to ARM cores in IPC. Anandtech was observing that Apple had better IPC in their phone chips YEARS before M1. Lots of people discredited it as "apples and oranges&qu
48.
by hajile 4mo ago
Demand for 512+gb hasn't gone away though. I suspect we'll see M5/M6 Ultra later this year with 512gb-1tb of ram going for the biggest premium we've ever seen from the company.
49.
by hajile 4mo ago
We've already hit RAM power and size limits (about 40k electrons which is the limit before we get noise messing up the amplifier). If a model needs 2x more memory, but serves the same number of customers, the cost is going to go up per
50.
by hajile 4mo ago
If you are trying to get more than 64gb of RAM or doing tons of inferencing, you're getting a Max or Ultra anyway.
51.
by hajile 4mo ago
It might be M6 Ultra and I think the real reason for stopping selling top-tier units was to avoid mid-generation price hikes and increasing demand for the more expensive next-gen systems that I assume will come with 512gb (maybe 1TB) of RAM
52.
by hajile 4mo ago
Most of the areas without good internet barely take home $100/m and a lot of them take home less than that. If you hooked up every single cargo ship on the planet to starlink, you'd only add around 100k connections and average wag
53.
by hajile 4mo ago
There are two different questions. Are cables cheaper and is Starlink profitable in the long term? Launching a starlink satellite costs $1.5-2M per satellite for the current design. Each satellite lasts around 5 years and they need 42k of t
54.
by hajile 4mo ago
This is putting the world at risk of Kessler Syndrome.
55.
by hajile 4mo ago
The even bigger hurdle is selling token based pricing to normal (non-dev) users. "You pay an indeterminant amount of money to ask a question and you might not even get the response you want without spending even more money" doesn&
56.
by hajile 4mo ago
AI with blockchain. Maybe we can mix in IoT and VR for the ultimate in buzzword synergy.
57.
by hajile 4mo ago
It reminds me of the Chinese bike wars where everyone was slashing prices trying to keep marketshare until the bubble burst and everyone lost billions. https://www.youtube.com/watch?v=FQrEDq8KPiU
58.
by hajile 4mo ago
In the coding realm, I think we'll be seeing 35, 70, and 150B models sold where you pay a few hundred to a few thousand dollars up front and get a year of monthly/bi-monthly updates where they've trained it on new coding docu
59.
by hajile 4mo ago
Humans have good spatial memory and having a handful of statically-positioned desktops in a 2D plane makes navigation intuitive and consistent. The real issue is how the ORDER of the desktops changes all the time which messes with that spat
60.
by hajile 5mo ago
That's some really fast goalpost moving. If AI could outperform humans, Anthropic would NEVER release that model. Instead, they'd use it to create a new google, photoshop, office, windows, etc for cheap then undercut all those com

More ›