layoric

5 ms·

31.
by layoric 5mo ago
Very impressive. One thing that seems odd to me is that is at like 4 minutes before it starts a response for large input? I don't use mac hardware for LLMs, but that is quite surprising and would seem to be a pretty large stumbling blo
32.
by layoric 5mo ago
I agree, the mechanical refactoring of modern IDE tooling, especially with typed languages is so much faster and safer, it's not even close. These tools can be useful for sure, but I think in general they are being wayy over prescribed
33.
by layoric 5mo ago
This is very true, I've found these tools that I am highly encouraged to use very hit and miss, which they are by nature. After using Matt Pocock's skills, I've come around to the idea that LLM's main utility is to act a
34.
by layoric 5mo ago
A 90s Camry, Corolla, or Civic seems to have become the peak minimalist car. Shame we will never likely see an EV equivalent focused on utility and cost efficiency without all the bloat. I don’t think there is a good option sadly, any ICE c
35.
by layoric 5mo ago
Are you concerned this will just lead to coupling everywhere like microservices tend to do?
36.
by layoric 5mo ago
Yeah, I tried Codex pro today and the $20 plan is way more generous than Claude's, especially lately.
37.
by layoric 5mo ago
I've found MiniMax 2.7 pretty decent and even pay-as-you-go on OpenRouter, it's $0.30/mt in, and $1.20/mt out you can get some pretty heavy usage for between $5-$10. Their token subscription is heavily subsidized, but ev
38.
by layoric 5mo ago
I'm trying out codex for first time as well cause something up with Claude for sure, 4.7 has been super frustrating. For other models, highly recommend trying MiniMax 2.7, using it with Hermes is actually pretty good, and their token s
39.
by layoric 5mo ago
+100 this. As devs we need to internalise this issue to avoid repeating the same class of exploits over and over again.
40.
by layoric 6mo ago
Worked on the software side of increasing the rate of solar penetration in electricity networks between 2016-2020 via global solar radiation forecasting. The uptake of the software was slow the first year but then rapid once more electricit
41.
by layoric 6mo ago
Building websites, I agree has little value, but using it as a way to explain basics of how the web works I think is pretty valuable. Web likely isn't going anywhere for a long time, having some basic knowledge of how it works I think
42.
by layoric 6mo ago
"side loading", I know this term is the one used but I think should be pushed back against with just using the standard "installing"/"install". It makes the control point clearer and (should be) unsettling
43.
by layoric 7mo ago
Rugged individualism for the poor and vulnerable, won't someone think of the company and shareholders! /s
44.
by layoric 7mo ago
I think it would assist in exploiting exploring multiple solution spaces in parallel, and can see with the right user in the loop + tools like compilers, static analysis, tests, etc wrapped harness, be able to iterate very quickly on multip
45.
by layoric 8mo ago
I'm quite surprised the A100 is not much better since the power levels for the Ampere cards I believe is a lot lower. Does this mean even for a model that fits on a single server that trains for a few weeks will absolutely need a recov
46.
by layoric 8mo ago
Right, a market is a small tool of larger systems. That’s fine, hard to get right but can make systems better. Type two just seems to be the cargo culted everywhere..
47.
by layoric 8mo ago
Exactly, these markets exist in the real world, so as their size and use increases, the more likely the odds will influence real world events. Look at sports betting for a much smaller example. Match fixing is known. Electricity markets are
48.
by layoric 9mo ago
Thanks for posting the performance numbers from your own validation. 6-7 tokens/sec is quite remarkable for the hardware.
49.
by layoric 10mo ago
This happens when you get worse and worse inequality when it comes to buying power. The most accurate prediction into how this all plays out I think is what Gary Stevenson calls "The Squeeze Out" -> https://www.yout
50.
by layoric 11mo ago
Totally true. I have a trusty old (like 2016 era) X99 setup that I use for 1.2TB of time series data hosted in a timescaledb PostGIS database. I can fetch all the data I need quickly to crunch on another local machine, and max out my aging
51.
by layoric 11mo ago
> The second you turn your head though, your fellow teammates will conspire to replatform onto Go or Rust or NodeJS or GitHub Actions and make everything miserable again. Curious how would you use use Smalltalk in replace of GitHub Actio
52.
by layoric 11mo ago
I have a hard time trying to conceptualize lossy text compression, but I've recently started to think about the "reasoning"/output as just a by product of lossy compression, and weights tending towards an average of the
53.
by layoric 11mo ago
> In general once you start thinking about scaling data to larger capacities is when you start considering the cloud What kind of capacities as a rule of thumb would you use? You can fit an awful lot of storage and compute on a single ra
54.
by layoric 11mo ago
Same setup here, one game setup I've hit but this will be a rare problem, is StarCraft Remastered. Wine has an issue with audio processing which I can't seem to configure my way out of. It pegs all 32 threads and still stutters. T
55.
by layoric 11mo ago
Working at IT places in the late 2000s, it was still pretty common place for there to be a server rooms. Even for a large org with multiple sites 100s of kms a part, you could manage it with a pretty small team. And it is a lot easier to bu
56.
by layoric 11mo ago
I discovered this project recently and used it for Himawari Standard Data format and it made it so much easier. Definitely recommend using this if you need to create binary readers for uncommon formats.
57.
by layoric 11mo ago
I must be confused, my understanding was m7a was 4th generation Epyc (Genoa, Bergamo and Siena) which I believe all have 2 threads per core no?
58.
by layoric 11mo ago
Exactly, and the performance of consumer tech is wildly faster. Eg, a Ryzen 5825U mini pc with 16GB memory is ~$250USD with 512GB nvme. That thing will outperform of 14 core Xeon from ~2016 on multicore workloads and absolutely thrash it in
59.
by layoric 11mo ago
> $50 for a dyno with 1 GB of ram in 2025 is robbery AWS isn't much better honestly.. $50/month gets you an m7a.medium which is 1 vCPU (not core) and 4GB of RAM. Yes that's more memory but any wonder why AWS is making mone
60.
by layoric 11mo ago
Decoder for people reading: PM - Product Manager FS - Fullstack developer FE - Frontend developer BE - Backend developer

More ›