mrinterweb

8 ms·

61.
by mrinterweb 9mo ago
Most consumers aren't running LLMs locally. Most people's on-device AI is likely whatever Windows 11 is doing, and Windows 11 AI functionality is going over like a lead balloon. The only open-weight models that can come close to m
62.
by mrinterweb 9mo ago
The Apple M series chips are solid for inference.
63.
by mrinterweb 9mo ago
The finance comments may be right. Another factor would be marketing budgets and existing brand recognition. The watches are marketed as having all of these features, and I think customers got lost in the feature comparison instead of think
64.
by mrinterweb 9mo ago
I had two pebble watches, and I used them daily for years. I rarely use my pixel watch 3, mainly because of charging. I only have one proprietary charger for the watch and sometime it is on my desk, sometimes near my bed, sometimes somewher
65.
by mrinterweb 9mo ago
Pebble seems to be the only watch company that I feel understands what a smartwatch should be. It feels like everyone else is trying to make a phone replacement. Pebbles are more of an extension to your phone. Sure it can do some things wit
66.
by mrinterweb 9mo ago
> TPUs aren't transformer ASICs. https://cloud.google.com/tpu > A TPU is an application-specific integrated circuit (ASIC) designed by Google for neural networks.
67.
by mrinterweb 9mo ago
Soon was wrong. I should have said it is already happening. Google Gemini already uses their own TPU chips. Nvidia just dropped $20B to buy the IP for Groq's LPU (custom silicon for inference). $20B says Nvidia sees the writing on the
68.
by mrinterweb 9mo ago
Gemini is likely the most widely used gen AI model in the world considering search, Android integration, and countless other integrations into the Google ecosystem. Gemini runs on their custom TPU chips. So I would say a large portion of in
69.
by mrinterweb 9mo ago
As far as I understand all the inference purpose-build silicon out there is not being sold to competitors and kept in-house. Google's TPU, Amazon's Inferentia (horrible name), Microsoft's Maia, Meta's MTIA. It seems that
70.
by mrinterweb 9mo ago
I've been wondering when we will see general purpose consumer FPGAs, and eventually ASICs, for inference. This reminds me of bitcoin mining. Bitcoin mining started with GPUs. I think I remember a brief FPGA period that transitioned to
71.
by mrinterweb 9mo ago
I'm considering hosting a separate pg db just to be able to access certain extensions. I am interested in this extension as well as https://wiki.postgresql.org/wiki/Incremental_View_Maintenanc... (also not availab
72.
by mrinterweb 9mo ago
Ruby is my favorite language for writing CLI scripts/apps. I've been feeling the TUI options for ruby feel a bit dated, and I've been secretly wanting charm for ruby for a while. I'm very excited to use this.
73.
by mrinterweb 9mo ago
When I'm writing code that will be distributed to other devs, I feel type annotations make more sense because it helps document the libraries and there is less ambiguity about what a method will take. As with everything, "it depen
74.
by mrinterweb 9mo ago
The times I've been bitten by type safety issues is far less than the hassle of maintaining types. Seriously, it is a much smaller issue than people make it out to be. I will say that I do get bitten by the occasional `NoMethodError` o
75.
by mrinterweb 9mo ago
I too feel the type safety concern people have with ruby is overblown. The number of actual wrong type related issues I encounter is hardly enough to justify the costs of strong typing. The biggest type issue is with `nil` values and `NoMet
76.
by mrinterweb 9mo ago
There is [RBS]( https://sorbet.org/ ) (part of ruby 3) and [sorbet]( https://sorbet.org/ ). To be honest, these aren't widely used as far as I am aware. I don't know if it is runtime overhead, ergonom
77.
by mrinterweb 10mo ago
I was hoping LSP support would be implemented. I know there are existing MCP servers that can do something kind of similar, but I doubt the agent would be smart enough to consistently utilize the LSP MCP. Here's hoping for less greps.
78.
by mrinterweb 10mo ago
Hotwire Native would be a great option, but I will argue that I've never felt that I got JSON APIs for free with rails. Thousands of my rails dev hours spent writing APIs would say otherwise.
79.
by mrinterweb 10mo ago
I have lost track of the number of times I have heard that argument, and implemented the API only to never have other API clients, or the API clients that do come later have very different needs and I need to create another API for that. I
80.
by mrinterweb 10mo ago
I would much rather buy a dumb TV. I feel that the smart TV experience is an opportunity it eventually make TVs feel dated and slow. I would rather buy a standalone streamer that I can plug in. Buying a new $100 dollar streamer every couple
81.
by mrinterweb 10mo ago
I have often wondered how much a specialized local LLM could benefit an agentic tool like Gemini CLI. I would think there could be a good win for speed and minimizing token use if coding agents used a local model. A local model could handle
82.
by mrinterweb 10mo ago
Not all web applications need to be have an API that serves other clients. Often web apps are enough.
83.
by mrinterweb 10mo ago
HTML over the wire frameworks like HTMX, Hotwire (rails), LiveView (phoenix), Livewire (laravel), LiveView (django), etc. They all have the same basic idea with differences in how they achieve it. I feel this approach is overlooked, and it
84.
by mrinterweb 10mo ago
I realize terrestrial data centers have environmental risks, but are the risks greater for an orbital data center? I would think space debris, solar flares, or a bad actor satellite with a laser could do a lot of damage. Good luck repairing
85.
by mrinterweb 10mo ago
I can see how sharding could be difficult with a bigint FK, but UUIDv7 would still play nice, if I understand your point correctly. Monotonically increasing foreign keys have performance benefits over random UUIDv4 FKs in postgresql is the
86.
by mrinterweb 10mo ago
How so?
87.
by mrinterweb 10mo ago
I mean undermining of science in the sense of popular opinion. These politicians actively denigrate, de-fund, ignore science. Unfortunately, these same politicians were popular enough to gain power. They continue to attack science and treat
88.
by mrinterweb 10mo ago
The undermining of science has given people like this more of a voice. US leadership has got to the point where science is largely disregarded and leaders just impose whatever they think is true regardless of facts.
89.
by mrinterweb 10mo ago
I wish more of the web was like this. I miss the wild creativity of websites way back in the day. The web has mostly homogenized around what web UI should be. I love seeing weird experimental stuff made just for fun.
90.
by mrinterweb 10mo ago
This reminds me of how rails manages encrypted credentials. https://guides.rubyonrails.org/security.html#custom-credenti... . The big differences, this is portable and sets values as session env vars instead of application v

More ›