yowlingcat

8 ms·

31.
by yowlingcat 8mo ago
What do you think about RLMs? At first blush it looks like sub agents with some sprinkles on top, but people who have become more adept with it seem to show its ability to handle sublinear context scaling behavior very effectively.
32.
by yowlingcat 8mo ago
It's a very concerning future. I would love to live in a world where we could simply stop them from doing that, but for the moment, the best hedge appears to be the Chinese open weight models that can't be put back in the box and
33.
by yowlingcat 8mo ago
It goes the other way around as well. DeepSeek has made quite a few innovations that the US labs were lacking (DSA being the most notable one). It's also not clear to me how much of distilled outputs are just an additional ingredient o
34.
by yowlingcat 8mo ago
Does this support when you click on a peon a bunch of times and it says "Me not that kind of Orc!"
35.
by yowlingcat 8mo ago
Just came across SST the other day and it looks very interesting. It looks like it's based on Pulumi, so it begs the question for me of why does it exist? Structurally it doesn't seem to be that different in capabilities. Perhaps
36.
by yowlingcat 8mo ago
What I don't understand is why Gemini is not #1, other than that Google has no economic reason to have the same fire under its ass to be #1 as Anthropic and OpenAI. Or maybe they are correctly assessing that getting to good enough and
37.
by yowlingcat 9mo ago
Something that's been on my mind recently - what if gen AI coding tools are ultimately attention casinos in the same way social media is? You burn through tons of tokens and you pay per token, it feels productive and engaging, but ulti
38.
by yowlingcat 9mo ago
I agree with your point and it is to that point I disagree with GP. These open weight models which have ultimately been constructed from so many thousands of years of humanity are also now freely available to all of humanity. To me that is
39.
by yowlingcat 9mo ago
I don't believe Antigravity or Cursor work well with pluggable models. It seems to be impossible with Antigravity and with Cursor while you can change the OAI compatible API endpoint to one of your choice, not all features may work as
40.
by yowlingcat 9mo ago
It may be worth taking a look at LFM [1]. I haven't had the need to use it so far (running on Apple silicon on a day to day basis so my dailies are usually the 30B+ MoEs) but I've heard good things from the internet from folks usi
41.
by yowlingcat 9mo ago
This is the approach that I've taken with Open WebUI. It's a great piece of software for exposing a shared GPT interface but of course that's pretty primitive in the grand scheme of things compared to something like this. But
42.
by yowlingcat 9mo ago
Great stuff and very timely. I just started getting into using opencode and while I'm hugely optimistic about its capabilities and can use it personally without too much sweat, I was left hoping for something a bit more batteries inclu
43.
by yowlingcat 9mo ago
This is the way. Branches are structurally cheap in git for a reason - to make it easy to do this! The only minor pain is that then I have to remember to clean up the unused branches for paths that didn't pan out but that isn't so
44.
by yowlingcat 9mo ago
The whole idea of outcompeting on volume doesn't add up for music. It's a power law game not a commodities game. Spotify is playing a dangerous game trying to pretend that it is but I have little faith it won't destroy their
45.
by yowlingcat 9mo ago
I didn't even think about the analogy to sampling (and the prior controversy) but that is an even better analogy. Ultimately, the different between what's creative re-use and what's a ripoff is a matter of how skillfully it&#
46.
by yowlingcat 9mo ago
Wasn't it Picasso that said "good artist borrow, great artists steal?" I've never heard an artist confident in their own ability complain about this because they're not threatened by other competent human artists kn
47.
by yowlingcat 9mo ago
A view I have which feels controversial these days is that GenAI code tools are a net asset to code being held by entities that "should" hold them (ie workloads where code is a profit center not a cost center) and a net liability
48.
by yowlingcat 9mo ago
It isn't that simple. One of the implicit tradeoffs you make buying SaaS is that the overall cost of evolution (development and ongoing maintenance) is subsidized across all of the investment resources and customer base of the vendor.
49.
by yowlingcat 9mo ago
Someone here has lost the plot and at this point I wonder if it is me. Is software supposed to be deterministic anymore? Are incremental steps expected to be upgrades and not regressions? Is stability of behavior and dependability desirable
50.
by yowlingcat 10mo ago
Locally, I use a Mac Studio with a ton of VRAM and just accept the limitations of the Metal ecosystem, which is generally fine for the inference workloads I am consistently running locally (but I think would be a pain for a lot of people).
51.
by yowlingcat 10mo ago
Run a model at all, run a model fast, run a model cheap. Pick 2. With LLM workloads, you can run some of the larger local models (at all) and you can run them cheap on the unified 128G RAM machines (Strix Halo/Spark) - for example, gpt
52.
by yowlingcat 10mo ago
Very cool! Managing ones boxes as cattle and not pets almost always seems like a better idea in retrospect but historically it is easier said than done. Moreover, I like the idea of being able to diff a box's actual state from a curren
53.
by yowlingcat 10mo ago
Ah, I remember scheming about buying an NF7-S + an Athlon XP Barton and unlocking it, combining it with a geforce 4 ti4200 and overclocking both but not even having enough of the pocket change to pull that off. By the time I was far enough
54.
by yowlingcat 10mo ago
Are you experienced with DAWs as a composer or producer? Many if not most professional producers use MIDI controllers with knobs/sliders/buttons MIDI mapped to DAW controls. As such the skeuomorphism actually plays a valuable role
55.
by yowlingcat 10mo ago
I agree with you and I will also anecdotally note that I've been personally observing more and more of the younger generations (Z, esp gen Alpha) adopt these mechanisms en masse, viewing social media as the funhouse simulation of socia
56.
by yowlingcat 10mo ago
Technically it's a lot closer to monopsony (Sam Altman/OAI cornering 40% of the market on DRAM in a clever way for his interests that harms the rest of the world that would want to use it). I keep hoping that somehow necessity wil
57.
by yowlingcat 10mo ago
Very cool! Found this note interesting: ``` Limitations I haven't, yet, found a good way to implement filters (low-pass, high-pass, band-pass, etc.). It does not have Fourier transform, and we cannot operate on the frequency domain. Ho
58.
by yowlingcat 11mo ago
I get your point around the soft deletion example but that sounds more like poor module separation + relational query abstraction/re-use rather than a shared database issue. Whether it's through a service, a module or a library, l
59.
by yowlingcat 11mo ago
I see a lot of value in spinning up microservices where the database is global across all services (and not inside the service) but I struggle more to see the value of separate core transactional databases for separate services unless/
60.
by yowlingcat 11mo ago
I observe this compulsion a lot and in my opinion, it's almost always coming from resentment driving ego in an attempt to compensate for insecurity and self-loathing, which ultimately ends up misdirected towards others. It's almos

More ›