mitjam

5 ms·

31.
by mitjam 6mo ago
Yes, it's interesting that HBM was invented by a collaboration between AMD and SK Hynix. It seems, HBM is the way to go for GPUs, anyway. The GB202 die that's in the GDDR7 based RTX 5090 and RTX 6000 Pro literally needed to be thi
32.
by mitjam 6mo ago
I assume a vm on DO is HA protected. Also storage might live on a Cluster. Did you consider a socond dedi or do you just accept the risk of longer failover time and data loss time (RPO) for recovering to a newly provisioned server? Would lo
33.
by mitjam 6mo ago
I would say 1-2 RTX 6000 Pro maxQ are more practical.
34.
by mitjam 7mo ago
I feel that too :) With the license, you are right, and I like your stance of "expressed intent".
35.
by mitjam 7mo ago
I like that you've started keeping your prompts in the repo [1]. Why have you deleted them, later on? What I find curious is how can something AI generated can be licensed AGPL? [1]: https://github.com/c0m4r/kula&#
36.
by mitjam 7mo ago
Reminds me of the "Weird Al" Yankovic evergreen "Mission Statement": https://www.youtube.com/watch?v=GyV_UG60dD4
37.
by mitjam 7mo ago
From personal experience, SW that was developed with agent does not hit the road because: a) learning and adapting is at first more effort, not less, b) learning with experiments is faster, c) experiencing the acceleration first hand is dem
38.
by mitjam 8mo ago
1999-2000, the company I worked with gave a smallish number of key users full read rights to the SAP minus HR, briefly after introducing SAP to the global supply chain of that company. The key users came from all orgs using SAP, basically e
39.
by mitjam 8mo ago
Thereafter: Design a bike that an actual pelican can learn to ride in real life.
40.
by mitjam 8mo ago
There is a word play in German: „Selbstständig bedeutet selbst und ständig.“ - Self-employed means yourself, continuously.
41.
Hardware for local coding models is still affordable. For how long?(mitjamartini.com)
2 points by mitjam 9mo ago|0 comments
42.
by mitjam 9mo ago
Coding agents let me build and throw away prototypes extremely fast. A major value, for me, is that they help me understand early what users truly want and need — rather than relying on assumptions or lingering in abstraction. They help me
43.
by mitjam 9mo ago
I have researched a bit more and think your recommendations are spot on. The 256 GB M3 Ultra is probably the best value right now even though it's 2k EUR more expensive than the 96 GB version.
44.
by mitjam 9mo ago
Building AI agents for a living is what I hope to become able to do, too, I consider myself still in learning phase. I have talked with some potential customers (small orgs, freelancers) and learned that local inference would unlock opportu
45.
by mitjam 9mo ago
That‘s exactly my fear.
46.
by mitjam 9mo ago
This is certainly the best approach.
47.
by mitjam 9mo ago
yes, I'm using smaller models on a Mac M2 Ultra 32GB and they work well, but larger models and coding use might be not a good fit for the architecture, after all.
48.
by mitjam 9mo ago
Yes, I also considered the RTX 6000 Pro Max-Q, but it’s quite expensive and probably only makes sense if I can use it for other workloads as well. Interestingly, its price hasn’t gone up since last summer, here in Germany.
49.
by mitjam 9mo ago
Yes, I already run Pi-hole on a Raspberry Pi at home, but I had to disable it due to complaints.
50.
by mitjam 9mo ago
True — I think local inference is still far more expensive for my use case due to batching effects and my relatively sporadic, hourly usage. That said, I also didn’t expect hardware prices (RTX 5090, RAM) to rise this quickly.
51.
by mitjam 9mo ago
Thanks, that helps me keep things in perspective.
52.
by mitjam 9mo ago
As a heavy user of OpenAI, Anthropic, and Google AI APIs, I’m increasingly tempted to buy a Mac Studio (M3 Ultra or M4 Pro) as a contingency in case the economics of hosted inference change significantly.
53.
by mitjam 9mo ago
I'm exploring adding a firewall to my home network to detect if apps are using my network as residential proxy. My daughter likes to install random games on iOS that have been advertised to her on other apps, and I wonder if some of th
54.
by mitjam 9mo ago
> Now imagine you're one of these customers. [...] Then you find out: 90% of the engineering team is leaving for Nvidia, The CEO and President are leaving for Nvidia, All the IP is licensed to Nvidia, Your point of contact is now...
55.
by mitjam 9mo ago
Yes, fun aspect: I actually think it was written by a human but in a way as if they‘re asking a machine and not other human beings. I feel guilty of doing the same, too, from time to time I feel it‘s a bad direction.
56.
by mitjam 9mo ago
I apologize if it sounded like a critique (it did), but I wanted to make an honest observation first and foremost. I think it was written by a human but it sounds Like a prompt. I believe I changed my use of language, too, but I dont like t
57.
by mitjam 9mo ago
I want to learn to launch and grow a paid app, I‘ve built a few SaaS and installed apps up to a point of „80% ready to launch“, but did not go all the way. I don’t quite know what‘s holding me back but I realized that this is what’s most im
58.
by mitjam 10mo ago
AI accellerates my learning. It helps me understand, do more experiments and lured me into reading more code. I think AI also helps me be more productive, but I‘m less focussed and sooner exhausted. I also fear its addictive potential which
59.
by mitjam 10mo ago
Maybe it's just because I'm LLMing a bit too much, recently, but this question sounds to me like a prompt.
60.
by mitjam 10mo ago
I don't quite understand how this would affect apps for SaaS and cloud services (if at all). Examples: I use Azure's app to launch a VM on Azure. I access content purchased as part of a SaaS subscription (eg. Sofa Tutor in Germany

More ›