pbgcp2026

8 ms·

121.
by pbgcp2026 6mo ago
"Q4 has generally been the sweet spot" for self-hosting, yes. For any real meaningful work it's dumb AF. The only way to get reasonable intelligence from mid-size Gemma or Qwen is to run full precision BF16. Anything else i
122.
by pbgcp2026 6mo ago
Thank you, I just realised we are talking about MTP. It seems that it's not that clear though. "Currently, the MTP capabilities are primarily accessible through Google's proprietary LiteRT framework, rather than the open-weig
123.
by pbgcp2026 6mo ago
It seems to me it's only Grok 4.20 that does this currently? Which other models did you have in mind, if I may ask?
124.
by pbgcp2026 6mo ago
" it supports prompt caching" May I ask if you checked that? I use "{"cachePoint": { "type": "default" }" and I found 2 things: * 1) even if stated in the Doco, Bedrock Converse API does
125.
by pbgcp2026 6mo ago
... cheers to that! ;-)
126.
by pbgcp2026 6mo ago
"here have been times, especially this year, when I wonder despairingly what it is exactly that I am preparing you for." This. Leaving the virtue signaling aside – what is exactly the value of your "preparation"? This
127.
by pbgcp2026 6mo ago
@arcfour - you are absolutely correct and you will be PIP'd and pushed out if you try this in FAANG company today , where *everything* is about AI.
128.
by pbgcp2026 6mo ago
it deleted the db to "simplify the migration". That was real scenario of at least one Sev 1 outages in "leading cloud provider".
129.
by pbgcp2026 6mo ago
"servers I own" - that's a temporary glitch and AI will fix it for ... someone else.
130.
by pbgcp2026 6mo ago
... expect Hetzner raising prices in ... 3 ... 2 ... 1
131.
by pbgcp2026 6mo ago
... meanwhile, all these students graduate, can't find jobs and become plumbers or bricklayers.