zkmon

12 ms·

241.
by zkmon 4mo ago
Interpreting the query by LLM is fine. But the problem happened when the query results were routed to LLM, which was unnecessary.
242.
by zkmon 4mo ago
Back in the day, personalization / customization was all the rage, as it lets the user feel the control, power and freedom. Now it's the opposite. It's about not letting user to have any control at all. I can't delete so
243.
by zkmon 4mo ago
Why would the agent send the results of the query "Show me my recent transactions" to LLM? This pretty deterministic results which involve no LLM interpretation or decision making. I understand that people are no longer writing IF
244.
by zkmon 4mo ago
Why would the agent send the results of the query "Show me my recent transactions" to LLM? This pretty deterministic results which involve no LLM interpretation or decision making.
245.
by zkmon 4mo ago
The confusion is due to blurring of distinction between the roles: Tool, Tool user and Tool provider. Traditionally, a human-agent who can have an intent and trigger an action is held liable for the consequences of the actions, not the tool
246.
by zkmon 4mo ago
After people get tired of the "too dangerous to release" punchline, they might come up with "too big to fail". Oh, wait that's already invented in 2008.
247.
by zkmon 4mo ago
Rockstars, AI or not, were 'successful' because they defined how success looks like. They created that perception and called it success. Not many people would bother going beyond the perceptions. They don't know how success o
248.
by zkmon 4mo ago
Ed's posts always sing the same tune - AI spend is unsustainable. But why are the investors pouring into these megacorps allowing them to burn cash? What calculations are the investors making? I would like to see those projections, ass
249.
by zkmon 4mo ago
The IF statement is the root creator of software programming. It has the ability to compare two values against each other and branch out to blocks of instructions. So it is perceiving (reading), decision making and routing - all that which
250.
by zkmon 4mo ago
Most American companies (regulated ones, definitely) can't dare to touch any Chinese models, though they knew that it makes perfect economic sense. Until the taboo prevails, the cartel get's their flood of profit. That's a ca
251.
by zkmon 4mo ago
> I don't know what to do. Ride the wave. You rode it when websites/webapps were the wave. I came into software industry before internet, kept changing my horse. You are never too old to learn new tricks. The new wave create ne
252.
by zkmon 4mo ago
How can the smaller Unsloth GGUF quant can beat the original google quant? (ref: unsloth/gemma-4-31B-it-qat-GGUF)
253.
by zkmon 5mo ago
This has a religious angle. Some religions believe in having as many babies as possible. Other religions are seeing the effect and realizing their mistake.
254.
by zkmon 5mo ago
Quanta article are getting longer and longer. AI effect?
255.
by zkmon 5mo ago
Not the first time. There were calls for NPT treaties etc over the decades. It is irreversible by design. Competition and ownership is the driving force.
256.
by zkmon 5mo ago
The concept of "flow" is questionable though. Bubbles in water move upwards, but it is actually water that is flowing downward around the bubbles. Just because bubbles do not contain water, we can't say bubbles are not flowin
257.
by zkmon 5mo ago
I was referring to transistor base bit - the way it 'switches' the circuit on/off. That bit is the primordial creator of 'logic', IF branching, compute and the intelligence.
258.
by zkmon 5mo ago
The big question is, will the productivity gains be absorbed by the needs? Societies don't have a need for infinite amount of luxury and laziness offered by the productivity of the machines. At some point, you would shake off things, g
259.
by zkmon 5mo ago
They are made out of data bits (memory) and switching bits (transistors/compute). Bits are made out of electric voltage and no voltage. Voltage is made out of flow of positive electric charges. Charges are made out of quarks ...
260.
by zkmon 5mo ago
Do they run well on vLLM?
261.
by zkmon 5mo ago
It's quite interesting to see the quants pour into the HF page. I keep refreshing it and see many new quants every few mins.
262.
by zkmon 5mo ago
I'm waiting for FP8 quant, preferably from Google.
263.
by zkmon 5mo ago
So they are recommendations. At global level.
264.
by zkmon 5mo ago
The reason why the tech giants push those features is that they tune their features to serve the average user from where bulk of their revenue comes from. If you feel offended by "Tap to improve", then you are not their average us
265.
by zkmon 5mo ago
> so I left to where?
266.
by zkmon 5mo ago
My company recently forced us to move from Atlassian BitBucket to GitHUb. What a mess.
267.
by zkmon 5mo ago
I don't think the analogies of animals in the wild or groups of hunter-gatherer is correct to the modern companies. A better analogy is the teams who built pyramids or armies who empowered Alexander or the medieval peasant settlements
268.
by zkmon 5mo ago
People are being forced to express in suboptimal ways, just to avoid being detected as slop. Some others are instructing AI to inject some typos or write grammatically incorrect sentences. The whole "hey I detected that you have used A
269.
by zkmon 5mo ago
I think we should stop discriminating or the pursuit of detecting LLM-generated content. This is not helping to stop the slop, it causing a harm - making the genuine human-generated content being branded as something bad. It's like bra
270.
by zkmon 5mo ago
Interesting. Wonder if they have competitive pricing on GPU instances.

More ›