drakenot

7 ms·

31.
by drakenot 1y ago
The commentary around every Chinese model is incredibly disappointing. Asking about Tiananmen Square isn't some clever insight. Look at the political leanings that government-backed AIs in the United States will soon be required to ref
32.
by drakenot 1y ago
Have CC output a plan.md file.
33.
by drakenot 1y ago
Remote tracking?
34.
by drakenot 1y ago
Does the AI have the same content restrictions that the chat service does?
35.
by drakenot 1y ago
Yes, I mentioned this in the comment. I think it is closer, although still even it has a cold start problem. Once you are connected and in-session, it is a better experience. There is still some "turn based" conversational aspect
36.
by drakenot 1y ago
Something that really kills the 'effect' of most of the Voice > AI demos that I see is the cold start / latency. The OpenAI "Voice Mode" is closer, but when we can have near instantaneous and natural back and for
37.
by drakenot 1y ago
The cost of inference[0] for the same quality has been dropping by nearly 10x year over year. I’m not sure when that trend will slow down, but there’s still been a lot of low-hanging fruit around algorithmic efficiency. [0] https:/&#x
38.
by drakenot 2y ago
I've seen the same "Superficial Self-Reflection" mentioned in their linked blog post[0] as well, where the conclusion doesn't naturally follow the output of the thinking tokens. I think people are fooled by this, but if
39.
by drakenot 2y ago
Because of benchmark leakage / contamination?
40.
by drakenot 2y ago
Yes. And the original announcement and paper called out that this ~6 million was just for training the R1 model. It specifically mentioned that this didn't include any other costs, including research, previous models, etc. Just raw t
41.
by drakenot 2y ago
This just seems like Dario asking for regulatory capture and protection of his company. I don't think you need a deeper explanation than that.
42.
by drakenot 2y ago
People have proposed doing CoT not with output tokens, but to do it in the latent space of the model.
43.
by drakenot 2y ago
With DeepSeek-R1-Zero, their usage of RL didn't have reward functions really that indicated progress towards the goal afaik. It was "correct structure, wrong answer", "correct answer", "wrong answer". Thi
44.
by drakenot 2y ago
What are some other domains outside of Math and Coding that would be suitable for RL with automated verification?
45.
by drakenot 2y ago
(Summary from Reddit) - fp8 instead of fp32 precision training = 75% less memory - multi-token prediction to vastly speed up token output - Mixture of Experts (MoE) so that inference only uses parts of the model not the - entire model (~37B
46.
by drakenot 2y ago
Every time I've tried to use Qutebrowser, or similar -- I end up bouncing from it because I want proper extension support.
47.
by drakenot 2y ago
Are there any LLM products yet that can navigate websites for you ? Or perform operations on your local computer?
48.
by drakenot 2y ago
Commoditize your complement and all that.
49.
by drakenot 3y ago
Bookcamp has fairly negative reviews on the App Store. Have you had issues with it?
50.
by drakenot 3y ago
Local Siri with function calling for dozens of on-device use cases around contacts, phone settings, interpreting web results, timers, calculator, calendar and phone manipulation.
51.
by drakenot 3y ago
The whole embrace, extend.. ? > Mistral Remove "Committing to open models" from their website That was 5 hours ago. Without having insider details it is hard to know why, but the coincidence of timing with the Microsoft deal is
52.
by drakenot 3y ago
Is there real evidence of people becoming more fragile? Tons of young people still play sports and are physically active. Maybe it is just the bubble I live in, but kids who are on even rec leagues from 5 years old on are engaged in organi
53.
by drakenot 3y ago
Like the cabinets and whatnot? Wouldn't they be fitted to the space available or are the kitchen spaces standardized?
54.
by drakenot 3y ago
How effective would it be to build a neural network that controls the reaction wheel motors?
55.
by drakenot 3y ago
Do you know of any solid KVMs with EDID emulation and 1.4 DP?
56.
by drakenot 3y ago
Have you been paying attention to the proliferation of AI / LLM generated content on the web? Things are about to get dark unless we have new methods for combating it. It has seemed like Google has been on a slow and steady decline, l
57.
by drakenot 3y ago
Neal Stephenson's Anathem (2008): > “Early in the Reticulum-thousands of years ago-it became almost useless because it was cluttered with faulty, obsolete, or downright misleading information,” Sammann said. > “Crap, you once cal
58.
by drakenot 3y ago
I remember when jQuery was first released. To convince my coworkers to use it, I held an internal presentation called "Don't Fear the $," where I walked through the advantages it provided.
59.
by drakenot 3y ago
I just remember reading The Stars My Destination from Bester and noticing all these elements: * Mega-corporations with immense power and influence over all of society (Kodak of Kodak) * Drug dens offering synthetic designer drugs that made
60.
by drakenot 3y ago
William Gibson is the father of Cyberpunk, not Steam Punk. Though if Gibson is the father, I might say Bester is the grandfather.

More ›