animan

8 ms·

1. 1.▲
   by animan 10d ago

   First domestic model (Union?)
2. 2.▲
   by animan 11d ago

   It's unclear if the context extends as the conversation grows?
3. 3.▲
   by animan 17d ago

   Not directly but enable a rouge lab to make the next COVID but lethal
4. 4.▲
   by animan 17d ago

   Hack s/huggingface/nuclear codes to s/steal test answers/launch nukes
5. 5.▲
   by animan 18d ago

   Wasn't for most of the day
6. 6.▲
   by animan 29d ago

   This was fun to read! I wish there was a no tech version of hackers news for this type of content only
7. 7.▲
   by animan 3mo ago

   Hi Satoshi
8. 8.▲
   by animan 8mo ago

   What was the point of Claude code or Gemini banning the OP? Why would they care about how IDEs use the underlying API?
9. 9.▲
   by animan 1y ago

   That snippet is trying to say that you can calculate KV for all the input tokens at once, and you don't need to loop over them since you have them all available. Instead for decode, you need to sequentially generate each token.
10. 10.▲
    by animan 1y ago

    Prefill is part of Inference. It's the first major step where you calculate all the keys and values for the input tokens. Decode is the next major step where you start generating output tokens one at a time. Both run on GPUs but have s
11. 11.▲
    by animan 2y ago

    One of us, one of us...