tanananinena

3 ms·

1. 1.▲
   by tanananinena 2y ago

   This is probably the most interesting (and insightful) paper on grokking I’ve read recently: https://arxiv.org/abs/2402.15555
2. 2.▲
   by tanananinena 2y ago

   I remember being completely clueless as to where/how input is handled in the code (or how I would even start to grasp it). It would be nice to see someone actually do this and explain their thought process though.
3. 3.▲
   Activating a Playstation-Only Cheat on PC in Just Nine Bytes(falseceilings.wordpress.com)

   27 points by tanananinena 2y ago|7 comments
4. 4.▲
   by tanananinena 2y ago

   Classical word embeddings are static - their value doesn't change depending on the context they appear in. You can think of the word embedding as a weighted average of embeddings of words which co-occur with the initial word. So it&#x2