3 ms·
> Also where is your evidence for this? The fact that "scaling laws" didn't scale? Go open your favorite LLM in a hex editor, oftentimes half the larger tensor
by bigyabai 1y ago
> Also where is your evidence for this?
The fact that "scaling laws" didn't scale? Go open your favorite LLM in a hex editor, oftentimes half the larger tensors are just null bytes.
- bubblelicious 1y agoShow me a paper, this makes no sense of course scaling laws are scaling