sidharthkmenon

3 ms·

1. 1.▲
   by sidharthkmenon 2mo ago

   Yeah i think empirically you've hit the nail on the head (and there are some ties here to computability theory, e.g. Rice's thm). sometimes the specification is easier to write than the code (sorting algo vs. quicksort impl) and s
2. 2.▲
   by sidharthkmenon 2mo ago

   FWIW I believe we can hit AGI! but I think at this point it’s clear that benchmarks are ~meaningless. LLMs are spiky / alien intelligences which don’t map to our own expectations; the existence of a benchmark creates a dataset to hill
3. 3.▲
   by sidharthkmenon 3mo ago

   but managing humans is simpler in many ways, too: there's accountability for one. and it's much easier to reason about the capability boundary of a human.