>a large enough corpus of whale speech To add, large enough here is also a potentially shifting target. LLMs exhibit extreme positive transfer of language comp

>a large enough corpus of whale speech To add, large enough here is also a potentially shifting target. LLMs exhibit extreme positive transfer of language competency. So 5B tokens of Korean will take Korean competency much further if trained alongside 50B tokens of English than if alone.