the focus on non-proprietary training datasets and computational efficiency for the purposes of reducing costs and democratizing access is pretty cool! it is i

the focus on non-proprietary training datasets and computational efficiency for the purposes of reducing costs and democratizing access is pretty cool! it is interesting how model performance seems to scale almost linearly with size for the sizes chosen. (or perhaps not, perhaps the researchers are choosing to focus on the part of the performance-size response curve that is linear).