3 ms·
> Bleeding edge research work should not be hindered by premature optimization concerns. isn't the ingenuinity in doing things efficiently rather than just tur
by mathisfun123 3y ago
> Bleeding edge research work should not be hindered by premature optimization concerns.
isn't the ingenuinity in doing things efficiently rather than just turning off the "scarce resources" setting? really i wish someone would explain to me what is the substance of "bleeding edge research" wherein nothing has been optimized except the flow of grant dollars from DoE/NSF to NVIDIA. like what is the research in "we burned O(1,000,000) compute core hours to train a model". i was recently in a discussion with ANL people about rick stevens next big idea - "the trillion parameter consortium" - where he plans to just commandeer aurora for a month. lol.