For the interested, this phenomenon is known as (deep) double descent: https://openai.com/blog/deep-double-descent/ https://openai.com/blog/deep-double-descent

For the interested, this phenomenon is known as (deep) double descent: https://openai.com/blog/deep-double-descent/ https://openai.com/blog/deep-double-descent/ https://www.lesswrong.com/posts/FRv7ryoqtvSuqBxuT/understanding-deep-double-descent https://www.lesswrong.com/posts/FRv7ryoqtvSuqBxuT/understand... (Edit: Oh, the definition appears in the abstract of the linked paper.)