I'm a little concerned about the statement on choosing the smallest size bearings as they can handle the greatest speed. is that true? I tend to use the largest

I'm a little concerned about the statement on choosing the smallest size bearings as they can handle the greatest speed. is that true? I tend to use the largest bearings the space and my wallet will accommodate for wear and stability...but I tend to make things up