As other comments suggest, this might be due to transcoding. There is tool Tdarr which transcodes media in advance. h264 could be the safest choice for mobile (

As other comments suggest, this might be due to transcoding. There is tool Tdarr which transcodes media in advance. h264 could be the safest choice for mobile (hw support) and web.