Speed changes would most likely be due to many other factors (like latency of your connection, the page you are loading, etc.) and these can vary much more wide

Speed changes would most likely be due to many other factors (like latency of your connection, the page you are loading, etc.) and these can vary much more widely and consistently that anything you are noticing.