4 ms·
Your app could be slightly but meaningfully faster (depending on your use case) if the other servers/services your app relies on are close by (also on Azure, in
by jimmyechan 4y ago
Your app could be slightly but meaningfully faster (depending on your use case) if the other servers/services your app relies on are close by (also on Azure, in the same region region or datacenter). Otherwise probably not much more speed difference aside. There are other benefits such as managing everything in the same cloud, single billing, and maybe even some security benefits of having everything in the same VPC. This is assuming Azure will allow you to chose a region for the GPT4 service.
- capableweb 4y agoWhen dealing with GPT/LLMs, latency of requests is a minimal part of the time spent, so I don't think geographic location will matter much for that.
- jimmyechan 4y agoYes, while the GPT API latency will be minimal, whether it's noticeable by users would still depend on the application, use case, and even the location of the client(s). In some cases, the small latencies may still be noticeable for example in gaming, chat apps, or maybe some large enterprise deployment that's tied to specific regions. I agree that for hacking it won't make a significant difference and there's no reason to get on Azure just for GPT - too much overhead and Azure isn't the easiest to figure out to begin with.