3 ms·

You missed the point. The modern infrastructure's primary value is scalability. This number is of course bad, for the data. But this number will be more impress

You missed the point. The modern infrastructure's primary value is scalability. This number is of course bad, for the data. But this number will be more impressive when the data is million time bigger.

jiggawatts 7y ago
You missed the point. Modern infrastructure's scalability is irrelevant if even one user's experience is poor. In the era of 64-core processors, scaling horizontally is meaningless for 99.9% of architecture designs. Latency matters to everyone, always. Trivial queries taking nearly 1/10th of a second on modern kit is absolutely atrocious, and shows a total lack of awareness of performance as a feature.
- therapon 7y ago
  It looks like the first query run in the REPL takes more time (startup cost). Subsequent runs of that query return around 5ms. Even a query like `SELECT * FROM 1` when executed immediately after starting the REPL will take longer than usual. Even running non-query expression, e.g., `1 + 1` immediately after starting the REPL will take more time to complete than usual. The time reported by the REPL can be misleading. There is work that we definitely need to do on performance as we develop PartiQL. Performance is something we have been considering since inception and we will keep considering as we go forward.
- monsieurbanana 7y ago
  > Latency matters to everyone, always. I used to do a lot of BigQuery for analytics. Latency in BigQuery is crap and clearly not it's selling point, we're not talking ms here, we're talking seconds at a minimum. Yet it's a really nice database for it's use cases.
  - vgt 7y ago
    We've improved our floor latency by a factor of 5 since two years ago, we've introduced clustering, and newly introduced BI engine gets you into dozen digit millisecond range, so give it a try again :) (Product manager on BigQuery)
- justicezyx 7y ago
  I mean modern infrastructure's user experience is very poor compared to decades ago's PC based software...

jiggawatts 7y ago

You missed the point. Modern infrastructure's scalability is irrelevant if even one user's experience is poor. In the era of 64-core processors, scaling horizontally is meaningless for 99.9% of architecture designs. Latency matters to everyone, always. Trivial queries taking nearly 1/10th of a second on modern kit is absolutely atrocious, and shows a total lack of awareness of performance as a feature.

therapon 7y ago
It looks like the first query run in the REPL takes more time (startup cost). Subsequent runs of that query return around 5ms. Even a query like `SELECT * FROM 1` when executed immediately after starting the REPL will take longer than usual. Even running non-query expression, e.g., `1 + 1` immediately after starting the REPL will take more time to complete than usual. The time reported by the REPL can be misleading. There is work that we definitely need to do on performance as we develop PartiQL. Performance is something we have been considering since inception and we will keep considering as we go forward.
monsieurbanana 7y ago
> Latency matters to everyone, always. I used to do a lot of BigQuery for analytics. Latency in BigQuery is crap and clearly not it's selling point, we're not talking ms here, we're talking seconds at a minimum. Yet it's a really nice database for it's use cases.
- vgt 7y ago
  We've improved our floor latency by a factor of 5 since two years ago, we've introduced clustering, and newly introduced BI engine gets you into dozen digit millisecond range, so give it a try again :) (Product manager on BigQuery)
justicezyx 7y ago
I mean modern infrastructure's user experience is very poor compared to decades ago's PC based software...