Y
HN Search
Hacker News Search
new
|
comments
|
top
|
jobs
acehyzer
searching PlanetScale…
1.
▲
2.
▲
3.
▲
4.
▲
5.
▲
6.
▲
4 ms
·
1.
▲
by
acehyzer
9y ago
Coincidentally, it is also a short name for the home assistant software in English.
2.
▲
by
acehyzer
10y ago
Does not support net neutrality. Game over for me.
3.
▲
by
acehyzer
11y ago
It happens pretty much real time. While using cURL or the .NET client it doesn't return a response until the indexing is finished. You can verify this by querying your index for some basic info. For example you could even just put the
4.
▲
by
acehyzer
11y ago
The bulk index API is very fast, I initially tried converting all the records into 7 separate JSON files with ~400k records each and passed them to elastic using cURL and the bulk api. Once the file finished uploading to the server where E
5.
▲
by
acehyzer
11y ago
Yeah I don't disagree with you there. I tested the memory consumption on one chunk before I went whole hog and did the whole data set. You certainly don't need to do 50k at a time, but it might be worth pulling at least 1k at a ti
6.
▲
by
acehyzer
11y ago
It took me about 20 minutes to index 2.7M records. It was pulling from 3 tables using joins, and using the .Net NEST client.
7.
▲
by
acehyzer
11y ago
Elasticsearch is awesome. It may be a good idea to use the bulk API that is built into elasticsearch, use some joins in your SQL query, and index more than just one record at a time. In the implementation I have, I batched my query to 50,0
8.
▲
by
acehyzer
11y ago
If I put this into my company's tests, we'd end up with no users... I have a lot of work ahead of me. :/