4 ms·
If you're already on AWS, I recommend switching to postgres for now. For context, I have 3 RDS instances, each multi zone, with the biggest instance storing sev
by mfrye0 3y ago
If you're already on AWS, I recommend switching to postgres for now. For context, I have 3 RDS instances, each multi zone, with the biggest instance storing several billion records. My total bill for all 3 last month was $661.
Postgres has full text search, vector search, and jsonb. With jsonb you can store and index json documents like you would in Mongo.
- https://www.postgresql.org/docs/current/textsearch.html https://www.postgresql.org/docs/current/textsearch.html
- https://aws.amazon.com/about-aws/whats-new/2023/05/amazon-rds-postgresql-pgvector-ml-model-integration/ https://aws.amazon.com/about-aws/whats-new/2023/05/amazon-rd...
- LunaSea 3y agoI have troubles seeing how this is possible. $220 dollars per instance gets you 8Gb of RAM which is way, way, below the index size if you are indexing billions of vectors.
- deleted 3y ago[deleted]
- philippemnoel 3y agoYou can even do Elastic-level full text search in Postgres with pg_bm25 (disclaimer: I am one of the makers of pg_bm25). Postgres truly rules, agree on the rec :)
- neeleshs 3y agohow big is the disk for the biggest instance?
- mfrye0 3y agoPretty small still at 500gb. It only stores hot data right now and a subset of what's important. Most of our data is in S3.