ngalstyan4

6 ms·

1.
by ngalstyan4 10mo ago
Sounds cool! Would be curious to know what the underlying aws ec2 instance is. Is each DB on a dedicated instance? If not, are there per-customer iops bounds?
2.
by ngalstyan4 11mo ago
They would need to handle all the translation changes as well, no? < https://github.com/search?q=repo%3Apostgres%2Fpostgres+%22ma... > I agree code change is simple, but I guess the task is complex for other reasons
3.
Select 1 Touches 5,583 Lines of Postgres Source Code(narekg.me)
3 points by ngalstyan4 11mo ago|6 comments
4.
by ngalstyan4 1y ago
Surprised to not see Ubicloud in there, which provides cloud services on top of various (including European) infra providers. https://www.ubicloud.com/
5.
Debugging Hetzner: Uncovering failures with powerstat, sensors, and dmidecode(ubicloud.com)
345 points by ngalstyan4 2y ago|108 comments
6.
by ngalstyan4 2y ago
This is really cool, congrats on launch! I am curious how you prevent private data from getting leaked to the auto-generated public docs. I imagine this problem does not exist in open source projects, but would become an issue if not everyt
7.
by ngalstyan4 2y ago
Author here. > I don’t think “get moar ram” is a good response to that particular critique. I do not think the blog post suggested "get more ram" as a response, but happy to clarify if you could share more details! > Indexin
8.
by ngalstyan4 2y ago
Author here. We will benchmark this thoroughly in the future for our vector indexes. But at least anecdotally, it made a ton of difference. We met <200ms latency budget with Ubicloud NVMes but had to wait seconds to get an answer from th
9.
by ngalstyan4 2y ago
I have tried CLIP on my personal photo album collection and it worked really well there - I could write detailed scene descriptions of past road trips, and the photos I had in mind would pop up. Probably the model is better for everyday pho
10.
by ngalstyan4 2y ago
We provide this functionality in Lantern cloud via our Lantern Extras extension: < https://github.com/lanterndata/lantern_extras > You can generate CLIP embeddings locally on the DB server via: SELECT abstract,
11.
by ngalstyan4 2y ago
For similar isolation level anomalies in real world applications check out this SIGMOD '17 paper: ACIDRain: Concurrency-Related Attacks on Database-Backed Web Applications: http://www.bailis.org/papers/acidrain-sig
12.
by ngalstyan4 3y ago
Not sure what the approach of this library is, but can't you generate a nonce from a larger alphabet, hash the column values with the nonce `hash(nonce || column)`, and crypto-shred the nonce in the end. Then, during hashing you just n
13.
by ngalstyan4 3y ago
this is cool! Does this only collect logs from frontend? Or it can also collect the backend and DB latency data related to a frontend interaction?
14.
by ngalstyan4 3y ago
My understanding is Trusted Language Extensions refer to extensions written in PL/Rust - a Postgres extension mechanism to write user defined functions and use them in SQL queries. PL/Rust is a more performant and more feature-r
15.
by ngalstyan4 3y ago
cofounder here. You are right that there are many trade-offs between HNSW and IVFFLAT. E.g. IVFFLAT requires there be significant amount of data in the table, before the index is created, and assumes data distribution does not change with a
16.
by ngalstyan4 3y ago
It is strange that there is no mention of Ruben Vardanyan, even when FAST foundation is mentioned. But still cool to read about Armenia's tech sector here.
17.
by ngalstyan4 3y ago
We have not run microbenchmarks to see what dimension ranges perform best but those are coming soon! Below is an anecdotal answer: We run our ci/cd benchmarks on 128dim sift vectors. We have some demos using clip embeddings (512dim) an
18.
by ngalstyan4 3y ago
This sounds like a very useful feature, and we will prioritize this. You’re correct that IVFFLAT would be faster for your use case. However, IVFFLAT’s shortcoming is bad recall, which means less relevant results for your application. We bel
19.
by ngalstyan4 3y ago
>When you say "produced locally", do you mean on the client? Sorry for the confusion. By “produced locally” I meant “produced on your DB server” as opposed to being an API call to a third party service such as OpenAI or Hugging
20.
by ngalstyan4 3y ago
Our index access method will be called lantern_hnsw if pgvector or any other provider has already taken the hnsw access method name. btw, we did not create our own vector type and just use size-enforced real[] arrays to represent embeddings
21.
by ngalstyan4 3y ago
Pgvector builds a vector index. Our extension, similarly, builds an index but also extends SQL in more ways. For example, - Generating embeddings to augment plain relational data - Using data from local proprietary embedding models or third
22.
Show HN: Lantern – a PostgreSQL vector database for building AI applications(docs.lantern.dev)
196 points by ngalstyan4 3y ago|43 comments
23.
by ngalstyan4 4y ago
Is this documented anywhere? Ran docker and one of my endpoints inserts rows to a google sheets via its API...
24.
by ngalstyan4 4y ago
Also, the main reason I did not initially add a lot of info to the story is I do not know what is relevant and what is not because the email I received from them contains even less detail than my post. That is the only thing I really wish c
25.
by ngalstyan4 4y ago
Added details here[1]. For clarity, I'd just add that I was also running my backend on the instance which could have been buggy and compromised (cannot rule that out). Was not mining crypto, hosting porn or doing anything else that I&#
26.
by ngalstyan4 4y ago
This was the first email I received, after my welcome email on July 15. This was a dev instance, maybe I was hacked, cannot rule that out. But was not expecting an outright ban with no details on what has happened.
27.
by ngalstyan4 4y ago
OP Here. I have a single configured email address on which I received my welcome email on July 15 and "Server Locking" email today. Looking into Hetzner dashboard, it seems they did not delete my instance, just turned it off and b
28.
Ask HN: Hetzner banned me with no explanation. What can I do?
73 points by ngalstyan4 4y ago|46 comments
29.
by ngalstyan4 5y ago
My first thought was that some VM virtualization repo got 100k stars on GitHub :))
30.
by ngalstyan4 5y ago
The more general problem with trusting software supply chains is well described in Ken Thompson's Turing award lecture on "Trusting Trust"[1] [1]: http://users.ece.cmu.edu/~ganger/712.fall02/papers&#

More ›