4 ms·

I needed it to be possible to run the graph in the browser and cloudflare workers, so TS was a natural fit here. It was built as an experiment into end to end t

by phpnode 6mo ago

I needed it to be possible to run the graph in the browser and cloudflare workers, so TS was a natural fit here. It was built as an experiment into end to end type safety - nothing to do with LLMs, but it ended up being useful in the product I'm building. It's not designed for large data sets.

2ndorderthought 6mo ago
Makes sense thanks for explaining the use case. The LLM question was only because of the comments at the time of the post. The query syntax looks nice by the way.
- phpnode 6mo ago
  thanks, it was as close to Gremlin[0] as I could get without losing type safety (Gremlin is untyped) [0] https://tinkerpop.apache.org/ https://tinkerpop.apache.org/
rglullis 6mo ago
> It's not designed for large data sets. How large is large, here? Tens of thousands of triples? Hundreds? Millions? I'm working on a local-first browser extension for ActivityPub, and currently I am parsing the JSON-LD and storing the triples in specialized tables on pglite to be able to make fast queries on that data. It would be amazing to ditch the whole thing and just deal with triples based on the expanded JSON-LD, but I wonder how the performance would be. While using the browser extension for a week, the store accumulated ~90k thousand JSON-lD documents, which would probably mean 5 times as many triples. Storage wise is okay (~300MB), but I think that a graph database would only be useful to manage "hot data", not a whole archive of user activity.
- phpnode 6mo ago
  it depends on the backing store (which is pluggable). I would not want to exceed let's say 50Mb in a Y.js doc, but i've tested the in memory storage with graphs approaching 1Gb and it's been fine - like any graph it really depends on how you query it. Most of the docs I'm dealing with in production are less than 10Mb, so this is fine for my use cases, but... buyer beware!
ForHackernews 6mo ago
You can use webassembly in both places https://developers.cloudflare.com/workers/runtime-apis/webassembly/ https://developers.cloudflare.com/workers/runtime-apis/webas...
rapnie 6mo ago
Gleam might be a great choice perhaps. Compiles to typescript and Erlang/BEAM.

by phpnode 6mo ago

2ndorderthought 6mo ago

Makes sense thanks for explaining the use case. The LLM question was only because of the comments at the time of the post. The query syntax looks nice by the way.

phpnode 6mo ago
thanks, it was as close to Gremlin[0] as I could get without losing type safety (Gremlin is untyped) [0] https://tinkerpop.apache.org/ https://tinkerpop.apache.org/

rglullis 6mo ago

> It's not designed for large data sets. How large is large, here? Tens of thousands of triples? Hundreds? Millions? I'm working on a local-first browser extension for ActivityPub, and currently I am parsing the JSON-LD and storing the triples in specialized tables on pglite to be able to make fast queries on that data. It would be amazing to ditch the whole thing and just deal with triples based on the expanded JSON-LD, but I wonder how the performance would be. While using the browser extension for a week, the store accumulated ~90k thousand JSON-lD documents, which would probably mean 5 times as many triples. Storage wise is okay (~300MB), but I think that a graph database would only be useful to manage "hot data", not a whole archive of user activity.

phpnode 6mo ago
it depends on the backing store (which is pluggable). I would not want to exceed let's say 50Mb in a Y.js doc, but i've tested the in memory storage with graphs approaching 1Gb and it's been fine - like any graph it really depends on how you query it. Most of the docs I'm dealing with in production are less than 10Mb, so this is fine for my use cases, but... buyer beware!

ForHackernews 6mo ago

You can use webassembly in both places https://developers.cloudflare.com/workers/runtime-apis/webassembly/ https://developers.cloudflare.com/workers/runtime-apis/webas...

rapnie 6mo ago

Gleam might be a great choice perhaps. Compiles to typescript and Erlang/BEAM.