3 ms·
I have not fully digested yet, but seems very similar to Scala Parallel Collections and Java8 Streams. There are databases which implements such interfaces.
by jankotek 9y ago
I have not fully digested yet, but seems very similar to Scala Parallel Collections and Java8 Streams. There are databases which implements such interfaces.
- willtim 9y agoIt isn't the slightest bit similar to those! Haxl is a high-level library for specifying (and optimising) concurrent data retrieval.
- jack9 9y agoI'm not sure that's an apt description either. Haxl's features include auto batching of IO through parallelism and a temporal cache...for error logging when failures occur. It's spelled out in the first minute he talks about it. In the IO batching code (the boilerplate) you specify how and what to output in your logging. Haxl can be used without performing optimization (write an inefficient batcher) or doing data retrieval (the I/O is fire and forget and never cache anything). Maybe I am misunderstanding the basic usage.
- willtim 9y agoIt's not easy summarising it in one sentence, but 'auto batching' and 'caching' is what I meant by optimising the data retrieval. EDIT: the Haxl docs describe it as "a library and EDSL for efficient scheduling of concurrent data accesses with a concise applicative API"
- solidsnack9000 9y agoWhich databases are those and what are the relevant features? Are you talking about FILESTREAM? https://technet.microsoft.com/en-us/library/bb933993(v=sql.105).aspx https://technet.microsoft.com/en-us/library/bb933993(v=sql.1...
- jankotek 9y agoHazelcast Jet, Spark, my project... they work similar way. But as I wrote, I need to read the presentation first.
- solidsnack9000 9y agoJet and Spark are not what most people would call databases, since they have such a heavy stream processing focus and are rarely stores of record.