paulasmuth

10 ms·

31.
by paulasmuth 10y ago
If you care about not having your data locked-in to Google's ecosystem or think BigQuery is too expensive, please consider to give the open-source EventQL [0] alternative a try. [0] https://eventql.io
32.
by paulasmuth 10y ago
Excellent idea! Are there any benchmarks of how the changed sysctl values affect performance?
33.
by paulasmuth 10y ago
That's not a fair comparison though. I only quickly read the postgres benchmark you linked, but it looks like you stored the data on disk (!) on a machine with only 16GB of ram for the postgres benchmark, while storing the data complet
34.
by paulasmuth 10y ago
256GB is 256 billion bytes. So you can only fit over a hundred billion rows into 256GB if you have zero overhead and every row is smaller than roughly two bytes... ;) [so you couldn't even store a single proper integer in each row in
35.
by paulasmuth 10y ago
To me the problem seems more that on a GPU you can only execute fast queries on fairly small datasets. I would assume that the space of problems that still fit into a few gigs of GPU RAM but need to be answered rapidly with a lot of paralle
36.
by paulasmuth 10y ago
Also check out this blog about internals of massively parallel databases such as MapD (it talks about _why_ they are so fast) [0] [0] https://news.ycombinator.com/item?id=12291767
37.
Parallel I/O and Columnar Storage(eventql.io)
2 points by paulasmuth 10y ago|0 comments
38.
by paulasmuth 10y ago
>> What we figured was the biggest problem with any form of machine learning or data based system is that we require high quality historic data. When a company starts the heavy dependance on free/freemium analytics services it me
39.
by paulasmuth 10y ago
We do have a csv import util (the API expects JSON) but it's not in the current distribution/release build. I'll add it and update this comment once it's live. Queries are mostly limited by IO if running on regular hard
40.
by paulasmuth 10y ago
Yes, it is similar to BigQuery with a couple of differences as you pointed out. The big ones being that it's fully open source and self-hostable. It's less similar to Apache Drill - Drill is "only" a query engine and doe
41.
Show HN: EventQL – Open-source distributed SQL analytics database in C++11(github.com)
90 points by paulasmuth 10y ago|18 comments
42.
by paulasmuth 10y ago
Interesting that they chose AGPL as the license for their modules (as opposed to BSD for core redis). It's good to see such an important project adopt a viral copyleft license. Hope this will help the redis developers to monetize on th
43.
by paulasmuth 10y ago
>> The rise of microservices, an approach to development in which you structure your software into smaller individual service-oriented units. Each microservice then runs its own process and they communicate with each other through API
44.
by paulasmuth 10y ago
>> You might be interested to know your example doesn't escape that correctly. It does -- You're right that the double-quote escaping is part of the original SQL standard, while the c-style escaping is an extension to it. Ho
45.
by paulasmuth 10y ago
>> How are you turning the user supplied string into the SQL string literal string? Is your method for doing so guaranteed to always produce a valid SQL string literal which represents the supplied string? Yes. This is trivial. Any se
46.
by paulasmuth 10y ago
No, you don't need to unescape it when displaying it. This SQL literal string: 'Gijs in \'t Veld' Is a representation for these ASCII bytes/content: Gijs in 't Veld In other words. The backs
47.
by paulasmuth 10y ago
I can't tell if you're trolling or not, but this is not how string escaping works in SQL or any other programming language that I know. >> SELECT 'here is an apostrophe: \''; >> returns: here i
48.
by paulasmuth 10y ago
This is false. Of course you can use any special characters in a literal string without using prepared statements. You just have to escape them correctly. Example: INSERT INTO USERS (name) VALUES ('Gijs in \'t Veld');
49.
by paulasmuth 10y ago
The nested repository feature sounds amazing. Dealing with both git submodules and git subtrees has been a huge pain for me. I'm looking forward to trying this out over the weekend. Is there some kind of util/script to import hist
50.
by paulasmuth 11y ago
Revenue != Income. Gross profit (before paying any taxes) will probably be a fairly small percentage of turnover in manufacturing - you have to pay employees, purchase supplies, etc... EDIT: just looked it up and most of "industry week
51.
by paulasmuth 11y ago
Yes, the current 'maybe' implementation should practically break almost any properly written IO code. At this point, it will only work for the most trivial of demo cases. Still IMO it's a cool demonstration of the linux ptrac
52.
by paulasmuth 11y ago
While this looks like a nice idea on paper, I would not recommend to use the current implementation of 'maybe' on a system that hosts valuable data. The tool seems to work by intercepting individual "blacklisted" system
53.
by paulasmuth 11y ago
I'm not sure I understand what exactly happened here. Was it previously possible for non-apple engineers to replace the home button or was it not? The guardian's article seems to suggest it was: "Indeed, the phone may have be
54.
by paulasmuth 11y ago
Is there a specific reason for using typedefs rather than (packed) structs? With typedefs you get no real type safety (you can pass a widget_counter_t to a method that expects a foo_t if both typedef to the same thing), do you?
55.
by paulasmuth 11y ago
Agreed on all points. Still the "airports can be hacked using this ninja barcode trick" spin that they put on the story pushes my buttons. -- The "trick" is absolutely trivial and they haven't even bothered to try a
56.
by paulasmuth 11y ago
I could only speculate how specific applications (e.g. at airports) are built. However, if some specific vendor was susceptible to this attack, it would just be a stupid, obvious and easily fixable input handling bug in their product. But t
57.
by paulasmuth 11y ago
Am is missing something or is the presented "attack" really trivial? They use a barcode scanner connected as a virtual keyboard to directly enter keystrokes into the windows shell - I imagine the barcode simply reads "CTRL, T
58.
by paulasmuth 11y ago
A similar thing has happened in the past: >> "Gracia was selected to represented [sic] Germany in the Eurovision Song Contest with the song "Run & Hide", produced and composed by David Brandes. After the German nati
59.
by paulasmuth 11y ago
ZBase | Berlin/Amsterdam | full time, freelance, remote About us: We develop a database/analytics product. Company founded in 2015 by german serial entrepeneurs and ex-Google engineers. We have launched our product in spring and i
60.
by paulasmuth 11y ago
>> the advantage of the approach taken in this project (essentially, sending an >> abstract syntax tree encoded in capnproto) over just sending a string, is that >> there is no parsing-step needed at the rec

More ›