buremba

38 ms·

421.
by buremba 10y ago
You may try https://rakam.io Shameless plug: I'm the maintainer.
422.
by buremba 10y ago
so what happened to hyperdex? it looks like the project is no longer maintained. could you please share why the project is dead?
423.
by buremba 10y ago
We tried Avro, Thrift and Protobuf and Avro was our choice. The schema of collections in Rakam is dynamic and with both Thrift and Protobuf schema evolution is not that easy at runtime. Avro is easier to use in Java and doesn't enforce
424.
by buremba 10y ago
We're also using S3 but we have a hybrid approach to the problem. The event data is immutable and you use instance stores with EC2 and cache the data to local SSDs and use S3 as backups. The thoughtput of HDFS is better than S3 or EFS
425.
by buremba 10y ago
We actually have pretty similar architecture and use Presto for ad-hoc analysis, Avro is used for hot data and ORC is used as columnar storage at https://rakam.io . Similar to Slack, we have append-only schema (stored on Mysql in
426.
by buremba 10y ago
Parquet is a columnar storage type whereas Avro is row-oriented serialization framework. If you have lots of columns and want to perform ad-hoc analysis, Parquet will be better than Avro due to the mechanics of the columnar storage types.
427.
SQL is still superior for big-data analytics(blog.rakam.io)
15 points by buremba 10y ago|0 comments
428.
by buremba 10y ago
I hope that Amazon contributes back to the Presto community.
429.
by buremba 10y ago
Materialized view is already supported by Postgresql but it requires full table re-write: https://www.postgresql.org/docs/9.3/static/sql-createmateria... We're also experimenting incremental materialized
430.
by buremba 10y ago
Yes, the tag names are even similar but the performance and simplicity is even better than ng2.
431.
by buremba 10y ago
wow, it ates all the free memory available in the system regardless how much it is.
432.
by buremba 10y ago
This thing makes me believe that we should not use any OSS project which released by a big companies such as Google and Microsoft. Even if they don't say that they're dropping support, when they start to work on another project, i
433.
by buremba 10y ago
I think cstore_fdw is not popular enough among Citus users. Only a few of their customers use it since it's not trivial to use cstore_fdw in real-time workloads. Given than its use-case is mainly analytics, it seems a bit odd though.
434.
by buremba 10y ago
Having spent some time with Protractor and strong believer of the importance of writing tests, I think that writing end-to-end tests for a complex web application is quite hard and you will often end up spending more time for testing compar
435.
by buremba 10y ago
I totally agree that Python is much less problem compared to Javascript but I think that it's not fair to compare a backend language to a frontend language. My only complain is that Python is not great at async operations so people hav
436.
by buremba 10y ago
"-Ever heard of Python 3?" (go to top)
437.
by buremba 10y ago
Done! https://rakam.io/integrate?part=website
438.
by buremba 10y ago
It's really neat. Very much needed for our analytics platform Rakam and I already started implementing it.
439.
by buremba 10y ago
In fact, JSONB is probably not a good idea when it comes to analytics. The storage is almost x2, accessing attributes are expensive than tabular data even though JSONB is indexed, the data can be dirty (the client can send extra attributes
440.
by buremba 10y ago
imagine a serverless distributed database. fault tolerant, scalable and cheap, that would be great.
441.
by buremba 10y ago
nice ending scene with pomme de terre.
442.
Amazon Kinesis Analytics – Process Streaming Data in Real Time with SQL(aws.amazon.com)
2 points by buremba 10y ago|0 comments
443.
by buremba 10y ago
It looks good but I don't think that it's powerful than Zapier. Creating a workflow is harder than Zapier and integrations are not enough. I wanted to create a workflow that fetches data from an external RESTful API, parses the re
444.
by buremba 10y ago
The people behind this coup is also islamists and most of the people in Turkey support Erdoğan so I doubt it. A civil war is quite possible in that scenario.
445.
by buremba 10y ago
How can we import CSV dataset? HTTP API for insert returns this error message: expected JSON_OBJECT_BEGIN, got: JSON_OBJECT_BEGIN. The GROUP BY query in homepage scans 1.8B rows and only takes 1.5 seconds which is great but how many nodes u
446.
by buremba 10y ago
If I understand correctly, you can prevent Google to track your activity in this page: https://myaccount.google.com/activitycontrols
447.
by buremba 10y ago
IMHO that's not the proper reaction for this news, everybody already knows Google collects data about you.
448.
by buremba 10y ago
AFAIK, there is no synchronous way to do it and if I do it asynchronously, partial data loss is possible.
449.
by buremba 10y ago
We're implementing Clickhouse ( http://clickhouse.yandex ) to our open-source analytics platform Rakam. ( https://github.com/rakam-io/rakam )
450.
by buremba 10y ago
Maybe but unfortunately the database doesn't support "backup store" that we can use directly S3, it just writes the data to specified directory in a filesystem. We should either fork the database or implement "S3 backed&

More ›