stavrospap

9 ms·

31.
by stavrospap 9y ago
TileDB, Inc. | Senior Software Engineer | Cambridge, MA or REMOTE | FULL-TIME or PART-TIME | tiledb.io TileDB, Inc. leads the development of the open source TileDB array management software. The company closed a $1M seed round last May led
32.
by stavrospap 9y ago
TileDB, Inc. | Senior Software Engineer | Cambridge, MA or REMOTE | tiledb.io TileDB, Inc. leads the development of the open source TileDB array management software. The company closed a $1M seed round last May led by Intel Capital and Nex
33.
by stavrospap 9y ago
Stavros from TileDB, Inc. here: HDF5 is a great software and TileDB was heavily inspired by it. HDF5 probably works great for your use case. TileDB matches the HDF5 performance in the dense case, but in addition it addresses some important
34.
by stavrospap 9y ago
Stavros from TileDB, Inc. here: TileDB could be useful for storing your training data (in some storage backend of your choice) as well as your intermediate data (as davedx pointed out). But this would make sense only if your data are truly
35.
by stavrospap 9y ago
Stavros from TileDB, Inc. here: Currently, TileDB is a storage manager, so it offers only efficient slicing. Support for aggregation queries (e.g., similar to what you can do with Pandas) is in our roadmap. We plan to work on it as soon as
36.
by stavrospap 9y ago
In-core algorithms require the entire array(s) in main memory to perform some computation. Out-of-core algorithms are typically block-based and stream the array blocks from persistent storage to main memory on demand, working on parts of th
37.
by stavrospap 9y ago
The way the code is currently architected allows us to add support for pretty much any compressor (compatible with our MIT license) with minimal effort. So, please do send us suggestions about your preferred compressor and we will add it pr
38.
by stavrospap 9y ago
Stavros from TileDB, Inc. here: We have elevated the Python/NumPy bindings as our top priority and have already started development. We will try to ship them asap. :)
39.
by stavrospap 9y ago
Stavros from TileDB, Inc. here: This comment gives us the opportunity to explain a bit the history of the company and our thesis. TileDB was my research project while I was working as a full-time researcher at Intel Labs and was stationed a
40.
by stavrospap 9y ago
Stavros form TileDB, Inc. here: Another area of great interest to us is point cloud data, which are essentially 3D points in a super sparse space. In fact, any application dealing with spatio-temporal data (which are 2D/3D/4D data
41.
by stavrospap 9y ago
Stavros from TileDB, Inc. here: Arrow employs a columnar format to store objects like data frames. TileDB is also columnar (so you can sub-select attributes and perform analytics with very similar optimizations to Arrow), but the first-clas