4 ms·
Precog is being open-sourced
- spenczar5 13y agoRelevant: This comes on the heels of their acquisition by RichRelevance last month (http://techcrunch.com/2013/08/14/richrelevance-acquires-precog-to-add-large-scale-analytics-engine-to-e-commerce-personalization-platform/ http://techcrunch.com/2013/08/14/richrelevance-acquires-prec...).
- tlrobinson 13y agoAt this point I would not have been surprised if "PRECOG" was a codename for another NSA program. Fortunately this looks much more benign and pretty cool.
- pekk 13y agoIt would be really easy to write a bot to make a snarky political reference regarding the NSA on every new article regardless of its content.
- deleted 13y ago[deleted]
- phdtree 13y agoWhat is Precog? Why this is being upvoted? Anyone care to explain a bit?
- pufuwozu 13y agoI worked on Precog. Here's my explanation: It's an analytics platform for big data. Basically, you upload lots of JSON, use the custom language (http://quirrel-lang.org/ http://quirrel-lang.org/) for analytical queries and the platform will handle efficient storage and querying of your data. There are also has extras like a library for charting and reporting query responses using JavaScript and an IDE for writing Quirrel and uploading data.
- joeblau 13y agoHow is this different/better than using something like Elastic Search? Does it handle real time upload/searching or do you have to bulk upload, process the data and then run your searches?
- pufuwozu 13y agoNo processing necessary. Just upload JSON. The Quirrel language is much more high level than the API for ElasticSearch. It comes with things like machine learning (e.g. clustering and linear regression): http://precog.com/developers/how-tos/machine-learning/ http://precog.com/developers/how-tos/machine-learning/ Even without libraries like machine learning, you can write somewhat readable queries which do some impressive things: http://precog.com/developers/how-tos/common-analytics/ http://precog.com/developers/how-tos/common-analytics/
- joeblau 13y agoGreat, now I'm gonna be up for another three hours! Thanks for your feedback.
- alexatkeplar 13y agoThanks for the explanation. What do you actually upload the JSON into - is it a proprietary NoSQL technology, something built on top of Akka, a wrapper around HDFS or something else?
- JulianMorrison 13y agoHow does this compare to rethinkdb (sharding, map-reduce, indexes, queries and joins on JSON data)?
- ddorian43 13y agocolumnar storage, compression etc
- 13y ago
- rurban 13y agoBut I cannot find his previous open-sourced tool anymore, UNA.