markpapadakis

15 ms·

91.
by markpapadakis 10y ago
FWIW we will likely open source our search engine/IR technology sometime next month (hold up is the documentation and cleaning up some parts of the codebase). It's written in C++, and the core features are performance, simplicity(
92.
WikiLeaks Releases Trove of Alleged C.I.A. Hacking Documents(nytimes.com)
3 points by markpapadakis 10y ago|0 comments
93.
by markpapadakis 10y ago
My theory (everyone has one) is that Tim Cook is excellent at delegating and orchestrating operations, but he lacks the combination of qualities, charisma and personality of Jobs that pushed(forced?) people to go above and beyond and surpas
94.
by markpapadakis 10y ago
I don't really get DDG. I guess it's nice that they pattern-match some queries and give you a a query specific UI on top of the results or maybe some results UI that makes a lot of sense for the query -- though Google and Bing do
95.
by markpapadakis 10y ago
That's a good question, and the answer has to do with, obviously, the cost of spawning OS threads/processes, context-switching among them, and how all that affects caches (cache hit/miss ratio dominates most workloads nowaday
96.
by markpapadakis 10y ago
This is a C++ coroutines framework( https://github.com/markpapadakis/coros-fibers ), but its trivial to “port” it to C. I ‘ve also written a few things about coroutines and fibers(e.g https://medium.com&#x2F
97.
by markpapadakis 10y ago
Thank you - yes, I was planning to base the implementation on etcd's. I appreciate the heads up:)
98.
by markpapadakis 10y ago
The consumers applications (which interface with Tank brokers via a Tank client library) are responsible for maintaining the sequence number they are consuming from. Suppose one such application is consuming every new event that's publ
99.
by markpapadakis 10y ago
The Tank Client will immediately publish to Tank (it doesn't buffer requests). You get at least once semantics /w Tank(exactly once pretty much means at least once but with dupes-detection).
100.
by markpapadakis 10y ago
Some benchmarks added https://github.com/phaistos-networks/TANK/blob/master/README... . Will add consumer benchmarks later (our ops folks are on it). Apologies for not backing the "high performance&q
101.
by markpapadakis 10y ago
Yes, single threaded, because the contention to the various files and the cost of serialisation would likely negate the benefits of using multiple threads. Network I/O is obviously asynchronous - you may want to check the codebase. Dis
102.
by markpapadakis 10y ago
I think I, or someone else maybe?, needs to run some benchmarks and produce some meaningful comparison metrics -- as pointed out by commenters here, and elsewhere. I suppose I should have done that already. Apologies for the lack of concret
103.
by markpapadakis 10y ago
Please see earlier comment. Specifically re: sys calls and concurrency you may want to start from this issue https://github.com/phaistos-networks/TANK/issues/14
104.
by markpapadakis 10y ago
It is a service, and a library(C++). You can always check the implementation, but obviously that's the wrong answer to that question :) The README states that replication is not implemented yet. I encourage you to also check this issue
105.
by markpapadakis 10y ago
I am the core developer. It's not abandoned at all. There are updates that haven't been pushed upstream, but no new features. Was going to support replication via an external consensus service (etc, consul, etc) -- but looks like
106.
Google services, logins, harvesting data and machine intelligence(medium.com)
2 points by markpapadakis 10y ago|0 comments
107.
by markpapadakis 10y ago
John Carmack's said "Focus is a matter of deciding what not to do". I think that quote describes a fairly efficient heuristic for keeping your mind focused.
108.
DHTs rings transitions plans with Consistent Hashing(github.com)
2 points by markpapadakis 10y ago|0 comments
109.
by markpapadakis 10y ago
We build our own. All events are published on Tank( https://github.com/phaistos-networks/TANK ) , and we have a bunch of consumers that consume from various Tank topics. They process the data and either publish to othe
110.
by markpapadakis 10y ago
Sometimes things just don’t work out. Twitter certainly can’t be blamed for trying all kinds of different ideas, either by putting their own resources to work on them, or just acquiring other companies (Vine, Periscope, and many more - see
111.
by markpapadakis 10y ago
I imagine Yahoo! Mail engineers being royally pissed about this. Well, I suppose that includes all Yahoo! folks who are still putting real effort into improving Y!'s services. Every odd day something surfaces about Y!'s execs ques
112.
by markpapadakis 10y ago
Maybe TANK ( https://github.com/phaistos-networks/TANK ) would have been a good alternative on there. No features parity with Kafka, but setting it up is a matter of running one binary and creating a few topics, and it
113.
by markpapadakis 10y ago
In Greece, elections are always held on Sundays. No provision for submitting votes by any other means other than physically going to election posts(in practice, the government uses schools), entering a tiny makeshift voting booth (which in
114.
by markpapadakis 10y ago
I recommend Robin Hood open addressing scheme. It's particularly trivial to implement, and because it relies on linear probing, so it's memory-cache friendly. See more here: http://www.sebastiansylvan.com/post&#x2F
115.
by markpapadakis 10y ago
It was called Trinity -- it was initially developed for Pathfinder.gr, and soon thereafter was the search provider for in.gr, and was also accessible at trinity.gr for some time.
116.
by markpapadakis 10y ago
In the past we built and operated Greece’s largest search engine(Trinity), and we would crawl/refresh all Greek pages fairly regularly. If memory serves, the frequency was computed for clusters of pages from the same site, and it depen
117.
by markpapadakis 10y ago
I used Instapaper for a long time before I switched to a Pocket. There were issues with their parser they never fixed, has been consistently slow, articles would often be lost even though they were "saved" according to the apps th
118.
by markpapadakis 10y ago
I live in Crete, Greece. Almost all families here own olive trees groves and produce oil - the island, and I guess this is true for most regions of Greece, is full of olive trees. We consume a lot of oil - we use oil in everything, and it’s
119.
by markpapadakis 10y ago
You may also find this interesting: https://github.com/phaistos-networks/TANK/issues/14
120.
by markpapadakis 10y ago
This is a message broker. You can publish messages to it, and it will retain them for as long as you want(it supports retention and compaction semantics), and you can consume the messages, starting from any message(messages are identified b

More ›