5 ms·
Search Goes Real-Time With Scoopler (YC S08)
- pclark 18y agoCool. But until there are a lot of real time services their value is very limited.
- dilanj 18y agoGoing by the current trend, there will only be more real time services in the future. It pays to be early in the game :)
- deleted 18y ago[deleted]
- axod 18y agoYeah. Soon I can imagine a time when we could talk to each other online in real time. Like twitter but without a delay. But maybe that's a couple of years off.
- pclark 18y agohave you seen mibbit.com?
- sachinag 18y agoOr some sort of instantaneous messaging or how about a telephonic device that transmits voice over copper lines (or even wirelessly) or perhaps meeting someone for a malted beverage at a public house of some sort.
- axod 18y ago>> "how about a telephonic device that transmits voice over copper lines" In real time? You're crazy.
- jimbokun 18y agoThis is a fun game to play, actually, any time a new technology is introduced. Imagine the new technology was invented first, and the old technology is actually the new challenger. What are the advantages and benefits of the old technology you can promote over the new one?
- jsrn 18y agothis is a tradition in the Emacs community: for each release, they publish "antinews", e.g.: > For those users who live backwards in time, > here is information about downgrading to > Emacs version 21.4. We hope you will enjoy > the greater simplicity that results from the > absence of many Emacs 22.1 features. > [...] http://www.gnu.org/software/emacs/manual/html_node/emacs/Antinews.html http://www.gnu.org/software/emacs/manual/html_node/emacs/Ant...
- paul9290 18y agoDoes mibbit or chatterous or an Instant message client allow for search of conversations? If not I think all chat clients should make an API to search data, especially links shared in email & chat clients!
- arasakik 18y agoMembers of Chatterous groups can search through chat history.
- ikayak 18y agoGood execution on the trending and the real power here is the deep search on live content. Anybody who does search right has value.
- ajasver 18y agoThanks! We're working on adding more data sources to provide broader results.
- okeumeni 18y agoI have one question, are they consuming other companies search API, let’s say Twitter or are they crawling and aggregate their own data? Either way it’s a great job!
- ajasver 18y agoWe actually crawl and index all the data ourselves. That's how we identify the most popular content.
- okeumeni 18y agoNice Work!
- hachiya 18y agoIs this truly crawling the sites, or querying each site's search service? e.g. for Twitter, are you crawling all the Twitter users' URLs (seems difficult to do - how do you find new accounts' URLs?), or are you fetching results from search.twitter.com ?
- zaidf 18y agoI don't think crawling and querying are mutually exclusive ideas.
- dannyr 18y agoYeah. I'm curious if they developed something similar to Twitter's search functionality or they are using Twitter's Trends feed. In its current form, most of the results are from Twitter which doesn't really differentiate it much from Twitter Search.
- ajasver 18y agoWe take the raw data streams (e.g. a data mining feed from Twitter) and process them, ourselves.
- vaksel 18y agoisn't Google pretty close to real time anyways? I know I tend to find things on Google that I just posted 5-6 minutes ago.
- ajasver 18y agoYes Google is pretty fast for newly published static content. However, it's difficult to use for events happening right now. From the feedback we've got, people like real-time results because its engaging and effortless, a little like watching TV.
- BenS 18y agoThis is really cool - congrats. I'd really like to see google-trend-like features but on much shorter time scales. Even a weekly-zeitgeist tied to news stories instead of having to wait for the end of year.
- anuraggoel 18y agoWhat is Scoopler built with?
- ajasver 18y agoScoopler is written in Python. We use Cloudant (YC s08) for storing our data. I'm planning to write a blog post about this on soon on our Posterous.
- kyro 18y agoCool. I'll take a note of that using Snipd, upload it to Scribd, then post it to Reddit, then tell my friends to upvote me using Heysan or maybe Chatterous. It depends on whether I'll have enough time, since I'm always playing on DraftMix. Anyway, good luck with Scoopler. :P
- datums 18y agoNice start. I was expecting more from the twitter feed. It's an rss feed from a query. Maybe a better way is to group similar real-time results ? v2
- edawerd 18y agoawesome job dude! It would be awesome to have some sort of real-time alert feature, too!
- ajasver 18y agoIt's in the pipeline! Thanks.
- hamai 18y ago"One element that’s really nice, is the Peek feature, which allows you to take a look at pages being linked to in an overlay on top of the results, so you don’t have to visit the actual page." Real-Time news for the writer: you actually visit the page. It's an iframe... In the old days, there was something called target attribute. Neat when the target is not iframe friendly.
- snprbob86 18y agoThis feature is really curious to me... why would I want to peek when I have a back button on my mouse?
- deleted 18y ago[deleted]
- deleted 18y ago[deleted]