3 ms·

1. Grabbing data from any site by just highlighting the content and providing format rules straight to JSON. This could be a plugin for a browser. 2. A develop

1. Grabbing data from any site by just highlighting the content and providing format rules straight to JSON. This could be a plugin for a browser. 2. A developmental IDE that targets interactive run-time development where you see results instantly. Variables would instantly turn into scrollable bars that you can set min and max to modify a running game window. (i'm working on this idea.) 3. A service that teaches me how to program distributed, peer to peer, or machine learning step by step in implementing useable already made tools. Not just blog posts or coursera courses how to teach yourself how to make them. 4. An small box that you can program to respond to text with other small parts to turn lights on and off as well as other small things around the house for automation. But not be over the internet. A simple home automation by wifi sounds safer to me. 5. A plugin for the browser that track's movements and clicks of a mouse, for later automating a specific session. Useful for automation and faking users for social sites. This would probably have to be open source since privacy is a concern with plugins that provide that much level of tracking. 6. A finance screen that pulls off data in a more use-able way that isn't just simple stock figures but gives insight into market trends. This is a general idea, but the data needs to be useful enough. Thinknum, quantopian, and quandl.com are all decent ideas that are like "half-there."

krapp 13y ago
>Grabbing data from any site by just highlighting the content and providing format rules straight to JSON. This could be a plugin for a browser Would you pay for a service that collected sets of tags from a site and returned it as JSON? Like all the links or images or script tags?
- switch33 13y ago
  I think a browser plugin would be the best idea. Basically you highlight something a button appears. You click that button and name the type of data. It build's a script to capture that in JSON so you can do webscraping without even needing to write any code. Then it has options to create rules for other pages similar to it as well so you can just provide a url or two and it'd update the script.
  - deleted 13y ago
    [deleted]
- AznHisoka 13y ago
  YES.. but only if that services includes the actual crawling. otherwise, it's trivial to implement.
  - switch33 13y ago
    Do you want to work on it with me? I have an idea to make it work probably more accurate than the kimono bullshit. Add me on skype: Switch336 .
  - krapp 13y ago
    I'm working on another project that more or less does that to create feeds from metadata but it might be worth tweaking.
blooberr 13y ago
What's missing in #6? Could you clarify on "half-there"?
- switch33 13y ago
  Sure, Quantopian is nice. But it's only stock data in some cases. It is up-to-date. It serves well for back-testing and for managing a portfolio in a certain way using newer ideas, but real-time investing information is limited. Quandl is nice, but it is only "shared data" that people are willing to submit so it is not up-to-date. It does have the best API of the group because you can pull data from it with very few lines of code, or simply download a .csv. Thinknum is nice, they do discounted cash flow computing which is useful for investing. But theres not much there besides the balance sheets. It is a large amount of data, but it's not curated in a very digestable format. If you look at finviz you can see what I mean about more digestable information. It has green or red marks where it lists information indicating if things are good or bad that is a bit more digestable. Mutual fund inflows are what really do a lot of the work for the market, but many financial sites do not cover this data. And momentum investing seems to be very big, but it's not covered that much.
localuser 13y ago
For 1, check out kimono. It was on show hn a while a go. https://news.ycombinator.com/item?id=7066479 https://news.ycombinator.com/item?id=7066479
- switch33 13y ago
  This looks close. I wonder how good it really is functioning though. I'll take a look, but it is a great idea. edit: Ok, I dunno how well this really works, but it sounds/looks rather brokenish. Actually, I think this could have been easily made not nearly so pricey though. An API is expensive for this task, it's such a general task it should be a 1 time fee. edit2: Actually this is pretty neat, but dang that price is annoying. I think anyone re-coding this idea as a plugin without a API cost and instead with a single cost but outputted the code would literally make 3x the amount of money. edit3: Kimono is broken. Just did some tests on random blogs. It is not exactly as good as it suggests. It just chose a few sites that are easy to scrape from for it's display.

krapp 13y ago

>Grabbing data from any site by just highlighting the content and providing format rules straight to JSON. This could be a plugin for a browser Would you pay for a service that collected sets of tags from a site and returned it as JSON? Like all the links or images or script tags?

switch33 13y ago
I think a browser plugin would be the best idea. Basically you highlight something a button appears. You click that button and name the type of data. It build's a script to capture that in JSON so you can do webscraping without even needing to write any code. Then it has options to create rules for other pages similar to it as well so you can just provide a url or two and it'd update the script.
- deleted 13y ago
  [deleted]
AznHisoka 13y ago
YES.. but only if that services includes the actual crawling. otherwise, it's trivial to implement.
- switch33 13y ago
  Do you want to work on it with me? I have an idea to make it work probably more accurate than the kimono bullshit. Add me on skype: Switch336 .
- krapp 13y ago
  I'm working on another project that more or less does that to create feeds from metadata but it might be worth tweaking.

blooberr 13y ago

What's missing in #6? Could you clarify on "half-there"?

switch33 13y ago
Sure, Quantopian is nice. But it's only stock data in some cases. It is up-to-date. It serves well for back-testing and for managing a portfolio in a certain way using newer ideas, but real-time investing information is limited. Quandl is nice, but it is only "shared data" that people are willing to submit so it is not up-to-date. It does have the best API of the group because you can pull data from it with very few lines of code, or simply download a .csv. Thinknum is nice, they do discounted cash flow computing which is useful for investing. But theres not much there besides the balance sheets. It is a large amount of data, but it's not curated in a very digestable format. If you look at finviz you can see what I mean about more digestable information. It has green or red marks where it lists information indicating if things are good or bad that is a bit more digestable. Mutual fund inflows are what really do a lot of the work for the market, but many financial sites do not cover this data. And momentum investing seems to be very big, but it's not covered that much.

localuser 13y ago

For 1, check out kimono. It was on show hn a while a go. https://news.ycombinator.com/item?id=7066479 https://news.ycombinator.com/item?id=7066479

switch33 13y ago
This looks close. I wonder how good it really is functioning though. I'll take a look, but it is a great idea. edit: Ok, I dunno how well this really works, but it sounds/looks rather brokenish. Actually, I think this could have been easily made not nearly so pricey though. An API is expensive for this task, it's such a general task it should be a 1 time fee. edit2: Actually this is pretty neat, but dang that price is annoying. I think anyone re-coding this idea as a plugin without a API cost and instead with a single cost but outputted the code would literally make 3x the amount of money. edit3: Kimono is broken. Just did some tests on random blogs. It is not exactly as good as it suggests. It just chose a few sites that are easy to scrape from for it's display.