unsettledtck

8 ms·

31.
Scrapy Tips from the Pros – Debugging Web Crawlers(blog.scrapinghub.com)
2 points by unsettledtck 10y ago|0 comments
32.
Extracting data from websites using Scrapy(medium.com)
3 points by unsettledtck 10y ago|0 comments
33.
Scrapy and MonkeyLearn: Textual Analysis of Web Data(blog.scrapinghub.com)
7 points by unsettledtck 10y ago|0 comments
34.
Machine Learning Predicts Death of GOT Characters(got.show)
2 points by unsettledtck 10y ago|0 comments
35.
Scrapy Tips from the Pros: April 2016 Edition(blog.scrapinghub.com)
11 points by unsettledtck 10y ago|2 comments
36.
Inky the Octopus's Great Escape(npr.org)
2 points by unsettledtck 10y ago|0 comments
37.
The Art and Science of Storytelling Through Data at Jawbone(insightdatascience.com)
2 points by unsettledtck 11y ago|0 comments
38.
Mapping Corruption in the Panama Papers with Open Data(blog.scrapinghub.com)
7 points by unsettledtck 11y ago|0 comments
39.
Open data and the API economy: when it makes sense to give away data(zdnet.com)
3 points by unsettledtck 11y ago|0 comments
40.
by unsettledtck 11y ago
Out of curiosity, where are the boundaries of your gray area when it comes to scraping?
41.
Scrapy Tips from the Pros: March 2016 Edition(blog.scrapinghub.com)
9 points by unsettledtck 11y ago|0 comments
42.
Brisbane welcomes world renowned physicist by naming spider after him(brisbanetimes.com.au)
1 points by unsettledtck 11y ago|0 comments
43.
by unsettledtck 11y ago
Thank you. Glad you enjoy Scrapy, we're pretty fond of it ourselves!
44.
by unsettledtck 11y ago
I just ran across https://www.opensecrets.org/ and found it quite useful and comprehensive in tracking contributions to candidates. I live in the US and am privileged with the level of transparency that exists, but it'
45.
by unsettledtck 11y ago
Not sure if you're interested, but we (Scrapinghub) do offer a Kimono to Portia migration https://blog.scrapinghub.com/2016/02/25/migrate-your-kimono-... Otherwise, I'd recommend you check out Porti
46.
by unsettledtck 11y ago
So for Scrapy and Portia, they are both free as in beer, specifically because we believe in the power of open source. Scrapy actually precedes Scrapinghub and was certainly not developed as a marketing tool. Charges come with large scale cr
47.
by unsettledtck 11y ago
Full disclosure, I work for Scrapinghub. Our tools are Scrapy and Portia, both open source and both free as in beer. Scrapy is for those who want fine-tuned manual control and who have a background in Python. Portia is the visual web scrape
48.
by unsettledtck 11y ago
Full disclosure, I work for Scrapinghub and the web UI you speak of is Portia - our open source visual web scraper. It's for those who range from non-technical to technical but want a quick way to scrape data. I think it's extreme
49.
Migrate Your Kimono Projects to Portia(blog.scrapinghub.com)
3 points by unsettledtck 11y ago|0 comments
50.
Scrapy Tips from the Pros: February 2016 Edition(blog.scrapinghub.com)
49 points by unsettledtck 11y ago|3 comments
51.
by unsettledtck 11y ago
By overcharging, I mean that we compared prices to a baseline day in January (the 13th, to be exact) and then showed those prices against what was on offer from other retailers. Consumers do have access to this information and their buying
52.
by unsettledtck 11y ago
There is a distinction made by those sold and fulfilled by Amazon.com vs sellers on Amazon. Both have inflated prices.
53.
by unsettledtck 11y ago
Part of their shadiness is also elevating prices on days that are dedicated to being major "sales" so as to jump on that bandwagon.
54.
by unsettledtck 11y ago
haha, I would say touche except for the fact that we never advertised a sale and then elevated our prices.
55.
by unsettledtck 11y ago
I think the unethical aspect of arbitrary pricing that goes beyond daily fluctuations really came out in this project. I actually was not aware of the situation with JC Penny, but really fascinating glimpse into their consumer mindset. Prob
56.
by unsettledtck 11y ago
Very much agreed. And this was very much the case on specific days. Prices do fluctuate, but there were definitely products that were continuously inflated over the course of multiple days.
57.
by unsettledtck 11y ago
The fascinating thing about this study is that in certain cases, prices went beyond traditional fluctuations to the point of being inflated for multiple days in a row irrespective of time of day and demand.
58.
by unsettledtck 11y ago
Thanks for the support! I agree especially that it's not just random price fluctuation, specifically with the Apple TV example listed in the article. Target dropped the price and then systematically kept it at an inflated rate before d
59.
by unsettledtck 11y ago
I stick by the title. No, it's not a crime, but there's definitely a disingenuous aspect to overcharging for a product.
60.
by unsettledtck 11y ago
I like your extremely accurate title pitch. And no, we're not entitled to low or consistent prices, but the fact that there is inflation on "sale" days is noteworthy because of the air of false advertising. You're absolu

More ›