6 ms·
This is my site. I need to re-run a scrape and update the prices. McDonald's blocked my scraper when it went viral the first time
by sach90 3y ago
This is my site. I need to re-run a scrape and update the prices.
McDonald's blocked my scraper when it went viral the first time
- ape4 3y agoAh I was wondering where the info was from. Nice site.
- cylinder714 3y agoDon't you have an identical site with Taco Bell prices?
- sach90 3y agoI do - taconomical.com
- paulkrush 3y ago+1 for https://taconomical.com/ https://taconomical.com/ Texas is really divided.
- spiffytech 3y agoCould I interest you in listing any others you have?
- rthkljlkrj 3y ago[dead]
- foxandmouse 3y agoWould it be possible to include Canada? food inflation has been massive over the last couple years.
- joenot443 3y agoBig +1 to this. A medium fries at Canadian McDonald’s is now $5, it’s madness!
- switch007 3y agoWow. $2.74 CAD in the UK. I feel they’ve shrunk too but ymmv.
- pbhjpbhj 3y agoSeemed to me the same size box, less fries. I was there recently. AFAIK UK pricing is national?
- loudandskittish 3y agoYeah, I used to stop at McDonald's on my way home from a big grocery run and stopped when I saw the fries there cost more than the giant bag of frozen fries I had just bought...
- Tiktaalik 3y agoI got a 10 piece McNuggets meal the other day. Cost $15. Wild stuff.
- nosecreek 3y agoNot for Big Macs, but if you’re interested I’ve been collecting Canadian grocery price data over the past couple of years here: https://grocerytracker.ca/ https://grocerytracker.ca/
- ClimaxGravely 3y agoOh wow! I've been looking for something like this. Thank you.
- btzs 3y agoThis is great! I would love something like this for Hong Kong. The prices here are very volatile due to special offers, etc. Any plans to add other countries?
- nosecreek 3y agoIf I had unlimited time I would love to. Unfortunately I can’t see it expanding beyond Canada anytime soon though.
- ssss11 3y agoHave you had any hassles from supermarket chains?
- nosecreek 3y agoNo, but I’ll admit that is my biggest hesitation in promoting it beyond what I already do. Walmart has the most aggressive blocking (in general, I don’t think specifically directed at my site) and I haven’t been able to get new data from them since October I think. Otherwise haven’t had any issues.
- ThePowerOfFuet 3y agoYou should probably sort the store/city selector dropdown alphabetically.
- 3y ago
- joenot443 3y agoWell done. Any personal findings?
- orenlindsey 3y agoYou should publish the dataset or provide an API to get it. I found what seems to be a dataset but it doesn't have a clear structure.
- ratsmack 3y agoIs there a way you prevent them from identifying your scraper?
- jonnycoder 3y agoYes, there is a lot written about it. Here is one link I have saved: https://github.com/niespodd/browser-fingerprinting https://github.com/niespodd/browser-fingerprinting
- jrmg 3y agoHow old is the data?
- jader201 3y agoLooks like most prices haven’t been updated since March 2023, so about 10 months old.
- Wistar 3y agoI admire the crispness and precision of your mapping. Zooming in tight so just three or four McD locations are on screen and then sliding a location juuuust off-screen immediately changes the price results.