sakisv

7 ms·

31.
by sakisv 2y ago
> A record to an non-elastic IP, and the box gets rebooted Oh mate, I've seen that happen with a company that was selling security-adjacent services, which were running on servers with just random IPs ffs
32.
by sakisv 2y ago
I wonder how things would have played out back in the crisis of 2008 if Iceland was a member of the Eurozone: What they would have been allowed or forced to do and whether their response could have been the same.
33.
by sakisv 2y ago
Honest question: How was it discovered? Was it reported by a pentester? (ex-)employee? Facebook itself? How do we know that it goes back to 2012? I know in the public sector you have to disclose such things to ICO, but does that also apply
34.
by sakisv 2y ago
Well I'm just thinking of concourse the same way it describes itself, "a continuous thing doer". I want something that will run some code when something happens. In my case that "something" is a specific time of day
35.
by sakisv 2y ago
...or worse, if there _is_ an API call but the response is HTML instead of a json
36.
by sakisv 2y ago
Ha, you can't imagine how many times I've thought of doing just that - it's just that it's somewhat blocked by other things that need to happen before I even attempt to do it
37.
by sakisv 2y ago
Thanks! > I have found that it is best to split the task of scraping and parsing into separate processes. By saving the raw JSON or HTML, you can always go back and apply fixes to your parser. Yes, that's exactly what I've been
38.
by sakisv 2y ago
Haha all we have to do is agree on the format, right?
39.
by sakisv 2y ago
When you click on a product you get its full price history by default. I did consider adding a 3 and 6 month button, but for some reason I decided against it, don't remember why. It wasn't performance because I'm heavily cach
40.
by sakisv 2y ago
The few random checks that I did on a few products as I was shopping didn't show any difference. Either I was lucky or they don't bother, who knows
41.
by sakisv 2y ago
Thanks for your kind words! I haven't thought about monetizing it, because honestly I don't really see anything about it to be monetized in its current form.
42.
by sakisv 2y ago
Thankfully I'm not there yet. Since this is just a side project, if it starts demanding too much of my time too often I'll just stop it and open both the code and the data. BTW, how could the network request not appear in the netw
43.
by sakisv 2y ago
Yeah I thought about that, but I've seen cases that a product jumped more than 100%. I used this kind of heuristic to check if a scrape was successful by checking that the amount of products scraped today is within ~10% of the average
44.
by sakisv 2y ago
I do track the price per unit (kg, lt, etc) and I was a bit on the fence on whether I should show and graph that number instead of the price that someone would pay at the checkout, but I opted for the latter to keep it more "familiar&q
45.
by sakisv 2y ago
Initially that's what I wanted to do, but the first supermarket I did is sending back HTML rendered on the server side, so I abandonded this approach for the sake of "consistency". Lately I've been thinking to bite the b
46.
by sakisv 2y ago
I gave it a very quick try with chatgpt, but wasn't very impressed from the results. Granted it was around January, and things may have progressed... (Βut then again why take the easy approach when Ι can waste a few afternoons playing
47.
by sakisv 2y ago
Thanks!
48.
by sakisv 2y ago
Ah yes. My approach so far has been to first extract the brand names (which are also not written the same way for some fcking reason!), update the strings, and then compare the remaining. If they have a high similarity (e.g. >95%) then t
49.
by sakisv 2y ago
Oh nice! A thorny problem in my case is that the same item is named in 3 different ways between the 3 supermarkets which makes it very hard and annoying to do a proper comparison. Did you have a similar problem?
50.
by sakisv 2y ago
Thanks! If Greece's case is anything to go by, I doubt they'd ever accept that as it may bring to light some... questionable practices. At some point I need to deduplicate the products and plot the prices across all 3 supermarkets
51.
by sakisv 2y ago
When I first started it there was a couple of instances that my IP was blocked - despite being a residential IP behind CGNAT. I then started randomising every aspect of the scraping process that I could: The order that I visited the links,
52.
Tracking supermarket prices with Playwright(sakisv.net)
467 points by sakisv 2y ago|210 comments
53.
by sakisv 2y ago
I know that Google has extremely talented people tackling these kind of things, and with vastly more experience than I, but I can't help to think that the problem is that we as users have extremely diverse needs and use cases, which is
54.
by sakisv 2y ago
Hi Antonio, thanks for Zed, love it. If I may offer a small piece of feedback based on your comment here: Apart from its speed, the single thing I loved about Zed and made it stand out from the likes of vscode, was the built-in language sup
55.
by sakisv 2y ago
While I appreciate their intention and their transparency on what they're doing, I'll echo other comments here in that I, too, feel a bit uneasy that a 3rd party is rewriting my content. The good news is that a (strict) CSP can he
56.
by sakisv 2y ago
I think this sums it up pretty nicely. It's a failed state with corrupt people at the top of the government. The parliament, i.e. the majority, i.e. these people, are also the ones who appoint the judges of the top courts of the countr
57.
by sakisv 2y ago
You'd be 100% correct if that was the case. However, the problem is that she is not a politician and she has no public presense whatsoever. She was chosen by her party, and eventually elected because her last name starts with A which p
58.
by sakisv 2y ago
They did do that. Back in 2013-2015 or so. It was called Google Now, and it was a bit like magic. It showed you contextual cards based on your upcoming trips/appointments/traveling patterns. E.g. Any tube delays on your way home f
59.
by sakisv 2y ago
Location: UK/Greece Remote: Yes or Hybrid Willing to relocate: Yes - to Switzerland Technologies: AWS, terraform, docker, CI/CD (concourse), prometheus, grafana, python, bash, rust, go Résumé/CV: Available on req
60.
by sakisv 3y ago
Personal anecdata: - Work MPB which I got 2021-12, 99% of the time plugged in because I was WFH, last time I unplugged it to return it to my employer, the battery was at ~95% of max capacity (as reported by MacOS) - Personal MBP bought 2021

More ›