4 ms·

Cool project. I do something similar for the daily free ebook from Packt. Also for when new episodes of Silicon Valley are posted. Tiny detail - you can do t

Cool project. I do something similar for the daily free ebook from Packt. Also for when new episodes of Silicon Valley are posted. Tiny detail - you can do the regex match case insensitive and avoid the call to lower() for every string. re.match(..., re.I)

jamesbvaughan 10y ago
Oh cool, thanks for that!
- column 10y ago
  Seems to me you don't need regex, nor the call to list() at all for that free_food = [s for s in soup.stripped_strings if "free" in s.lower()] works
  - js2 10y ago
    You can also avoid building the list and terminate at the first true value with `any`: free_food = any(s for s in soup.stripped_strings if ...)
    - tedmiston 10y ago
      Well on that note, if you just want the boolean, I think it'd be enough to say: free_food = 'free' in soup.get_text().lower()
  - jamesbvaughan 10y ago
    Oh even better. I'm kind of new to Python, so I hadn't seen that before!
    - dmn001 10y ago
      Right, if you're just matching a substring in a list of strings then you don't need regex for that. Also, lxml is over 20x faster than BeautifulSoup, although it doesn't really matter with such a low frequency of requests, it's something to note if you had another project that required parsing e.g. 1,000's of html pages.
ge96 10y ago
Is the 4th season airing already?
- joshschreuder 10y ago
  Nope, it's back April 24th
  - ge96 10y ago
    Ahh nice something to look forward to in life haha
douche 10y ago
Do you have that Packt script handy? There's a lot of junk that gets put up there, but also some gems. Unfortunately it seems like the gems are always on the days I don't check it...
- tedmiston 10y ago
  For Packt, I'm just using ChangeDetection.com with an email alert. I noticed in the stats for that URL that others are doing the same. It's super easy to setup.
- tedmiston 10y ago
  So today I noticed that they announced additional free ebooks on twitter besides the daily one. I'm thinking of writing custom code now that subscribes to their tweets and filters for mention of free. May be doable with IFTTT.

jamesbvaughan 10y ago

Oh cool, thanks for that!

column 10y ago
Seems to me you don't need regex, nor the call to list() at all for that free_food = [s for s in soup.stripped_strings if "free" in s.lower()] works
- js2 10y ago
  You can also avoid building the list and terminate at the first true value with `any`: free_food = any(s for s in soup.stripped_strings if ...)
  - tedmiston 10y ago
    Well on that note, if you just want the boolean, I think it'd be enough to say: free_food = 'free' in soup.get_text().lower()
- jamesbvaughan 10y ago
  Oh even better. I'm kind of new to Python, so I hadn't seen that before!
  - dmn001 10y ago
    Right, if you're just matching a substring in a list of strings then you don't need regex for that. Also, lxml is over 20x faster than BeautifulSoup, although it doesn't really matter with such a low frequency of requests, it's something to note if you had another project that required parsing e.g. 1,000's of html pages.

ge96 10y ago

Is the 4th season airing already?

joshschreuder 10y ago
Nope, it's back April 24th
- ge96 10y ago
  Ahh nice something to look forward to in life haha

douche 10y ago

Do you have that Packt script handy? There's a lot of junk that gets put up there, but also some gems. Unfortunately it seems like the gems are always on the days I don't check it...

tedmiston 10y ago
For Packt, I'm just using ChangeDetection.com with an email alert. I noticed in the stats for that URL that others are doing the same. It's super easy to setup.
tedmiston 10y ago
So today I noticed that they announced additional free ebooks on twitter besides the daily one. I'm thinking of writing custom code now that subscribes to their tweets and filters for mention of free. May be doable with IFTTT.