5 ms·
Python's Hidden Regular Expression Gems (2015)
- natch 9y ago2015. "Ignoring Python 3.." that's getting harder and harder to do these days.
- josteink 9y agoI'm rather the opposite: I ignore anything ignoring Python 3. That's the only version of Python I can bother touching these days.
- dismantlethesun 9y agoAh for context, the article only means the the regex module had limited updates until Python 3. Which is to say that it is presumably much better in Python 3.
- WaxProlix 9y agoThe article seems to be saying that it didn't need to change much at all to be Py3 ready.
- RUTHLESS_RUFUS 9y agoIt is official; Netcraft confirms: Python 2.7 is officially dead. One more crippling bombshell hit the already beleaguered Python 2.7 community when josteink confirmed that he would not be bothering to touch anything older than Python 3 code. All major surveys show that Python 2.7 has steadily declined in market share. 2.7 packages are very sick and their long term survival prospects are very dim. If legacy Python is to survive at all it will be among trolling dilettante dabblers. 2.7 continue to decay. Nothing short of a miracle could save it at this point in time. For all practical purposes, Python 2.7 is dead. FACT: Python 2.7 is dying.
- jjawssd 9y agoEvidence plz
- zu03776 9y agoWasn't the same said of BSD at one time?
- RUTHLESS_RUFUS 9y agoYes, ha, I was just taking the piss. It's an old Slashdot trope to declare things dead by Netcraft survey.
- ndr 9y agoThe article is not dismissing Python 3 in any way, the full quote: > Ignoring Python 3 it has not really evolved since its inception other than gaining basic unicode support at one point. It's actually praising that the 're' module only needed basic unicode support and not an API revamp to get into Python 3.
- ubernostrum 9y agoThe third-party 'regex' library is aiming to finish off what needed to happen there. It's a drop-in replacement for 're', and adds some important things like implementing the Unicode grapheme-matching rules.
- nzjrs 9y agoTalk about a dishonest misquote!
- DonaldPShimoda 9y agoThis is super neat! But... why is it undocumented? Is there a reason it's kept a "secret"?
- kingosticks 9y agoSurely it would have been way more useful to contribute the missing documentation rather than write the article. Maybe that's harder to do than it sounds.
- atdt 9y ago> (Have a look at what dir() returns on a regex pattern object). Python 2.7.13 (default, Dec 20 2016, 16:00:28) [GCC 4.2.1 Compatible Apple LLVM 8.0.0 (clang-800.0.42.1)] on darwin Type "help", "copyright", "credits" or "license" for more information. >>> import re; dir(re.compile('')) ['__class__', '__copy__', '__deepcopy__', '__delattr__', '__doc__', '__format__', '__getattribute__', '__hash__', '__init__', '__new__', '__reduce__', '__reduce_ex__', '__repr__', '__setattr__', '__sizeof__', '__str__', '__subclasshook__', 'findall', 'finditer', 'flags', 'groupindex', 'groups', 'match', 'pattern', 'scanner', 'search', 'split', 'sub', 'subn'] Looks OK to me. What am I missing?
- js2 9y agoThat was apparently fixed in Python 2.7: https://github.com/python/cpython/commit/6116d4a1d1ecd6e9b94cfaa524b9b7cd5a6b5447 https://github.com/python/cpython/commit/6116d4a1d1ecd6e9b94... http://bugs.python.org/issue12099 http://bugs.python.org/issue12099 But that commit pre-dates the blog post by many years, so maybe Armin was referring to something else, or maybe he hadn't realized it had been fixed?
- fernly 9y agoCouple relevant links. "regex"[1] is an upward-compatible "re" replacement with better performance and many added features including fuzzy matching. Second, the tokenizer technique of stacked expressions described in the OP is also documented in the Python re module doc[2], at least conceptually. [1] https://pypi.python.org/pypi/regex/2017.04.29 https://pypi.python.org/pypi/regex/2017.04.29 [2] https://docs.python.org/3.5/library/re.html#writing-a-tokenizer https://docs.python.org/3.5/library/re.html#writing-a-tokeni...
- aargh_aargh 9y agoPrevious HN discussion here: https://news.ycombinator.com/item?id=10600520 https://news.ycombinator.com/item?id=10600520
- falsedan 9y ago> [Python's implementation of regular expressions is] one of the best of all dynamic languages I would argue This sounds dishonest to me; it's deliberately couching the claim with a qualification ("imo") and disqualifying the 'dynamic' languages with better regex support (Perl, Ruby, JavaScript). The counter-claim is already prepared as a "No true Scotsman" argument: these other languages aren't as good because they don't have a scanner built into the regex language. I also don't understand why the author needs to qualify the claim on dynamic/non-dynamic grounds. Can someone please help me understand?
- falsedan 9y agoRelated: http://blog.aurynn.com/contempt-culture-2 http://blog.aurynn.com/contempt-culture-2
- mseebach 9y agoIt's just poor writing. The "Internet style" dictates that if you can't put something in bombastic absolutes, it's probably not worth writing down. The cluttering up with qualifications, then, is a sign of honesty, rather than the opposite. In a more civilised age, the author might have written [Python's implementation of regular expressions is] really good and very interesting.
- coldtea 9y ago>This sounds dishonest to me; it's deliberately couching the claim with a qualification ("imo") He gives his opinion, so he's humble about it ("imo", i could argue, etc). It's not some great weasel-word trick to lure people, nor it's meant as an absolute scientific conclusion. Just says what he has seen in his experience. >and disqualifying the 'dynamic' languages with better regex support (Perl, Ruby, JavaScript). How's that dishonest? He's not disqualifying them from the comparison he makes with some trick -- he just explicitly states that Python, in his opinion, is better than them. >The counter-claim is already prepared as a "No true Scotsman" argument: these other languages aren't as good because they don't have a scanner built into the regex language. Even if he said that, that's not how the "No true Scotsman" fallacy works. No true Scotsman involves you adding to the necessary qualities AFTER you've made an initial argument that doesn't include the new qualities. If you spell out in advance that you consider feature X important for a good regex engine, then you might be wrong, but you're not making a No True Scotsman. Besides, his point is not that Python has a better regex library mainly or because it has a scanner feature. The latter is just one feature of the library that he presents, not what he defines as what makes Python's lib great. For that he merely says that it's "one of the better designed core systems from a pure API point of view". >I also don't understand why the author needs to qualify the claim on dynamic/non-dynamic grounds. Can someone please help me understand? Because he is interested only in or experienced only in dynamic languages and their regex libs? Or because while he knows that there are better regex engines for non-dynamic languages, he still thinks Python has the better regex engine among the dynamic ones. It's a casual phrase in a blog post, not some huge marketing / FUD conspiracy that needs to be explained.
- Neutrion 9y agoAs of Python2.7.13 x64 there is no keyword argument "skip" in Scanner.scan method.
- threepipeproblm 9y agoI don't have a dog in the fight, but... this reminded me of Rob Pike's suggestion to avoid regular expressions in parsing and lexing tasks. https://commandcenter.blogspot.com/2011/08/regular-expressions-in-lexing-and.html https://commandcenter.blogspot.com/2011/08/regular-expressio...