Faster Regexes: What to do when text matching is your bottleneck

Faster Regexes: What to do when text matching is your bottleneck

By Aaron Crane (‎arc‎) from Edinburgh.pm, London.pm
Date: Thursday, 14 August 2008 15:10
Duration: 30 minutes
Language:
Tags: optimisation regex regexp


We all know how good Perl is at munging text. But what do you do when your Perl text-munging code isn't fast enough for what you're trying to do?

We needed to extract useful information from tens of gigabytes of web-server log files. Our Perl code was simple and obvious, but not fast enough for our purposes. When profiling revealed a frequently-executed regex as the bottleneck, we tried several things to make it faster.

This talk looks at what we did to speed up our regex-heavy code (by a factor of well over 100 in some places), identifying a few general-purpose optimisation techniques on the way.


Attended by: Vincent Pit (‎vincent‎), Leon Brocard (‎acme‎), Andrey Shitov (‎ash‎), Anton Berezin (‎Grrrr‎), Barbie, Jacob Bunk Nielsen, Steffen Mueller, Stefan Hornburg (‎Racke‎), Casiano Rodriguez-Leon (‎casiano‎), Damian Conway (‎damian‎), Sue Mynott (‎virtualsue‎), Francoise Dehinbo (‎franky‎), Michael Zedeler (‎mzedeler‎), Rasmus Hansen (‎rasmoo‎), Dmitry Karasik (‎McFist‎), Karen Pauley, Alex Balhatchet (‎Kaoru‎), William Travis Holton, Stéphane Payrard (‎cognominal‎), Alberto Simões (‎ambs‎), Alex Kapranoff (‎kappa‎), Arne Sommer (‎Arne‎), Martin Schipany (‎ElCondor‎), Stefan Hanski, Darius Jokilehto, Stan Sawa, Jörg Plate (‎Patterner‎), allan dystrup (‎ady‎), Patrick Michaud (‎Pm‎), Wendy Van Dijk (‎woolfy‎), David Jack Wange Olrik (‎davidolrik‎), Andreas Hetey, Mark Fowler (‎Trelane‎), Gertraud Unterreitmeier (‎Gertraud‎), Nicholas Clark, Bart Lateur, Lars Dɪᴇᴄᴋᴏᴡ (‎daxim‎), Matija Grabnar (‎matija‎), Søren Døygaard, Erik Johansen (‎uniejo‎), Roel de Cock, Nuno Carvalho (‎smash‎), Martin Kjeldsen (‎baest‎),