I maintain about 8 crawlers and I use only vanilla Python I have a function to help me search : def find_r(value, ind, array,stop_word): indice = ind

I maintain about 8 crawlers and I use only vanilla Python I have a function to help me search : def find_r(value, ind, array,stop_word): indice = ind for i in array: indice = value.find(i,indice)+1 end = value.find(stop_word,indice) return value[indice: end], end You can use it like that : resulting_text , end_index = find_r(string, start_index, ["<td", ">"], "</td") To find text it is quite fast and you don't need to master a framwork