4 ms·
This product is great... But it makes me feel sad to think about all the webpages that hide a small amount of tabular data in an oversized web UI. I want the
by londons_explore 6y ago
This product is great... But it makes me feel sad to think about all the webpages that hide a small amount of tabular data in an oversized web UI.
I want the reverse of this service - I just want the raw data from any web page in a spreadsheet ready to filter and sort and define new columns as I please...
- tjchear 6y agoWhat you just described is essentially a scraper/crawler right? Would scraping them into a sheet you own be sufficient for your use case?
- londons_explore 6y agoYes, but currently the process of writing a scraper for a given page is usually half an hour with beautiful soup... Or more if you have to handle multiple pages, Auth cookies that expire, and rate limits. Example usecase:. eBay search results, I want to sort by "Price plus $0.50 per mile from me", since I'm going to have to drive my van to pick up the item. That would be super easy with a spreadsheet of the search results, and I could probably have the data sorted in under 60 seconds on a column of "=B5+C5*0.5"
- tjchear 6y agoIt's the complete opposite of what SheetUI hopes to achieve, but this is such an interesting use case I'll think more about it :) I can see how there might be a legitimately strong demand for it. Feel free to connect with me (tjchear on twitter/linkedin/gmail) to discuss this further.
- contravariant 6y agoThis is one of the reasons I really like that some webpages have taken to using JSON REST endpoints to provide the data for their (usually React-based) webpage. It makes it fantastically easy to circumvent all the complicated stuff and just directly access the data. It's somewhat of a shame that HTML never quite managed to split data from representation. It managed to separate content and styling, but the content is still treated as some kind of text document, not a textual representation of some data.
- tjchear 6y agoLike it or not, it's the reality we're in. It's not going away anytime soon, but we can always achieve incremental improvements towards that ideal through HTML standardizations. React and GraphQL (both great products from fb) really make that possible.
- infinite8s 6y agoThere's a research project at MIT trying to do this - https://www.geoffreylitt.com/wildcard/salon2020/ https://www.geoffreylitt.com/wildcard/salon2020/