4 ms·
pretty broad question. what format is your data in? structured or unstructured? structured would be, for example, XML or even CSV. unstructured would be on a w
by jnazario 15y ago
pretty broad question. what format is your data in? structured or unstructured?
structured would be, for example, XML or even CSV. unstructured would be on a web page in HTML.
XML? use the python XML parser (i like the xml.dom.minidom parser myself, plenty of good examples online). CSV? even easier, the csv module has good documentation and examples.
HTML? trickier. i like BeautifulSoup still, although other people prefer other tools for getting at the data.
care to elaborate?
- armenarmen 15y agoI suppose it is super broad. I really have no idea to be honest, again I am still quite new to coding. I'll check out what you've recommended. I want to be pulling prices from here: http://www.metalprices.com/FreeSite/metals/al/al.asp http://www.metalprices.com/FreeSite/metals/al/al.asp
- jnazario 15y agohad a look. you'll want to parse those tables using a technique broadly known as "screen scraping". varied libraries and tools exist in python. basically walk the document and find the tables you wish to scrape, check the table name (the red bar), then keep track of the values in some python data structure (e.g. a list of dicts, list of lists, etc) and then access them that way. that's the basic strategy.
- jnazario 15y agoalso some neat tips here: http://stackoverflow.com/questions/4426504/python-library-to-do-jquery-like-text-extraction http://stackoverflow.com/questions/4426504/python-library-to... i hadn't seen some of the more modern ways to do screen scraping.