Gridspy monitors power usage in real time. My original plan was to effectively stream the live data through the database as it passed from collection (sensors)

Gridspy monitors power usage in real time. My original plan was to effectively stream the live data through the database as it passed from collection (sensors) to display (on the website). The frequent writing to and polling of the database to keep data "live" was absolutely killing performance. Now I have moved to a Twisted application that aggregates the data and does occasional writes into the DB. It can answer webserver queries for the latest data out of its internal datastructures and streams live data to the user's browser via Orbited See http://blog.gridspy.co.nz/2009/09/database-meet.. http://blog.gridspy.co.nz/2009/09/database-meet... (the database side) and http://blog.gridspy.co.nz/2009/10/realtime-data.. http://blog.gridspy.co.nz/2009/10/realtime-data... (the whole application structure) [I posted this on the original site too]