3 ms·

a lot of it is just simple python scripts to download/convert data to csv files, and do some simple post processing. for the computer activity i took a snapsho

by jehiah 14y ago

a lot of it is just simple python scripts to download/convert data to csv files, and do some simple post processing. for the computer activity i took a snapshot every 30seconds of what program was active, and how long my laptop was active.

nphase 14y ago
Are these tools open source?
- jehiah 14y ago
  The script I used for extracting sms/iMessages is here https://gist.github.com/4437883 https://gist.github.com/4437883 Some of the other scripts just download data from foursquare's API, and post processing transaction download from Mint. Hopefully I'll have time to clean and post those scripts.
  - mikeevans 14y ago
    I'd be interested in seeing the one(s) that keep track of application usage!
    - jehiah 14y ago
      I've dumped the cron job i use for data collection here https://gist.github.com/4477372 https://gist.github.com/4477372 My rough approach to post processing this data was to group by 6 minute intervals, and to drop any records where the computer was inactive for more than 120 seconds.
      - sbouafif 14y ago
        Many thanks for the script :)
      - lucaspiller 14y ago
        I've tweaked it a bit here https://gist.github.com/4478297 https://gist.github.com/4478297 - Logs active website from Chrome - Stores time including local timezone (interesting to see what timezones I'm in) - File name includes hostname
arscan 14y ago
So you parse your credit card statements (or equivalent) for the coffee & travel costs? I thought the travel was by distance (not cost) at first, which is what I was curious about because it would require a more active role in logging on your part. Is this purely for kicks, or are you trying to use it to drive behavioral changes (e.g. spend less on coffee)? I ask because I always think about doing this, but I get a stuck on the "why".
- jehiah 14y ago
  coffee data is more driven from foursquare checkins, and only partially credit card transactions. The motivation for me is a way to learn about my year (not directly to change my actions), and part a fun exercise to get better at data processing, javascript, and UI Interaction/charting. I like the hard deadline that a personal annual report creates naturally (ie: it's no good if i release it in june).

by jehiah 14y ago

nphase 14y ago

Are these tools open source?

jehiah 14y ago
The script I used for extracting sms/iMessages is here https://gist.github.com/4437883 https://gist.github.com/4437883 Some of the other scripts just download data from foursquare's API, and post processing transaction download from Mint. Hopefully I'll have time to clean and post those scripts.
- mikeevans 14y ago
  I'd be interested in seeing the one(s) that keep track of application usage!
  - jehiah 14y ago
    I've dumped the cron job i use for data collection here https://gist.github.com/4477372 https://gist.github.com/4477372 My rough approach to post processing this data was to group by 6 minute intervals, and to drop any records where the computer was inactive for more than 120 seconds.
    - sbouafif 14y ago
      Many thanks for the script :)
    - lucaspiller 14y ago
      I've tweaked it a bit here https://gist.github.com/4478297 https://gist.github.com/4478297 - Logs active website from Chrome - Stores time including local timezone (interesting to see what timezones I'm in) - File name includes hostname

arscan 14y ago

So you parse your credit card statements (or equivalent) for the coffee & travel costs? I thought the travel was by distance (not cost) at first, which is what I was curious about because it would require a more active role in logging on your part. Is this purely for kicks, or are you trying to use it to drive behavioral changes (e.g. spend less on coffee)? I ask because I always think about doing this, but I get a stuck on the "why".

jehiah 14y ago
coffee data is more driven from foursquare checkins, and only partially credit card transactions. The motivation for me is a way to learn about my year (not directly to change my actions), and part a fun exercise to get better at data processing, javascript, and UI Interaction/charting. I like the hard deadline that a personal annual report creates naturally (ie: it's no good if i release it in june).