8 ms·
2012 Personal Annual Report
- arscan 14y agoWhat tools do you use to collect this data? Looks great, by the way.
- jehiah 14y agoa lot of it is just simple python scripts to download/convert data to csv files, and do some simple post processing. for the computer activity i took a snapshot every 30seconds of what program was active, and how long my laptop was active.
- nphase 14y agoAre these tools open source?
- jehiah 14y agoThe script I used for extracting sms/iMessages is here https://gist.github.com/4437883 https://gist.github.com/4437883 Some of the other scripts just download data from foursquare's API, and post processing transaction download from Mint. Hopefully I'll have time to clean and post those scripts.
- mikeevans 14y agoI'd be interested in seeing the one(s) that keep track of application usage!
- jehiah 14y agoI've dumped the cron job i use for data collection here https://gist.github.com/4477372 https://gist.github.com/4477372 My rough approach to post processing this data was to group by 6 minute intervals, and to drop any records where the computer was inactive for more than 120 seconds.
- sbouafif 14y agoMany thanks for the script :)
- lucaspiller 14y agoI've tweaked it a bit here https://gist.github.com/4478297 https://gist.github.com/4478297 - Logs active website from Chrome - Stores time including local timezone (interesting to see what timezones I'm in) - File name includes hostname
- arscan 14y agoSo you parse your credit card statements (or equivalent) for the coffee & travel costs? I thought the travel was by distance (not cost) at first, which is what I was curious about because it would require a more active role in logging on your part. Is this purely for kicks, or are you trying to use it to drive behavioral changes (e.g. spend less on coffee)? I ask because I always think about doing this, but I get a stuck on the "why".
- jehiah 14y agocoffee data is more driven from foursquare checkins, and only partially credit card transactions. The motivation for me is a way to learn about my year (not directly to change my actions), and part a fun exercise to get better at data processing, javascript, and UI Interaction/charting. I like the hard deadline that a personal annual report creates naturally (ie: it's no good if i release it in june).
- enobrev 14y agoFor collecting application usage data, I used to use an application called Timesnapper ( http://www.timesnapper.com/ http://www.timesnapper.com/ ), which takes a screenshot every x seconds and keeps track of the application title / etc, with the added benefit of allowing you to automatically categorize usage "Work", "Play", etc. Found it really useful to be able to literally play back my day in 10 second intervals. Unfortunately it's windows-only. One of the very few apps I truly miss since moving to Linux almost 2 years ago. -- I have absolutely no affiliation with TimeSnapper besides being a happily paying customer a couple years ago.
- perssontm 14y agoI think there is some package for ubuntu that tracked everything written on the keyboard, like a personal keylogger. It was mentioned on HN during december, cant find it now though.
- josyw 14y agoSelfspy? (http://news.ycombinator.com/item?id=4590987 http://news.ycombinator.com/item?id=4590987)
- gwern 14y agoYou could use arbtt (http://www.joachim-breitner.de/projects#arbtt http://www.joachim-breitner.de/projects#arbtt) and then just toss your favorite screenshot utility like ImageMagick into crontab set to fire every 10 seconds.
- enobrev 14y agoDefinitely interesting, and I'll probably try it at some point should I find both the time and the inclination to do so. Admittedly, I paid for that application because I didn't want to implement it myself. But I'm glad there are some building blocks in place that would make rolling my own a relatively easy task. Thanks for the suggestion!
- neetij 14y agoCheckout LifeSlice by Stan James (https://github.com/wanderingstan/Lifeslice https://github.com/wanderingstan/Lifeslice) for OSX - the script takes a screenshot, picture of the user and tracks web browser usage. The sample report leaves much to be desired from a design aesthetic but the data is available.
- datr 14y agoAny reason behind the move to Starbucks as the end of the year?
- jehiah 14y agolies, damned lies, and statistics. Unfortunately i didn't have time data for my other trips to Starbucks so that dataset is partial (I mostly visit Starbucks on the weekend/holidays). The transition from Carte Blanche to Burbon Coffee in the middle of the year is when @bitly's office moved, and my coffee habit followed.
- tribeofone 14y agoand that was awesome!
- m0th87 14y agoBeautiful. I would pay for a product that I could just turn on in the background and get reports like this daily.
- keso 14y agoHave you tried RescueTime? https://www.rescuetime.com/ https://www.rescuetime.com/
- aw3c2 14y agoThat seems like it sends all data home. I find that incredibly scary for something so indepth.
- rjtavares 14y agoThe productivity gain I had from using RescueTime was well worth the scary thought of having a spy on my computer.
- mej10 14y agoIs the productivity gain from the insight into how you spend your time? Or is there some other aspect I am missing.
- aaronblohowiak 14y ago>Hence the major effect of the Panopticon: to induce in the inmate a state of conscious and permanent visibility that assures the automatic functioning of power. So to arrange things that the surveillance is permanent in its effects, even if it is discontinuous in its action; that the perfection of power should tend to render its actual exercise unnecessary; that this architectural apparatus should be a machine for creating and sustaining a power relation independent of the person who exercises it; in short, that the inmates should be caught up in a power situation of which they are themselves the bearers. To achieve this, it is at once too much and too little that the prisoner should be constantly observed by an inspector: too little, for what matters is that he knows himself to be observed; too much, because he has no need in fact of being so. Michel Foucault on Bentham's Panopticon Prison design, which utilized a ring of cells around a central guard tower.
- rhodin 14y agoI did a similar report last year, focusing more on consumption (books, movies..) http://johanrhodin.se/RhodinReport/RhodinReport2011.html http://johanrhodin.se/RhodinReport/RhodinReport2011.html Hopefully this can be automated. I still have too many manual steps to perform.
- mattlong 14y agoLots of fun data here that is visualized well. Unfortunately Safari crashed several times on my iPad 1 while trying to load it. :(
- jehiah 14y agodoh. That's probably due to loading a full years worth of images as png's (I've added support for webp images when browsing w/ Chrome but that isn't going to help the iPad). Sorry i didn't get to do more than minimal iOS testing. glad you enjoyed the report.
- buremba 14y agowhat did you use to take pictures from your webcam periodically? If it's a python script, could you please share your code with us?
- someone13 14y agoHere's a quick script I whipped up. No warranty, etc. Also, you need OpenCV installed. https://gist.github.com/4476997 https://gist.github.com/4476997 OpenCV: http://opencv.willowgarage.com/wiki/ http://opencv.willowgarage.com/wiki/
- jehiah 14y agoI used isightcapture (The original source is offline, but i think this is the same thing http://distfiles.macports.org/isightcapture/ http://distfiles.macports.org/isightcapture/) https://gist.github.com/4477040 https://gist.github.com/4477040 is the cron script I use on a 10 min interval. There might be other ways to do this now days, but i've used this successfully for a few years.
- eloisius 14y agoI snap a picture every time I make a git commit. It's an easy way to ensure that I'm sitting at the computer. https://github.com/zacstewart/dotfiles/blob/master/git/.git_template.symlink/hooks/post-commit https://github.com/zacstewart/dotfiles/blob/master/git/.git_...
- awesomej 14y agoA very beautiful way to combine together lots of tiny snippets of data. Great fun!
- bliker 14y agofor a moment I tought someone from czech republic made it to top of HN
- ww520 14y agoThanks for the great presentation. I especially like the weekday/month visualization.
- awesomekid 14y agoReally cool! So what aspects of the report surprised you?
- jehiah 14y agoI was most surprised by the sheer amount of time I spend on the computer; clearly I need to unplug more often. (Though you can tell I did drop off the grid for a few weeks when my daughter was born, and again for a vacation in August. At least that's a start).
- enginous 14y agoThe lesson is to have more kids, fast.
- citricsquid 14y agoYou could start using whatpulse to track your typing too (http://whatpulse.org http://whatpulse.org) and if you listen to music last.fm would be great too (http://last.fm http://last.fm) There was a really awesome program called Wakoopa that tracked program usage for a few years, but they shut down their social portion last year :( http://social.wakoopa.com/ http://social.wakoopa.com/
- jehiah 14y agoI've not heard of whatpulse, but looks cool. I rolled my own data collection for keyboard stats last year. I've highlighted some last.fm data in a few of my previous annual reports, but it didn't make it this year (I Wasn't quite into new music enough recently for it to be interesting to me).
- nanook 14y agoThis is amazing! For those who haven't seen this already, Stephen Wolfram's been tracking such data for over 20 years (http://blog.stephenwolfram.com/2012/03/the-personal-analytics-of-my-life/ http://blog.stephenwolfram.com/2012/03/the-personal-analytic...). I'm going to try to track some of my data this year. I'm more interested in health data - sleep, exercise etc. It'll be interesting to see how other activities relate to sleep and exercise.
- lelandbatey 14y agoI really love the data you linked to, that's quite the commitment to keeping track of data, and it's very interesting to read his anecdotes on it. I'd love to do some of this information tracking, but nearly all of the data that I've seen comes from DIY setups, with custom tracking systems. Does anyone know of any open source projects that do this, or are willing to post their own solutions?
- mikeevans 14y agoGo on vacation at the end of July/beginning of August?
- jehiah 14y agoyup. I actually managed to travel without my laptop for a few weeks!
- ForrestN 14y agoBeautiful design, but a little depressing as a picture of a life: work, transit, texts, coffee, neutral facial expressions.
- bmuon 14y agoI disagree. I think the interesting part is in the blanks in most graphics. He does a very good job at keeping his computer use to work hours, so I think it's safe to assume he has a life outside work. He sends a good amount of texts which means he has people in his life. He drinks coffee mostly in the morning which is good.
- ForrestN 14y agoI'm not trying to say he has a "bad" life or is doing a "bad job" at something. But he seems to be saying that these things are meaningful as a representation of a year in his life. It's not bad to text or drink coffee or ride the bus, but I wouldn't want to think of a year in my life in these terms.
- lelandbatey 14y agoI guess. However, rather like any organization, I think it's good to review what has actually constituted the activities of a year. I think there's some utility, and certainly some novelty in taking a very frank look at what you've done in a year. I'm sure that there are short, personal moments and achievements from this year that define it for him. Lessons learned, moments of growth, of love, of victory and of failure. However, this is looking not at the interesting individual moments, but at the more mundane (but plentiful) every day things. Given that, I'd love to see a follow up post of what the year meant to the OP on a more personal level. A blog post that covers those moments of growth, love, learning, and victory.
- gknoy 14y agoJust because these metrics show evidence of how his time was spent, doesn't mean that's how he thinks of the year. He might think of it as time spent staying connected with far-away friends, while writing awesome code for a company he loves. As a parent, I have often wondered how much of my time is spent changing diapers, getting water/milk/juice for my kids, overseeing clean-up time, doing bathtime, reading, etc. I'd love to be able to look at a metric of this over the course of a year. If, at the end of the year, I had an annual report which included all of that (and work time), it would be very interesting to me as a way to understand my life better. I already think of myself as a parent, and know that these are the costs of being one, but that's not the only way I think of my life in a year.
- mmvvaa 14y agoWas the coffee move from Carte Blanche to Bourbon Coffee due to a change in location or a change in preference?
- jehiah 14y agoThe bitly office moved, so my morning coffee habit had to switch slightly. It's for the better thought; I <3 Bourbon Coffee.
- hamxiaoz 14y agoHow do you track your sleep time? Anything with Fitbit or just hand writing/computer/mobile entry?
- driverdan 14y agoI can't speak for the author but I keep a sleep journal. I write down the time I go to bed, the time I wake up, and any dreams I can remember.
- 001sky 14y agoThe 24x365 matrices for both Coffee and Computer activity -- perfect level of abstraction
- aditya 14y agoGood job presenting the data as usual, Jehiah! The d3 stuff looks nice :)
- jehiah 14y agothanks dude!
- omarkassim 14y agoCould you include a beard length index next year? I'm not certain, but it definitely looks like it grew out somewhat over the year. I'm all for a proper beard!
- jehiah 14y agobest-idea-ever Is there an official way of measuring beard length?
- zemo 14y agohttp://en.wikipedia.org/wiki/List_of_humorous_units_of_measurement#Beard-second http://en.wikipedia.org/wiki/List_of_humorous_units_of_measu... probably best to measure it in time. that is, a clean shave is length 0, time since last shave estimates length. If you use an electric shaver, the settings on the shaver associate to a known length. If you trim with scissors... that's a bit trickier.
- aharthegreat 14y agotest
- pazimzadeh 14y agoLooks like the "water" and "I'm a Mac" shirts are big winners.
- codex 14y agoHas a use been found for this visualization, or is it simply info-porn? What lessons can be drawn from this data? I must admit, I'm having trouble not classifying this as a waste of time--the result of the evolution-bred desire for tool-making, misapplied.
- arscan 14y agoI asked the same question and he replied... http://news.ycombinator.com/item?id=5021896 http://news.ycombinator.com/item?id=5021896 I think that "to get better at data processing, javascript, and UI Interaction/charting" is a perfectly valid answer. But in general, I tend to be wary of visualizations that don't ultimately inform some decision making process.
- edw519 14y agoCool, beautiful, clever, engrossing, and yet something about it bothered me. It took me a while, but then it hit me: This is a beautiful display of inputs. Where are the outputs? Where is the gorgeous dashboard that shows the results of all your hard work and the benefits that others got from them? That's something I'd love to see.
- peteforde 14y agohttp://statuschart.com http://statuschart.com would be the ideal presentation medium for this. I'm a fan.
- visualR 14y agoAt first I thought this post was poking fun at the Bingo Card creator-style annual reports.