9 ms·
Data Scientist: The Sexiest Job of the 21st Century
- carlsednaoui 14y agoFor those that prefer to read the article in one single page: http://hbr.org/2012/10/data-scientist-the-sexiest-job-of-the-21st-century/ar/pr http://hbr.org/2012/10/data-scientist-the-sexiest-job-of-the...
- javert 14y agoIMHO HN stories should always be posted in this format.
- carlsednaoui 14y agoTotally agree with you - much easier/ faster to read.
- seanconaty 14y agoBut you lose out on all those precious ad impressions!
- tzs 14y agoIn general, that is objectively bad, although for this particular site it is not as bad as it could be. Here are the three general problems with submitting print views: 1. For most sites, the print view results in a small font and lines that extend all the way across the page. This makes them hard to read. Sometimes, on a desktop, with a bit of fiddling they can actually be made legible to those of us who are older than 40. On mobile, they are often simply not possible for many of us to read. This particular site is OK in this regard, as they appear to have actually set the line width and the font size so that it comes out reasonable on the screen. In fact, their print view is quite pleasant to read. 2. The print view often omits comments, sidebar links to related stories, links for sharing, and so on. Some people actually might want to use those. 3. There is often no evident link from the print view back to the normal view. Sometimes you can figure it out by playing with the URL, but sometimes the relationship between the print URL and the normal URL is hard to figure out if all you have is the print URL to work with. Note that the normal page, on the other hand, does generally have a link to the print page, so those who prefer the print page can easily go to it. For these reasons, in almost all cases the submission should be to the normal page, not the print page. Ideally, the submitter can add a comment that gives the print URL to save time for those who do prefer it. Note that some sites have an "all on one page" option, that puts the whole thing on one page, but leaves comments, social links, and such. That's the best to use if available.
- jwoah12 14y agoI love the fact that this was posted a half hour after this: http://d.gould.in/blog/2012/09/18/your-job-is-not-sexy/ http://d.gould.in/blog/2012/09/18/your-job-is-not-sexy/
- donretag 14y agoIt was actually posted much sooner that that, but gained no traction: http://news.ycombinator.com/item?id=4542383 http://news.ycombinator.com/item?id=4542383
- dude_abides 14y agoInterestingly, just yesterday, I found out that Linkedin Friend Suggest uses, among other things, co-logins from same IP address as a signal. On my test account that I created at work, it eerily showed me all my co-workers in the Friend Suggest list. Later, as soon as I logged in from home, it added my wife to my Friend Suggest list. I wonder if one of the goals of a good Data Scientist is also to be not too accurate, lest the product create an eerie feeling among users! (remember the Target pregnant girl incident?!)
- makmanalp 14y agoGreat point! Rather, it is to gather and analyse data as accurately as possible, and then apply it as inaccurately as required :)
- 001sky 14y agoDefinitely creepy, when travelling. I've seen it, too.
- comlag 14y agoAn uncanny valley for data. Really interesting and certainly something I have felt but never could put a finger on.
- neutronicus 14y agoI was pretty weirded out when the fake account I made specifically to use Spotify (and which has absolutely no information about me in the profile), got a friend request from someone from my grad program.
- siganakis 14y agoI think that there is a tension between "creepiness" and "effective marketing". This I feel is one of Facebook's core problems, where for them to maximize the value of their dataset, their ad targeting becomes incredibly creepy. One issue is that from an end users perspective it makes it obvious how much information is being captured about them. While most people are aware that their information is being captured, seeing it plastered all over their facebook feed makes them confront it. Worse than that are the questions that come with these ads - "Why am I seeing ads for baldness cures?" Is it because I'm a 30+ male, or is it because they have analysed photos I'm tagged in and detected my thinning hair? Sometimes it just feels mean! This is primarily a challenge of data science working in a marketing environment and doesn't really permeate through all areas of data science, however it is the form of data science that is most visible. Therefore much of data science and the big data we work with gets lumped in with sleazy marketing.
- elchief 14y agoI teach data mining at a top grad school, and am a data scientist at a startup. I got one call from a recruiter who thought I was in a different city. Ain't so sexy from where I'm sitting.
- binarysolo 14y agoYou probably just need better buzzwords (and ideally the background to back it up) -- NoSQL, big data, MongoDB, Hadoop, etc. I consulted for a client that used those technologies, updated my LinkedIn profile afterwards, and the amount of incoming requests from recruiters and principals has been nothing short of phenomenal. (Anecdotally, 20 InMails in 10 days, of which 14 of them converted into a phone interview with the principal.)
- baltcode 14y ago> You probably just need better buzzwords (and ideally the background to back it up) -- NoSQL, big data, MongoDB, Hadoop, etc. Are there as many data scientists who don't work on Big Data?
- binarysolo 14y agoTo be pretty honest, prior to my life as a data scientist (and grad school) I was a business analyst. We mined data and threw 10M-100M entries into a MySQL database w/ Rails dashboard and for our non-RT analysis purposes it was tolerable. There are plenty of data problems out there already warehoused by small-cap and mid-cap firms; I honestly don't see a need to go Web-Scale and all that jazz for its own sake if your use case doesn't need it. There's also shortcuts like sampling to kick the can down the road, but that's another discussion in and of itself.
- _delirium 14y agoI think the keyword "big data" ends up being used in even a lot of smaller cases, because everyone thinks what they have is "big data", I'm guessing because they do all genuinely have much more data than they might have a decade ago. But that still varies widely in size; what some companies think is "big data" is still perfectly analyzable, for non-realtime purposes, on one beefy workstation. Yet, because they'd never seen data with tens of millions of rows! before, and it breaks whatever system they were previously using to analyze stuff (SPSS, etc.), what they want to hire is a "big data" person.
- gaius 14y agoHeh, I wonder if back in the 60s, HBR said Business Analyst or Statistician were the sexy jobs of the 20th century. Because that's all a "data scientist" is... but without the experience to realize there's already a job title for what they do.
- disgruntledphd2 14y agoThis is so very, very true. The major change appears to be one of scale, rather than any qualitative change. Funnily enough, since I put predictive analytics (what does that term even mean, anyway?) on my CV I've gotten much more attention from recruiters and employers. I guess it sounds so much sexier than statistics. More seriously though, the requirements to be able to hack up a prototype and talk to people are probably what hold back a lot of people who otherwise have the skills to be good "data scientists", or just scientists. My current employers told me at interview that they had no data, and in the three months I've been there I've been slowly discovering that they have loads of it, unfortunately in multiple incompatible forms and jealously guarded by different departments. It is rather funny, though a little sad that they were essentially drowning in data and didn't realise it.
- enos_feedler 14y agoI agree that being able to hack up a prototype could really make someone stand out as a data scientist. The Insight Data Fellows program mentioned in the article has a 6 week program where the focus is on learning enough software development to hack a prototype by the end of the program. That could be a good way to go.
- 001sky 14y agoIts like a "growth hacker", re-branded in a corporate way
- disgruntledphd2 14y agoThis is so very, very true. The major change appears to be one of scale, rather than any qualitative change. Funnily enough, since I put predictive analytics (what does that term even mean, anyway?) on my CV I've gotten much more attention from recruiters and employers. I guess it sounds so much sexier than statistics. More seriously though, the requirements to be able to hack up a prototype and talk to people are probably what hold back a lot of people who otherwise have the skills to be good "data scientists", or just scientists. My current employers told me at interview that they had no data, and in the three months I've been there I've been slowly discovering that they have loads of it, unfortunately in multiple incompatible forms and jealously guarded by different departments. It is rather funny, though a little sad that they were essentially drowning in data and didn't realise it.
- bearmf 14y agoI remember reading at least 10 articles with nearly the same content during the year. Why are authors so eager to convince everyone of big data's sexiness? Results should speak for themselves. So far Linkedin's Friend Suggest is one of the biggest success stories.
- rm999 14y agoAs a "data scientist" I found this article had much more meaningful content than most articles I've read in the past year. It's not just repeating how data science will be big in the next decade, it discusses who data scientists are and how to hire them. >So far Linkedin's Friend Suggest is one of the biggest success stories. I don't agree with this. Google is basically a big data sciences company. 'Data science' may be a new term, but it describes something companies have been doing for decades.
- bearmf 14y agoI agree that this article is better than average. >'Data science' may be a new term, but it describes something companies have been doing for decades. This is not what most articles say. They actually try to frame it as something "new and sexy".
- nostrademons 14y agoYeah, big data crunching pervades basically everything Google does. I joined Google as a UI SWE (basically a webdev), and find that most of my daily work nowadays involves processing large amount of data to come up with new features. I suppose I made a conscious effort to move back in the stack to more algorithmic back-end work, but even if you stick with UI work, the launch process is so data-driven that you almost need to have a basic familiarity with statistics & data processing.
- confluence 14y agoAnything that isn't "normal" news is a PR piece for someone or something - http://paulgraham.com/submarine.html http://paulgraham.com/submarine.html Looks like a tech company list looking to hire data scientists - essentially a sneaky job advertisement wrapped up in a fluffy HBR (aren't they all?) article written by a consultant who probably wants to get in on the new new thing.
- jboggan 14y agoI've found that a lot of companies are looking for data scientists but many of them have very different ideas of what that means. This makes for some interesting interviews. I recently moved to SF and am currently interviewing for data science positions - particularly ones involving social networks and applied graph theory - so drop me a line if you know anyone who is dealing with that problem space.
- binarysolo 14y agoJust checked out your LI profile (fellow data science guy here) -- I think you basically need a bit more work experience or some github code to show yourself off. The big data guys like Google who have best practices, brand, and provide great onboarding should be your focus IMHO.
- tejaswiy 14y agoQuick question: What do you classify as work ex? I do mostly iOS programming, but I've been playing with Hadoop + the commoncrawl.org crawl data. Basically, I guess, what level of stats do you need to be comfortable with to call yourself a data scientist?
- deleted 14y ago[deleted]
- ahuibers 14y agoFollowing Gladwell's 10000 hour rule, I would say you could probably call yourself a data science after 1000+ hours experience working with datasets successfully. As far as the math goes you should be able to do regression analysis, you don't need to know tons of stats but you do need to know stats and probability essentials (first few classes at a good school) deeply. I like this Wikipedia entry on "mathematical maturity": http://en.wikipedia.org/wiki/Mathematical_maturity http://en.wikipedia.org/wiki/Mathematical_maturity; apart from writing proofs, it is very relevant.
- binarysolo 14y ago
- bitwize 14y agoSorry, I don't think data science is going to topple the quadfecta of sexiness: porn star, rock star, sports star, and movie star.
- nachteilig 14y agoI know I should be excited for the positive innovations data science will bring us, but am I alone in mostly still finding it creepy?
- tryitnow 14y agoThere's a recommendation I give to people who are writing their online personals ad: If you're sexy, there's no reason to say that you're sexy. I think the same applies here. A data scientist is a fancy way of saying a "statistician who can code (should be required in stats programs now anyhow) and who can communicate effectively"
- gaius 14y agoI'd be surprised if it was even possible to graduate in stats these days and not know R at least, and probably NumPy too.
- majormajor 14y agoThis was ISyE, not stats, and it was 5 years ago, but I was amazed by how much extra work some people would do to avoid having to learn anything but Excel (meanwhile, I was messing around with R and whipping programs up to get better results in less time). This was at a highly ranked engineering program, too. Based on a few people I've kept in touch with, it seems like it hasn't changed all that much at the undergrad level. The grad level was where the problem sizes and difficulty really forced you to use better tools.
- crntaylor 14y agoIn case anyone else is wondering, ISyE == Industrial and Systems Engineering.
- brianto2010 14y agoAt RIT at least, R and NumPy aren't in the core curriculum. Instead, there is a "Statistical Computing" class which covers SAS. Most students either use Minitab or Excel. Surprisingly (or not), a lot of in-class work is done using a graphing calculator. Of course, that also carries into a lot of the homework. I wonder, do statisticians actually use graphing calculators to do stats?
- crntaylor 14y ago
- suyash 14y agoASK HN? : I'm little confused, can someone please shed some light into this so we can all get a clearer picture. What is the difference between Data Scientist vs Big Data Expert vs Analytics Engineer (Statistics, metrics etc) vs Hadoop Architect vs Machine Learning Expert ? Thanks a lot HN people!
- deleted 14y ago[deleted]
- rm999 14y agoEvery data scientist has to: * be very good at working with large datasets with computational tools (hadoop is an example) * be a decent programmer, scripter, and hacker * have a decent background in statistics A good data scientist: * has a good intuition and business sense * can explain insights to non-technical people (usually through visualization and plotting) * knows machine learning and predictive analytics It's a vague term, but purposefully so. There's tons of stuff you can do with data, a data scientist knows what to do and how to do it.
- suyash 14y agoThanks rm999 :)
- philip1209 14y agoQuestion for HN: I'm graduating this Spring with majors in Systems Engineering and Physics, and I want to work as a data scientist, preferably at a startup. What can I do to position myself for such a job? If any of you work in the field and are willing to provide some 1-on-1 advice, please shoot me an email - mail@philipithomas.com
- 3pt14159 14y ago1. Know programming. 2. Be smart with an eye for economics (there is way more overlap than people give it credit for). 3. Start by talking to people and telling them what you want to do. Most founders want to help people reach their dream. If you have a github account, email me and maybe you can start with us over at 500px here in Toronto.
- jvm 14y agoWhat's the Toronto scene like? I'm finishing up a PhD at NYU this year and was planning on breaking in to the field after graduating. NYC is obviously a great place to be but for relationship reasons I was thinking of moving to Toronto (which is honestly a nicer city anyway much as I love NY), but a cursory inspection suggests a lot less demand for data-loving jobs. I would love to be mistaken though; am I?
- chubot 14y agoFrom my experience, you will spend most your time finding, collecting and cleaning data. Doing anything super algorithmically interesting will be rare. Get familiar with the Unix shell + Python (or similar language). The shell will save you tons of code. awk/sed/cut and friends are very fast for cleaning data (in development time and runtime). And shell scripts are good for grabbing things from different systems.
- mmcdan 14y agoThe Insight Data Science fellows program looks awesome, but it is disappointing that only phd candidates and post-docs can apply. There is some irony with the fact that the cover of their brochure uses the facebook friendship visualization done by Paul Butler, who was an undergraduate intern at facebook when he made it.
- hcarvalhoalves 14y agoLet's keep reinventing job titles to pretend they are new and sexy. - Business Analyst: Data Scientist - Systems Analyst: Growth Hacker - Public Relations: Social Media Evangelist What else?
- oo 14y agoIt's only 12 years into the 21st century and you already know what the sexiest job of the whole century is. What's your prediction in 1912? Journalism these days.