4 ms·

Sadly, most academics realize that they're data-starved, but industry isn't able to/doesn't want to work with academia to help gain access to that data. Even if

Sadly, most academics realize that they're data-starved, but industry isn't able to/doesn't want to work with academia to help gain access to that data. Even if you do get access, you're NDA'd so hard that publishing useful papers is a challenge. It's a shame, because universities are essentially free labor, just on much longer timeframes and lower probability of immediate success. I understand why things are the way they are, but I'd love to find some way of reconciling this issue. It's already killed a research project of mine before it started.

moultano 16y ago
Google realizes this too, and there are a lot of people here that would like to help. There are a few huge issues that always come up. 1. Paranoia about giving competitors the edge they need. 2. Paranoia about giving spammers the edge they need. 3. Privacy. It's nigh impossible to anonymize user data enough to release and still have it in a useful form. The AOL logs debacle hurt everyone. One of my friends had a really interesting take on this. His belief essentially was that the industry advances when people switch companies and (legal or not) take their institutional knowledge with them. Unfortunately, academia is hard to transfer into.
- price 16y ago
  <quote>His belief essentially was that the industry advances when people switch companies and (legal or not) take their institutional knowledge with them.</quote> This is why it's so important that in California the law protects employees leaving companies to work for other companies -- this is legal there. You can't take code, data, hardware designs, or other concrete intellectual property -- that's forbidden by the agreements every tech company requires employees to sign. But if you couldn't take institutional knowledge with you, you couldn't work at a new company at all. (How could an ex-Googler unlearn how web-scale systems are built of many disposable pieces?) And if an agreement purports to restrict you from switching jobs, then California law repudiates that restriction. Unfortunately some other states have no such law, and cheerfully enforce non-competes against engineers trying to switch companies. And guess what? The industry doesn't move as fast in Massachusetts as in California.
  - kevinpet 16y ago
    If I could point to one thing other states could do to improve their economy, it would be adopt the exact language of California's anti-non-compete and the "you own your own ideas, unless developed as part of your work" law. Not that this is going to single handedly grow a silicon valley in Montana overnight, but it has so little downside. The reason for the exact language is because if they use the exact language consciously, they effectively import the case law surrounding those laws.
    - deleted 16y ago
      [deleted]
  - hga 16y ago
    Actually, I know of no other state that has such a law (although the Michigan legislature accidentally zapped their's for a fairly long period and research has been done on this). I've never lived/worked in California/SV, but based on what I've read about it (e.g. Shockley -> Fairchild -> many companies is the golden example) etc. and how I've experienced on the East Coast (Boston and D.C. areas) a number of failures to even get started-up due to non-completes, I'm convinced that this one and only unique to California feature is the #1 secret behind Silicon Valley's long term success, its crushing of Route 128, etc.
    - _delirium 16y ago
      Georgia was one until two weeks ago, at least de facto. The language wasn't quite as clear as California's, but it was essentially impossible to enforce non-competes. A bunch of big companies managed to get an initiative on the Nov. 3 ballot to overturn that, though, and it passed, partly due to misleading language that's currently being litigated. The ballot question read, Shall the Constitution of Georgia be amended so as to make Georgia more economically competitive by authorizing legislation to uphold reasonable competitive agreements?, which is a bit, uh, indirect about the fact that its main impact will be to legalize noncompetes in GA. It caused a bit of ruckus within libertarian-leaning circles in Georgia, with some people lining up on the pro side, arguing freedom of contract, and other people lining up on the anti side, arguing right-to-work. It was probably the only major issue where progressive groups and tea-party groups actually had the same position (against), but they were both greatly outspent by the Georgia Chamber of Commerce and business-Republican groups.
- fizx 16y ago
  > His belief essentially was that the industry advances when people switch companies and (legal or not) take their institutional knowledge with them. Ah, so pay $3.5MM to retain those people ;)
edge17 16y ago
While I do agree, it's important to note that the state of collaboration between American universities and industry is far greater than any other country and has helped both grow. It's one of the problems in places like India, where there isn't much collaboration between private institutions and industry. Of course things could always be better, but it could also be worse.

moultano 16y ago

Google realizes this too, and there are a lot of people here that would like to help. There are a few huge issues that always come up. 1. Paranoia about giving competitors the edge they need. 2. Paranoia about giving spammers the edge they need. 3. Privacy. It's nigh impossible to anonymize user data enough to release and still have it in a useful form. The AOL logs debacle hurt everyone. One of my friends had a really interesting take on this. His belief essentially was that the industry advances when people switch companies and (legal or not) take their institutional knowledge with them. Unfortunately, academia is hard to transfer into.

price 16y ago
<quote>His belief essentially was that the industry advances when people switch companies and (legal or not) take their institutional knowledge with them.</quote> This is why it's so important that in California the law protects employees leaving companies to work for other companies -- this is legal there. You can't take code, data, hardware designs, or other concrete intellectual property -- that's forbidden by the agreements every tech company requires employees to sign. But if you couldn't take institutional knowledge with you, you couldn't work at a new company at all. (How could an ex-Googler unlearn how web-scale systems are built of many disposable pieces?) And if an agreement purports to restrict you from switching jobs, then California law repudiates that restriction. Unfortunately some other states have no such law, and cheerfully enforce non-competes against engineers trying to switch companies. And guess what? The industry doesn't move as fast in Massachusetts as in California.
- kevinpet 16y ago
  If I could point to one thing other states could do to improve their economy, it would be adopt the exact language of California's anti-non-compete and the "you own your own ideas, unless developed as part of your work" law. Not that this is going to single handedly grow a silicon valley in Montana overnight, but it has so little downside. The reason for the exact language is because if they use the exact language consciously, they effectively import the case law surrounding those laws.
  - deleted 16y ago
    [deleted]
- hga 16y ago
  Actually, I know of no other state that has such a law (although the Michigan legislature accidentally zapped their's for a fairly long period and research has been done on this). I've never lived/worked in California/SV, but based on what I've read about it (e.g. Shockley -> Fairchild -> many companies is the golden example) etc. and how I've experienced on the East Coast (Boston and D.C. areas) a number of failures to even get started-up due to non-completes, I'm convinced that this one and only unique to California feature is the #1 secret behind Silicon Valley's long term success, its crushing of Route 128, etc.
  - _delirium 16y ago
    Georgia was one until two weeks ago, at least de facto. The language wasn't quite as clear as California's, but it was essentially impossible to enforce non-competes. A bunch of big companies managed to get an initiative on the Nov. 3 ballot to overturn that, though, and it passed, partly due to misleading language that's currently being litigated. The ballot question read, Shall the Constitution of Georgia be amended so as to make Georgia more economically competitive by authorizing legislation to uphold reasonable competitive agreements?, which is a bit, uh, indirect about the fact that its main impact will be to legalize noncompetes in GA. It caused a bit of ruckus within libertarian-leaning circles in Georgia, with some people lining up on the pro side, arguing freedom of contract, and other people lining up on the anti side, arguing right-to-work. It was probably the only major issue where progressive groups and tea-party groups actually had the same position (against), but they were both greatly outspent by the Georgia Chamber of Commerce and business-Republican groups.
fizx 16y ago
> His belief essentially was that the industry advances when people switch companies and (legal or not) take their institutional knowledge with them. Ah, so pay $3.5MM to retain those people ;)

edge17 16y ago

While I do agree, it's important to note that the state of collaboration between American universities and industry is far greater than any other country and has helped both grow. It's one of the problems in places like India, where there isn't much collaboration between private institutions and industry. Of course things could always be better, but it could also be worse.