7 ms·

Driving dataset for car autopilot AI training

100 points by EvgeniyZh 10y ago

metafunctor 10y ago
This is very cool. I believe scientific papers, especially in the AI space, should habitually share all data that was used so others can repeat and build on the results. That said, a few hours of highway driving is of course woefully inadequate for learning anything but steering in normal conditions on that particular highway, if even that. So this is not the "build your Tesla Autopilot" kit, even though the OP decided to use the word “autopilot” in the title.
- EvgeniyZh 10y ago
  > This is very cool. I believe scientific papers, especially in the AI space, should habitually share all data that was used so others can repeat and build on the results. I believe the problem here is that most AI researches are commercial and not scientific, so no data. > even though the OP decided to use the word “autopilot” in the title. Yeah it might be a bit misleading. Honestly, I had some problems with formulating title in English
  - metafunctor 10y ago
    > I believe the problem here is that most AI researches are commercial and not scientific, so no data. One would hope that OpenAI [1] would come through with some significant data sets for various areas in the future. There are some significant commercial names backing up the initiative (like Musk), so hopefully they will actually be relatively open and not protecting corporate interest until end of time. [1] https://openai.com/ https://openai.com/
- dharma1 10y ago
  Most papers use public data sets. I agree there should be more public data sets, for nearly everything. Having said that - what's the cost of doing something like this yourself? 7 hours of driving video, plus the positional/steering/etc data? Should be easy for almost anyone with enough inclination to gather hundreds of hours of data like this, if you really wanted to.
  - jacquesm 10y ago
    I suspect that a certain company whose name starts with a 'G' has been doing just that while at the same time they were filling out their streetview database.
    - jk563 10y ago
      And if not, upon seeing this they will be filled with regret.
- ocdtrekkie 10y ago
  The big question for me is... does comma.ai intend to continue to build a public dataset? Because for companies like Google, their primary "value" is their data, that's what they won't share with everyone else, it's what gives them their edge. If a company was truly willing to share their large datasets down the road, that'd be a Big Deal.
  - EvgeniyZh 10y ago
    When you think about it, at least in Russia many people have video cameras in their cars, and you probably can buy their data for relatively small money, acquiring many hours of driving video. I'm surprised no company have done it yet.
    - trhway 10y ago
      probably you just wouldn't want to train your AI on Russian driving. I mean it is like R rated movies - you don't want to expose unprepared mind to it until it reaches stage of maturity that would allow to handle it :)
      - Animats 10y ago
        Using videos from vehicles in accidents could be useful. Take the last seconds before the accident, extract a top-view model, and try to train for ways to detect imminent trouble and avoid it.
    - ocdtrekkie 10y ago
      In fact, this is effectively comma.ai's strategy! They released an app called chffr which is a dashcam which records all your driving and sends it to them. https://www.youtube.com/watch?v=sD-8CteXJl4&list=PLlDK3GJKKjqr5kHsup39uklcFxPg67uTY https://www.youtube.com/watch?v=sD-8CteXJl4&list=PLlDK3GJKKj... As a privacy-minded person, I'll pass on participating in that, but it's an interesting approach to take, since they're a small company and can't afford to do Google-scale things like deploying company cars nationwide.
  - dharma1 10y ago
bbayer 10y ago
Author George Hotz, also known as geohot, is the author of first working iOS jailbrake. He decided to enter self driving car area[1]. Apparently he founded a new company called comma.ai [2] [1] http://www.bloomberg.com/features/2015-george-hotz-self-driving-car/ http://www.bloomberg.com/features/2015-george-hotz-self-driv... [2] http://comma.ai/ http://comma.ai/
- denzell 10y ago
  Once I read George Hotz.. I knew i recognized the name.
IshKebab 10y ago
Cool, but this really confirms what I suspected about Hotz's car all along. He's just done the 'easy' bit - output steering angle on easy highways. That was done in the 80s (slower admittedly, but still). Wake me up when it can drive here (to pick a random example): https://www.google.co.uk/maps/place/London/@52.1986058,0.1433238,3a,75y,19.57h,82.48t/data=!3m7!1e1!3m5!1saA9p1edgcTokW-f7AhejPg!2e0!6s%2F%2Fgeo3.ggpht.com%2Fcbk%3Fpanoid%3DaA9p1edgcTokW-f7AhejPg%26output%3Dthumbnail%26cb_client%3Dmaps_sv.tactile.gps%26thumb%3D2%26w%3D203%26h%3D100%26yaw%3D80.355255%26pitch%3D0!7i13312!8i6656!4m5!3m4!1s0x47d8a00baf21de75:0x52963a5addd52a99!8m2!3d51.5073509!4d-0.1277583!6m1!1e1?hl=en https://www.google.co.uk/maps/place/London/@52.1986058,0.143...
- ocdtrekkie 10y ago
  Pretty much all most self-driving efforts has done is "the easy bit". Google's record is primarily focused on bragging about miles driven. And glossing over the fact the hundreds (or thousands?) of times their test drivers have to take over, presumably in difficult areas like intersections. If you see someone bragging about their "miles driven" as a key statistic, you should be wary of their actual accomplishment. Because racking up miles down a straight stretch of road is easy. There's a massive amount of hype in the area, and a terrifyingly small amount of actual substance.
  - Retric 10y ago
    Google is driving in urban traffic which is never easy. Tesla is being driven 'by customers' an thus out of the companies control. Look at any of the accident tapes and these are generally situations where people would likely also cause an accident. Just look at the number of people rear ended for daring to stop at a stop light.
    - ocdtrekkie 10y ago
      The problem is Google's most bragged about statistic, miles driven, ignores the frequency at which test drivers intervened to prevent accidents. Google reports yearly to the California DMV how many disengages the system had, both due to driver intervention and due to system failure on the part of the self-driving system. They also report how many accidents would've occurred if test drivers hadn't intervened. Those numbers are staggering, if you read the reports, and it's incredible that people believe these vehicles are anywhere near as safe as human drivers. We are nowhere near the point where you could remove the steering wheel... something Google has begged legislators to let them do. The important statistics about self-driving car safety are NOT the statistics Google is telling Congress or the media about their cars.
Animats 10y ago
This creates a model for driving that totally ignores things that can go wrong. It will work great in the normal case, and totally screw up if anything unusual happens. There's no model of "obstacle" or "oncoming vehicle". That's unsafe. This is a field where bug reports are written in blood.

100 points by EvgeniyZh 10y ago

This is very cool. I believe scientific papers, especially in the AI space, should habitually share all data that was used so others can repeat and build on the results. That said, a few hours of highway driving is of course woefully inadequate for learning anything but steering in normal conditions on that particular highway, if even that. So this is not the "build your Tesla Autopilot" kit, even though the OP decided to use the word “autopilot” in the title.

EvgeniyZh 10y ago
> This is very cool. I believe scientific papers, especially in the AI space, should habitually share all data that was used so others can repeat and build on the results. I believe the problem here is that most AI researches are commercial and not scientific, so no data. > even though the OP decided to use the word “autopilot” in the title. Yeah it might be a bit misleading. Honestly, I had some problems with formulating title in English
- metafunctor 10y ago
  > I believe the problem here is that most AI researches are commercial and not scientific, so no data. One would hope that OpenAI [1] would come through with some significant data sets for various areas in the future. There are some significant commercial names backing up the initiative (like Musk), so hopefully they will actually be relatively open and not protecting corporate interest until end of time. [1] https://openai.com/ https://openai.com/
dharma1 10y ago
Most papers use public data sets. I agree there should be more public data sets, for nearly everything. Having said that - what's the cost of doing something like this yourself? 7 hours of driving video, plus the positional/steering/etc data? Should be easy for almost anyone with enough inclination to gather hundreds of hours of data like this, if you really wanted to.
- jacquesm 10y ago
  I suspect that a certain company whose name starts with a 'G' has been doing just that while at the same time they were filling out their streetview database.
  - jk563 10y ago
    And if not, upon seeing this they will be filled with regret.
ocdtrekkie 10y ago
The big question for me is... does comma.ai intend to continue to build a public dataset? Because for companies like Google, their primary "value" is their data, that's what they won't share with everyone else, it's what gives them their edge. If a company was truly willing to share their large datasets down the road, that'd be a Big Deal.
- EvgeniyZh 10y ago
  When you think about it, at least in Russia many people have video cameras in their cars, and you probably can buy their data for relatively small money, acquiring many hours of driving video. I'm surprised no company have done it yet.
  - trhway 10y ago
    probably you just wouldn't want to train your AI on Russian driving. I mean it is like R rated movies - you don't want to expose unprepared mind to it until it reaches stage of maturity that would allow to handle it :)
    - Animats 10y ago
      Using videos from vehicles in accidents could be useful. Take the last seconds before the accident, extract a top-view model, and try to train for ways to detect imminent trouble and avoid it.
  - ocdtrekkie 10y ago
    In fact, this is effectively comma.ai's strategy! They released an app called chffr which is a dashcam which records all your driving and sends it to them. https://www.youtube.com/watch?v=sD-8CteXJl4&list=PLlDK3GJKKjqr5kHsup39uklcFxPg67uTY https://www.youtube.com/watch?v=sD-8CteXJl4&list=PLlDK3GJKKj... As a privacy-minded person, I'll pass on participating in that, but it's an interesting approach to take, since they're a small company and can't afford to do Google-scale things like deploying company cars nationwide.
- dharma1 10y ago

bbayer 10y ago

Author George Hotz, also known as geohot, is the author of first working iOS jailbrake. He decided to enter self driving car area[1]. Apparently he founded a new company called comma.ai [2] [1] http://www.bloomberg.com/features/2015-george-hotz-self-driving-car/ http://www.bloomberg.com/features/2015-george-hotz-self-driv... [2] http://comma.ai/ http://comma.ai/

denzell 10y ago
Once I read George Hotz.. I knew i recognized the name.

IshKebab 10y ago

Cool, but this really confirms what I suspected about Hotz's car all along. He's just done the 'easy' bit - output steering angle on easy highways. That was done in the 80s (slower admittedly, but still). Wake me up when it can drive here (to pick a random example): https://www.google.co.uk/maps/place/London/@52.1986058,0.1433238,3a,75y,19.57h,82.48t/data=!3m7!1e1!3m5!1saA9p1edgcTokW-f7AhejPg!2e0!6s%2F%2Fgeo3.ggpht.com%2Fcbk%3Fpanoid%3DaA9p1edgcTokW-f7AhejPg%26output%3Dthumbnail%26cb_client%3Dmaps_sv.tactile.gps%26thumb%3D2%26w%3D203%26h%3D100%26yaw%3D80.355255%26pitch%3D0!7i13312!8i6656!4m5!3m4!1s0x47d8a00baf21de75:0x52963a5addd52a99!8m2!3d51.5073509!4d-0.1277583!6m1!1e1?hl=en https://www.google.co.uk/maps/place/London/@52.1986058,0.143...

ocdtrekkie 10y ago
Pretty much all most self-driving efforts has done is "the easy bit". Google's record is primarily focused on bragging about miles driven. And glossing over the fact the hundreds (or thousands?) of times their test drivers have to take over, presumably in difficult areas like intersections. If you see someone bragging about their "miles driven" as a key statistic, you should be wary of their actual accomplishment. Because racking up miles down a straight stretch of road is easy. There's a massive amount of hype in the area, and a terrifyingly small amount of actual substance.
- Retric 10y ago
  Google is driving in urban traffic which is never easy. Tesla is being driven 'by customers' an thus out of the companies control. Look at any of the accident tapes and these are generally situations where people would likely also cause an accident. Just look at the number of people rear ended for daring to stop at a stop light.
  - ocdtrekkie 10y ago
    The problem is Google's most bragged about statistic, miles driven, ignores the frequency at which test drivers intervened to prevent accidents. Google reports yearly to the California DMV how many disengages the system had, both due to driver intervention and due to system failure on the part of the self-driving system. They also report how many accidents would've occurred if test drivers hadn't intervened. Those numbers are staggering, if you read the reports, and it's incredible that people believe these vehicles are anywhere near as safe as human drivers. We are nowhere near the point where you could remove the steering wheel... something Google has begged legislators to let them do. The important statistics about self-driving car safety are NOT the statistics Google is telling Congress or the media about their cars.

Animats 10y ago

This creates a model for driving that totally ignores things that can go wrong. It will work great in the normal case, and totally screw up if anything unusual happens. There's no model of "obstacle" or "oncoming vehicle". That's unsafe. This is a field where bug reports are written in blood.