8 ms·
Pixelopolis, a self-driving car demo from Google I/O built with TensorFlow-Lite
- axegon_ 6y agoDamn it... Just before the pandemic I had started piling up hardware to start building something similar(I was intending to use a raspberry pi). And since I couldn't go and look for parts in person(I'm not that crafty with my hands so I genuinely need to see in person the part in order to be able to tell if it's going to work) so I postponed it. And today I see this... Feeling kind of sucks, even though I can't really explain why.
- speedgoose 6y agoYou should still do it! I'm sure you will have a lot of fun, and it's perfectly normal to do something that has already been done before, it happens all the time. Your solution doesn't have to be better, but it will be different and interesting.
- axegon_ 6y agoGot other things lined up at the moment for better or worse, might go back to it at some point. It's just that "the Simpsons did it" kind of feeling, you know...
- ponker 6y agoIf you think it sucks that your idea was done before you by... Google ... you need to cut yourself some more slack.
- Polylactic_acid 6y agoI'm just stunned at how much effort they went in to carving and painting wood.
- sdenton4 6y agoGotta use that army of UX Designers for something...
- throwaway6000 6y agoYou can create a more robust version using nvidia jetson nano/xavier instead of raspberry pi.
- sandGorgon 6y agodoes anyone how the android phone is interfacing with the rest of the car hardware ? i did not know that android phones could do realtime i/o like this. Is this the "Android Things" or "Android Accessory Protocol" ?
- lucasmerlin 6y agoMaybe via bluetooth? I'd imagine that would be the easiest way.
- deleted 6y ago[deleted]
- izacus 6y agoIt doesn't quite say in the article but I'd guess that they're using USB connection with accessory protocol based on: - Their chosen controller doesn't have Bluetooth. - The images show phone cradle having cable connection to the phone. - There's an off remark in the motor segment that they made the external board power the phone implying they were connected before. - It's the easiest way and supported by Android APIs. Android Things as a project is dead and it never ran on phones - it was always meant to power IoT devices with screen.
- donquichotte 6y agoIt's in TFA: "the Pixel 4 also controls the motors and other electronic components via USB-C". There's an STM32 micro-controller which presumably acts as an USB slave and controls the servos.
- sandGorgon 6y agowhat SDK is this ? i have hunted and not found any easy way to do serial I/O over usb-C in the android SDK
- ezconnect 6y agoJust google "arduino android" the interface had been used by many projects for so many years.
- numpad0 6y agoInteresting that they went for expensive microcontroller based servos, I guess they consider Realtek chip RC cars to be just toys.
- Animats 6y agoThey were trying very hard to use Tensorflow. It's amusing that their first pre-training operation failed because they trained on straight roads. Direct camera to steering is possible but not really the best approach. Micromouse competition, 2019.[1] The first run, it's learning the maze. The second run is a speed run. [1] https://youtu.be/sKFIBQ64_zs https://youtu.be/sKFIBQ64_zs
- IshKebab 6y agoWell yeah, the whole point was to demonstrate Tensorflow.
- hendi_ 6y ago105.41 MB transferred Maybe think twice before putting a 40MB GIF on a website?
- StavrosK 6y agoWell how else are you going to do video on the web?!
- brutt 6y agoAnimated PNG?
- StavrosK 6y agoNow that's a billion dollar startup.
- forgingahead 6y agoBillion dollar startup or or billions in bandwidth costs?
- StavrosK 6y agoyes
- ape4 6y agoMNG https://en.wikipedia.org/wiki/Multiple-image_Network_Graphics https://en.wikipedia.org/wiki/Multiple-image_Network_Graphic...
- perryizgr8 6y agoEmbedded youtube?
- Abishek_Muthian 6y agoAmazon has been selling it's self-driving AWS Deep Racer car[1] and has been promoting race tournaments for a while now. Has anyone got that? Is it worth the price to test self-driving algorithms in the hopes of making it to the full sized vehicle one day or is it best we make our own self-driving toy card with Nvidia Jetson? [1]https://aws.amazon.com/deepracer/ https://aws.amazon.com/deepracer/
- lacker 6y agoI personally don’t but there’s a DIY robocars event near me where people compete in races using little self driving cars. Some people were using the AWS one but more popular in the “stock” division was the Donkeycar - https://diyrobocars.com/ https://diyrobocars.com/ https://github.com/autorope/donkeycar https://github.com/autorope/donkeycar I haven’t made one, I just go with my kids to show them how cool it is to be an engineer, but Donkeycar seems popular and performs well in the contests.
- Abishek_Muthian 6y agoThank you, donkey cars seems to be very approachable.
- dominotw 6y agoI want to but seems too expensive. I am not too interested in assembling a 'donkey car' either, just want to play with software for now.
- michaelt 6y agoMany robot competitions include a simulation league, where people who don't want to buy physical hardware can compete with a simulation of it. And being simulated means you never have a flat battery, and you can single-step your control code without hitting into something :)
- deleted 6y ago[deleted]
- praveen9920 6y agoWonderful. Are there any other "robotics" projects which use android phones instead of rasberry-pi or microcontrollers? Imagine in future there are generic robots. Rather than trusting its custom AI/processing, I can connect my phone to the robot and my phone gets hardware/robotic extension and is personalised for me. Its like ironman suit for my phone :)
- dekhn 6y agoFIRST uses android phones but they drive a hardware board that handles low-level stuff like motors.
- woile 6y agoCan this be scaled into building many small cities for self-driving cars training? Could it be used for real scale? Kind of like GTA V is used for training.
- pselbert 6y ago“Please excuse the crudity of this model. I didn’t have time to paint it or build it to scale” — Doc Emmett Brown (Decidedly not Google)
- domovoykot 6y agoThere is a definite resemblance to Duckietown[1], a robotics class/competition done developed at MIT. [1] https://www.duckietown.org/ https://www.duckietown.org/
- flemhans 6y agoWe had something similar at DTU in Denmark, albeit long before the times of TensorFlow and other “modern” ML. Lane keeping was a solved problem back then.
- quadrifoliate 6y agoOne thing I have always failed to understand about self-driving tech -- what's the motivation for each car to do its own self-driving computation in busy metropolitan areas? Are there technologies that integrate with some kind of existing infrastructure like beacons, etc. that would just tell the car where the streets are? If not, why not?
- fwip 6y agoIt's cheaper to buy a self-driving car than to augment every road the customer might want to drive on. Maybe if we were immediately jumping to 50% self-driving adoption it would be easier to make smart roads, but that's not the world we're living in yet.
- yardie 6y agoSmart roads have been attempted for years. Usually with some sort of antenna or wireless/light transmitter embedded in the road itself. The cost per mile was just too high. Far simpler to use what's already there with computer vision and map metadata. Now that cars have GPS, A-GPS, and RTK need to tailor roads for autonomous vehicles has been diminished.
- quadrifoliate 6y ago> The cost per mile was just too high. That's why I specified "in large metropolitan areas". I can see that it's impractical to outfit anything outside dense cities with such beacons, but inside the city they could augment, if not replace autonomous driving systems. Or so I imagine. > GPS, A-GPS, and RTK Thanks for telling me about RTK, I did not know about this!
- Redoubts 6y agoIn addition to the other replies, is path finding even enough? I think a lot of the hard part is dealing with arbitrary obstacles in the road which won't be playing nice with the centralized system.
- michaelt 6y agoGPS is already beacon infrastructure that tells cars where they are on the streets :) It cleverly got around our allergy to spending on infrastructure by being cold-war-era military technology.