10 ms·
Researchers shrink camera to the size of a salt grain
- kumarvvr 5y agoSo, this lens is using machine learning to understand the behavior of an individual lens, using supervised training, and then that ML model is used to decipher all other input images? Did I understand that right?
- xwdv 5y agoCould two of these cameras create stereoscopic videos that can let us feel what it would be like to be so tiny?
- FredPret 5y agoConversely, imagine dual orbiting telescopes feeding into VR glasses giving us the perspective of a planet-scaled monster
- williamtrask 5y ago…something something privacy…
- hellbannedguy 5y agoI've given up on privacy. Cameras will be watching our every step. The only positive is it might make cops/feds more honest if they know they are being recorded at every step?
- inter_netuser 5y agoeven if banned legally, the amounts of illegal surveillance will be mindboggling. It'll only keep shrinking, until it is the size of dust particles, just another order of magnitude. How do you prevent dust-cameras from being around? a pre-emptive EMP pulse lol?
- f3rnando 5y agoYou are overthinking here: 1- Actually, the main problem with privacy is that most people still doesnt really care and many more underestimates its current reach, if this were somehow to happen, proably it would raise awareness and that is of topmost priority. 2- Its is already mindboggling. 3- A spy needs privacy to spy.
- deleted 5y ago[deleted]
- bitwize 5y agoLocalizers are a thing now.
- cardamomo 5y agoI had the same thought! Now, can they create a mesh network and operate as a distributed processor?
- SECProto 5y agoAnd perhaps most importantly, do they have a low enough weight-surface area ratio that they float, and low enough power requirements to be powered by almost indetectable microwave pulses
- 14 5y agoIncredible. I guess the first use I thought of was swallowing the camera to identify bowel issues. Can’t wait to see what they come up with.
- kkaranth 5y agoThat's mentioned in the article > Enabled by a joint design of the camera’s hardware and computational processing, the system could enable minimally invasive endoscopy with medical robots to diagnose and treat diseases, and improve imaging for other robots with size and weight constraints. Arrays of thousands of such cameras could be used for full-scene sensing, turning surfaces into cameras. There are existing swallowable capsule endoscopy devices like the PillCam[1], the entirety of which is 11mm x 26mm[2] [1] https://www.medtronic.com/covidien/en-us/products/capsule-endoscopy/pillcam-crohns-system.html https://www.medtronic.com/covidien/en-us/products/capsule-en... [2] https://www.hopkinsmedicine.org/johns_hopkins_bayview/_docs/medical_services/gastroenterology/pill_cam_sb_faqs.pdf https://www.hopkinsmedicine.org/johns_hopkins_bayview/_docs/...
- daveguy 5y agoIf it could see through feces, that would be awesome. The worst part, by far, of a colonoscopy is the prep. And the prep is needed for a clean view. A smaller camera isn't going to help with cleaning things up. Improving the optical clarity of existing small-scope procedures (like cardioscope) would probably be the first application.
- inter_netuser 5y agowhat prep did you use? Afaik, GIs much rather prefer to use the scope, and would only use pillcam if everything but the small intestine hasn't been ruled out.
- trompetenaccoun 5y agoIt will be used to spy on us.
- shrimpx 5y agoThat guy Felix Heide is a research powerhouse. He and his group published 4 papers in SIGGRAPH 21, 7 papers in CVPR 21 and 6 papers in CVPR 2020, wow. https://www.cs.princeton.edu/~fheide/ https://www.cs.princeton.edu/~fheide/
- sjtindell 5y agoAre we seeing more people on this path where you get tenure (has to be one of the most secure jobs possible) and then launch companies from that foundation? It meshes so well, incredibly competitive though. Perhaps I’m just noticing more.
- shrimpx 5y agoIt sounds like in the case of Felix, he started his company while he was a Ph.D. student.
- sytelus 5y agoThis usually implies he has great funding sources and very large lab. Being a "powerhouse" as a researcher is probably a different thing.
- oceanghost 5y agoI know nothing about this person, but if his case is the average, he's probably got a lot of grad students doing the actual work. I can't tell you how many papers/patents I wrote only to be listed as the 5th contributor or some such thing.
- rudyfink 5y agoI'd love to see a paper looking at this (e.g., how often is the "primary" author the last author or is the last author a better predictor of quality than the first, if you look back historically). I suspect this is very widespread issue.
- 5y ago
- dtgriscom 5y agoThe article keeps saying "camera", but we only see the lens. How big is the sensor and cabling?
- cvakang 5y agoYes, I had the same question. But if the lens miniaturised so does the rest. Imagine swallowing this and getting picturs of your inside of body in a smart phone.
- nine_k 5y agoThere is a diffraction limit, which is not very small for visible light. Making a pixel grid that would resolve very tiny details may be hard. OTOH the light sensor needs not be as small. Imagine a thin optical fiber with such a lens on one end, and a large lens and large enough camera on the other end. In could immediately make a better and less invasive endoscope, e.g. for surgery.
- codingdave 5y agoThat already exists - the term is "capsule endoscopy" if you want to find out more. But -- it is a big pill to swallow. A smaller and better camera could both make the experience better for the patient and improve results, so this is still a good step to improvements.
- brazzy 5y ago> But if the lens miniaturised so does the rest. Not necessarily. I recently looked into miniature cameras for self- built drones. For less than $50, you can get a package with a lens that's maybe 2-3mm across. The entire sensor+lens unit is roughly 1cm cubed. But then you need the electronics to process and store the image, and you're up to credit card size. And then you need a battery, and not a tiny one because that image processing draws quite a bit of juice.
- euler2100 5y agoMind sharing the link for such small camera sensors and lenses?
- JoeAltmaier 5y agoSo privacy will evaporate. Imagine dropping millions of these from a drone, carpeting a city. They'd be carried everywhere on clothing, animals, wind. Go to any location and scan for local cameras, download. Privacy will have to be redefined. We've done this lots of times. You hear what goes on behind the bathroom door, you don't say anything, you actually forget it. Because it's not polite to snoop. So in future even if you see something you shouldn't on camera, it'd be boorish to mention it. That doesn't solve the police state of course.
- dataflow 5y ago> Imagine dropping millions of these from a drone, carpeting a city. Doesn't it still need a source of power?
- roywiggins 5y agoThere's at least some power to be pulled from ambient radio waves. No idea if it would be enough to power these things. https://phys.org/news/2017-08-ambient-energy-power-internet.html https://phys.org/news/2017-08-ambient-energy-power-internet.... Or combine it with photovoltaics: https://www.smart2zero.com/news/self-powered-camera-sensor-combines-imaging-energy-harvesting https://www.smart2zero.com/news/self-powered-camera-sensor-c...
- JoeAltmaier 5y agoRFID tags have no power source, and can do significant processing. As others mention, ambient electromagnetic fields can be harvested with a loop antenna.
- f3rnando 5y ago13 days ago: https://news.ycombinator.com/item?id=29255511 https://news.ycombinator.com/item?id=29255511 ("How to grow sodium chloride crystals at home")
- legostormtroopr 5y agoHow is this relevant to the conversation? Did you see salt grain and assume it was a dupe?
- Cyclical 5y agoVery cool! Fantastic that they were able to do this in silicon nitride, as that'll make commercialization and scalability much easier. Nitride is one of the more common MEMS manufacturing materials, and from the (admittedly tiny, which makes sense since they're trying to commercialize) fabrication section of the paper it seems like they're using a standard RIE process to manufacture the optical posts. I'm interested to know how they controlled for the isotropy of the plasma process without using DRIE, which is frequently used for these kinds of high aspect-ratio devices.
- fraiz 5y agoProject website is here: https://light.princeton.edu/neural-nano-optics/ https://light.princeton.edu/neural-nano-optics/
- kingcharles 5y agoThe sample photos are impressive.
- deleted 5y ago[deleted]
- interfixus 5y agoCompletely unsurprising of course, but still the second-scariest thing I've read this morning and actually for quite a while. The scariest is sophisticated, well-informed and higly intelligent HN commenters in this thread who seem to be bubbling over with unbridled enthusiasm.
- Krisjohn 5y ago... and use it to photograph a "close ad" button.
- fitzn 5y agoThis is wild.
- dookahku 5y agoIn the future, everyone will be nude on the internet for 15 minutes
- shahar2k 5y agothis is fun stuff, my uncle did quite a bit of development on micro cameras he worked on and made quite a bit on the patent for the first ingestible pill camera, and had some even smaller cameras for other medical devices that were even smaller (and fun to play with when I've visited a few years back) I also bet many of these lenses can be stacked together to create a nice lightfield display...
- fingerlocks 5y agoImagine a matrix of tightly-packed pixel sized micro-cameras opposite of a similarly sized LED screen. You could project the camera image on the screen and make the entire object appear roughly invisible. If we had a full body suit made of tiny cameras behind translucent LEDs, could we have invisibility/cloaking suits? Is this remotely feasible with current technology? Serious question.
- ei8htyfi5e 5y agoFor invisibility to work like that for more than one viewing angle you would need to add the initial number of pixels for each angle you want to support. So it’s unlikely to work even at small sizes. So 10 angles, you’d need 10x the original number of pixels.
- nine_k 5y agoThis works for very narrow FOVs, though. E.g. a stealth aircraft can absorb the radar signal, analyze its direction (using a phased antenna array) and send back a "reflection from earth" with a proper delay. This renders the aircraft effectively invisible to the radar, provided that the covering of the aircraft indeed does not reflect much back.
- fingerlocks 5y agoWith facial detection and one observer, we could orient our projection as the viewing angle changes. It wouldn’t be true invisibility, but maybe at best a Predator-style fuzzy cloak?
- oblio 5y agoAnd even if we somehow made the physics work for the actual displays, I can't even fathom how much computing power you'd need to push all those pixels around to make it look realistic.
- tdrdt 5y agoIf you take a look at the paper it is only about the optics. Which is still a big achievement, but I think the complete system is a little bit bigger than a grain of salt. So the article should be taken with a grain of salt as well. https://light.princeton.edu/publication/neural-nano-optics/ https://light.princeton.edu/publication/neural-nano-optics/
- hutrdvnj 5y ago> I think the complete system is a little bit bigger than a grain of salt. How much bigger, does anyone know or can estimate?
- ksec 5y ago>Neural nano-optics outperform existing state-of-the-art metasurface lens designs in broadband and it is the first meta-optic imager that achieves high-quality, wide field-of-view color imaging. Am I correct in saying this is still a Metalens but getting Neural / ML enhanced?
- mensetmanusman 5y agoYou could make a rice array located at various locations around a room and reconstruct an image through post processing.
- deleted 5y ago[deleted]
- mnw21cam 5y agoI thought metasurfaces were limited to handling a single wavelength, but this claims to be capable of full colour images. Anyone have a handle on how that works?
- Gravityloss 5y agoIs the neural network fixed, ie the same for different subjects? Ie how much of the image is filled in by it? I would like to see multiple photos of different subjects to gauge how much is just generated detail by the network.
- alexpotato 5y agoI remember years ago watching a show on potential future technologies and one of the people being interviewed mentioned the following: "One day, your child will be able to go to a dollar store and buy sheet of sticker cameras. These cameras will be paper thin, can be stuck anywhere and will have their own internet address that can be accessed over the public internet from a browser. Everything I just described is technically possible now, it's just not been put together and some of the components aren't cheap enough. As a society, we should be prepared for the ramifications of this." Research and advancements like this make the above feel like it's getting closer and closer to the above.
- curryst 5y agoAn ESP32-CAM isn't far off. It's got a sticker sized footprint already. If you cut off the pins, the PCB is thicker than a sticker and the camera is a centimeter or two long, but they're like $10 a piece for ones with a camera and an SD slot.
- LargoLasskhyfv 5y agoThere are so many microcontrollers which could be packed behind this, in a sandwiched way, behind the CCD which captures the light. Think of the stuff that's on your Smart-/Chipcards, like Credit/Debit/Banking/ID/Drivers License/... The thing under the golden metal contact plate has a diameter of about 5 millimeters, yet it is able to perform a subset of something like Java. The same goes for the SIM in your phone, or a Micro-SD Card. There the Microcontroller serves the interface on one end, and acts as a RAID-controller for the arrays of NAND-storage on the other end. This can all be hidden behind that, layered underneath each other. The biggest thing would be battery to power it, or the coils to harvest energy from WIFI, or whatever. Combine that with circuitry which only wakes up the system when the image is changing, and your're good to go, ...err spy ;->
- mgdev 5y agoCan the optics be used in reverse, as a short-range projector? Very interesting AR applications if so...