6 ms·

Ask HN: Computer Vision Project Ideas?

2 points by sss111 5y ago

We're a team of 5 senior undergrads taking a grad level Machine Learning + Computer Vision class. If you have ever had an idea but never had time to implement it, let us know here!

kordlessagain 5y ago
It would be great to have a model extract images from a screenshot of a webpage, then save them as their own images with locations of where they came from on the page. I haven’t been able to find this solution, although I’ve been able to do it with a color flattened palette approach using opencv.
judohacker 5y ago
I want to point my phone at a stack of poker chips and get a total of each chip color, e.g. 132 blue chips, 54 red chips, etc. Bonus points if I can then tell the app the value of each color and get the total. I play cash games every week and it takes the host forever to count people's chips when they want to cash out.
- atatatat 5y ago
  Weigh them.
  - judohacker 5y ago
    Sure, or dunk them in a beaker of water. ;)
    - atatatat 5y ago
      One of those would be ridiculous at a poker game, hahaha
- deleted 5y ago
  [deleted]
BadCookie 5y ago
Occasionally, a child will die due to accidentally being left on a bus that overheats. This feels like a problem that could be solved with a camera or two on each bus plus some computer vision logic. This might almost be too “easy” of a project from a technical standpoint … but it is a real problem. Examples: https://english.kyodonews.net/news/2021/07/6d6979264de4-japan-nursing-school-head-may-face-charge-over-boys-death-in-bus.html https://english.kyodonews.net/news/2021/07/6d6979264de4-japa... https://www.latimes.com/local/lanow/la-me-ln-settlement-autistic-boy-death-20170612-story.html https://www.latimes.com/local/lanow/la-me-ln-settlement-auti...
ArtWomb 5y ago
It seems like bar code scanning is a 1980s technology. The auto checkout kiosk could have product recognition, pricing & checkout built in ;) State of the art in CV is remains video prediction: given N frames of patch input, generate the next frame. If you are into space exploration, there are a lot of cool datasets like the "Spot the GEO" challenge https://aiforspace.github.io/2021/ https://aiforspace.github.io/2021/ And if you get access to NVidia GPUs in the cluster, there's plenty of envelope pushing stuff you can do with Omniverse: AI for rendering, light transport, physics simulations, etc http://cs348i.stanford.edu/ http://cs348i.stanford.edu/
the_only_law 5y ago
I’m not super familiar with the domain or if it’s trivial or not, but many years ago I had a budding idea for a stupid AR game, where using a phone’s camera, you would view the world around and the game detect human faces real time, drawing over them and turning them into “enemies”. Also the idea, that many have shared of using CV to detect insects (say a cockroach) and then attacking it with some sort of weapon (everyone loves lasers, but a laser strong enough to kill an insect like that seems like it would introduce significant risk of collateral, so I wonder if instead a jet of household pesticide could be used). I wondered a while back if those little hexbug toys could be used for development.
- mod 5y ago
  Someone made a laser that shoots mosquitoes: https://nymag.com/intelligencer/2017/07/laser-shooting-mosquito-death-machine-nathan-myhrvold.html https://nymag.com/intelligencer/2017/07/laser-shooting-mosqu... While googling that so I could provide the link, I found a household robot that's doing the same thing: https://www.theawl.com/2017/01/i-love-this-robot-that-kills-mosquitos-with-a-laser/ https://www.theawl.com/2017/01/i-love-this-robot-that-kills-... Just thought you might be interested to know your idea exists.
Jefro118 5y ago
Identifying the elements within a GUI image (e.g. this is a button, that's an input field, etc.). I want this myself for a tool I'm building to turn Figma designs into code but it's also useful for things like automated testing. There are a bunch of papers on this already but no good public version that I can find. Probably companies like UIPath already have a sophisticated version of this internally. If you could do this and turn it into an API it would be quite valuable I think.
ShamelessC 5y ago
What sort of compute do you get access to? There's a lot of cool stuff you could do depending on whether or not you have decent GPU's and for how much time you're allowed to experiment on them. Experimentation is fairly fundamental in practice. There are a lot of pretraining tasks in vision/multimodal that are cool. Largely techniques introduced or refined by OpenAI re-implemented as pytorch open source codebases with varying degrees of success: - Finetune your own CLIP https://github.com/mlfoundations/open_clip https://github.com/mlfoundations/open_clip - Train a (much smaller) DALLE https://github.com/lucidrains/DALLE-pytorch https://github.com/lucidrains/DALLE-pytorch - Train your own guided diffusion https://colab.research.google.com/drive/1javQRTkALBWLFWnx1K4VpRZkWLP3ozhr https://colab.research.google.com/drive/1javQRTkALBWLFWnx1K4... (pretty tough, may only be feasible on domain-specific data) - Train a variational autoencoder (VAE) - "VQGAN" from Heidelberg https://github.com/CompVis/taming-transformers https://github.com/CompVis/taming-transformers - "Discrete VAE", used as the backbone for OpenAI's DALL-E, reimplimented here (and other places) https://github.com/lucidrains/DALLE-pytorch https://github.com/lucidrains/DALLE-pytorch - "VQVAE2" https://github.com/tgisaturday/dalle-lightning https://github.com/tgisaturday/dalle-lightning
hellohntoday 5y ago
Please can you post a way for me to get in touch.
- hellohntoday 5y ago
  My company has some pretty unique global shutter 360 camera footage, both indoors and out with precision GPS. Going back about 7 years. In all sorts of environments. It's quite a unique dataset and might be interesting to use for your project.
Raed667 5y ago
I have been going to the gym for the last couple of months. I would love to see an app that analyses my movements (dumbbell, barbell, kettlebell, etc..) and tell me how i can correct it.
- abrichr 5y ago
  I believe this is one of the services offered by https://www.curvhealth.com/ https://www.curvhealth.com/
no_time 5y ago
Predict the outcome of a roulette spin realtime. Write a fully machine vision aimbot for CSGO. Perhaps you could feed the mouse and keyboard input into the tracking algorithm to improve accuracy. You need to intercept the mouse input anyway to tamper with the game state. Predict a coin flip realtime. Write a program that retroactively looks for a certain cat in a security cam footage (I miss my cat). This is the one I actually attempted a while ago using a the most dumb method known to man: Since it was an orange cat on a mostly grey/green footage I just defined a color range from dark brownish orange to light brownish orange and parsed each frame of the recording. It didn't work that well without defining a lot of treshold rules. There are quite a few deterministic carnival/arcade games you could cheat with a bit of machine vision magic :^) Stacker comes to mind for example
- makersmasher 5y ago
  I have spent a bit of time googling, but really can't find a whole lot. I am feeling around in the dark, and have no experience with CV (but would like to learn). Do you happen to have any resources relating to the roulette idea?
  - no_time 5y ago
    this paper http://cktse.eie.polyu.edu.hk/pdf-paper/Chaos-1209.pdf http://cktse.eie.polyu.edu.hk/pdf-paper/Chaos-1209.pdf comes to mind. I admit, the mathematical model they came up with is somewhat above my head so I cannot attest how good it is. I just find the topic really intriguing.
    - makersmasher 5y ago
      Awesome, thanks!
ragebol 5y ago
Take your favorite broad or card game, recognize the game state and suggest an optimal move. I've created a bot for the card game Set years ago using classic computer vision. Should revisit that when I get my OAK-D Lite camera.
fragmede 5y ago
read video from my dash cam and tell me if my car will fit into a parallel parking space before I drive by it read video from my dash cam and classify at the vehicles around me for being a police car or not.
high_byte 5y ago
I'd like to convert FaceMesh (tensorflow) to Blend Shapes (aka morphs), like iPhone's LiveLink app but without iPhone. I have some solutions and workarounds but none are good enough.
jobigoud 5y ago
I have one that should be relatively easy: get popular magazines in PDF format and train a network to predict if a page is a full page ad or actual content. Then rebuild the PDF without the ads.

2 points by sss111 5y ago

We're a team of 5 senior undergrads taking a grad level Machine Learning + Computer Vision class. If you have ever had an idea but never had time to implement it, let us know here!

kordlessagain 5y ago

It would be great to have a model extract images from a screenshot of a webpage, then save them as their own images with locations of where they came from on the page. I haven’t been able to find this solution, although I’ve been able to do it with a color flattened palette approach using opencv.

judohacker 5y ago

I want to point my phone at a stack of poker chips and get a total of each chip color, e.g. 132 blue chips, 54 red chips, etc. Bonus points if I can then tell the app the value of each color and get the total. I play cash games every week and it takes the host forever to count people's chips when they want to cash out.

atatatat 5y ago
Weigh them.
- judohacker 5y ago
  Sure, or dunk them in a beaker of water. ;)
  - atatatat 5y ago
    One of those would be ridiculous at a poker game, hahaha
deleted 5y ago
[deleted]

BadCookie 5y ago

Occasionally, a child will die due to accidentally being left on a bus that overheats. This feels like a problem that could be solved with a camera or two on each bus plus some computer vision logic. This might almost be too “easy” of a project from a technical standpoint … but it is a real problem. Examples: https://english.kyodonews.net/news/2021/07/6d6979264de4-japan-nursing-school-head-may-face-charge-over-boys-death-in-bus.html https://english.kyodonews.net/news/2021/07/6d6979264de4-japa... https://www.latimes.com/local/lanow/la-me-ln-settlement-autistic-boy-death-20170612-story.html https://www.latimes.com/local/lanow/la-me-ln-settlement-auti...

ArtWomb 5y ago

It seems like bar code scanning is a 1980s technology. The auto checkout kiosk could have product recognition, pricing & checkout built in ;) State of the art in CV is remains video prediction: given N frames of patch input, generate the next frame. If you are into space exploration, there are a lot of cool datasets like the "Spot the GEO" challenge https://aiforspace.github.io/2021/ https://aiforspace.github.io/2021/ And if you get access to NVidia GPUs in the cluster, there's plenty of envelope pushing stuff you can do with Omniverse: AI for rendering, light transport, physics simulations, etc http://cs348i.stanford.edu/ http://cs348i.stanford.edu/

the_only_law 5y ago

I’m not super familiar with the domain or if it’s trivial or not, but many years ago I had a budding idea for a stupid AR game, where using a phone’s camera, you would view the world around and the game detect human faces real time, drawing over them and turning them into “enemies”. Also the idea, that many have shared of using CV to detect insects (say a cockroach) and then attacking it with some sort of weapon (everyone loves lasers, but a laser strong enough to kill an insect like that seems like it would introduce significant risk of collateral, so I wonder if instead a jet of household pesticide could be used). I wondered a while back if those little hexbug toys could be used for development.

mod 5y ago
Someone made a laser that shoots mosquitoes: https://nymag.com/intelligencer/2017/07/laser-shooting-mosquito-death-machine-nathan-myhrvold.html https://nymag.com/intelligencer/2017/07/laser-shooting-mosqu... While googling that so I could provide the link, I found a household robot that's doing the same thing: https://www.theawl.com/2017/01/i-love-this-robot-that-kills-mosquitos-with-a-laser/ https://www.theawl.com/2017/01/i-love-this-robot-that-kills-... Just thought you might be interested to know your idea exists.

Jefro118 5y ago

Identifying the elements within a GUI image (e.g. this is a button, that's an input field, etc.). I want this myself for a tool I'm building to turn Figma designs into code but it's also useful for things like automated testing. There are a bunch of papers on this already but no good public version that I can find. Probably companies like UIPath already have a sophisticated version of this internally. If you could do this and turn it into an API it would be quite valuable I think.

ShamelessC 5y ago

What sort of compute do you get access to? There's a lot of cool stuff you could do depending on whether or not you have decent GPU's and for how much time you're allowed to experiment on them. Experimentation is fairly fundamental in practice. There are a lot of pretraining tasks in vision/multimodal that are cool. Largely techniques introduced or refined by OpenAI re-implemented as pytorch open source codebases with varying degrees of success: - Finetune your own CLIP https://github.com/mlfoundations/open_clip https://github.com/mlfoundations/open_clip - Train a (much smaller) DALLE https://github.com/lucidrains/DALLE-pytorch https://github.com/lucidrains/DALLE-pytorch - Train your own guided diffusion https://colab.research.google.com/drive/1javQRTkALBWLFWnx1K4VpRZkWLP3ozhr https://colab.research.google.com/drive/1javQRTkALBWLFWnx1K4... (pretty tough, may only be feasible on domain-specific data) - Train a variational autoencoder (VAE) - "VQGAN" from Heidelberg https://github.com/CompVis/taming-transformers https://github.com/CompVis/taming-transformers - "Discrete VAE", used as the backbone for OpenAI's DALL-E, reimplimented here (and other places) https://github.com/lucidrains/DALLE-pytorch https://github.com/lucidrains/DALLE-pytorch - "VQVAE2" https://github.com/tgisaturday/dalle-lightning https://github.com/tgisaturday/dalle-lightning

hellohntoday 5y ago

Please can you post a way for me to get in touch.

hellohntoday 5y ago
My company has some pretty unique global shutter 360 camera footage, both indoors and out with precision GPS. Going back about 7 years. In all sorts of environments. It's quite a unique dataset and might be interesting to use for your project.

Raed667 5y ago

I have been going to the gym for the last couple of months. I would love to see an app that analyses my movements (dumbbell, barbell, kettlebell, etc..) and tell me how i can correct it.

abrichr 5y ago
I believe this is one of the services offered by https://www.curvhealth.com/ https://www.curvhealth.com/

no_time 5y ago

Predict the outcome of a roulette spin realtime. Write a fully machine vision aimbot for CSGO. Perhaps you could feed the mouse and keyboard input into the tracking algorithm to improve accuracy. You need to intercept the mouse input anyway to tamper with the game state. Predict a coin flip realtime. Write a program that retroactively looks for a certain cat in a security cam footage (I miss my cat). This is the one I actually attempted a while ago using a the most dumb method known to man: Since it was an orange cat on a mostly grey/green footage I just defined a color range from dark brownish orange to light brownish orange and parsed each frame of the recording. It didn't work that well without defining a lot of treshold rules. There are quite a few deterministic carnival/arcade games you could cheat with a bit of machine vision magic :^) Stacker comes to mind for example

makersmasher 5y ago
I have spent a bit of time googling, but really can't find a whole lot. I am feeling around in the dark, and have no experience with CV (but would like to learn). Do you happen to have any resources relating to the roulette idea?
- no_time 5y ago
  this paper http://cktse.eie.polyu.edu.hk/pdf-paper/Chaos-1209.pdf http://cktse.eie.polyu.edu.hk/pdf-paper/Chaos-1209.pdf comes to mind. I admit, the mathematical model they came up with is somewhat above my head so I cannot attest how good it is. I just find the topic really intriguing.
  - makersmasher 5y ago
    Awesome, thanks!

ragebol 5y ago

Take your favorite broad or card game, recognize the game state and suggest an optimal move. I've created a bot for the card game Set years ago using classic computer vision. Should revisit that when I get my OAK-D Lite camera.

fragmede 5y ago

read video from my dash cam and tell me if my car will fit into a parallel parking space before I drive by it read video from my dash cam and classify at the vehicles around me for being a police car or not.

high_byte 5y ago

I'd like to convert FaceMesh (tensorflow) to Blend Shapes (aka morphs), like iPhone's LiveLink app but without iPhone. I have some solutions and workarounds but none are good enough.

jobigoud 5y ago

I have one that should be relatively easy: get popular magazines in PDF format and train a network to predict if a page is a full page ad or actual content. Then rebuild the PDF without the ads.