vladoh

10 ms·

1. 61.▲
   Reddit Place(youtube.com)

   2 points by vladoh 6y ago|2 comments
2. 62.▲
   Why Augmented Reality Is the Future of Interior Design Industry(blog.primer.com)

   2 points by vladoh 6y ago|0 comments
3. 63.▲
   MetaKovan on His $69m Purchase of Beeple's Everydays, the Metaverse, and NFTs(youtube.com)

   1 points by vladoh 6y ago|0 comments
4. 64.▲
   A Drone Went Bowling. Hollywood Noticed(nytimes.com)

   3 points by vladoh 6y ago|0 comments
5. 65.▲
   Alicia Boole Stott(en.wikipedia.org)

   3 points by vladoh 6y ago|0 comments
6. 66.▲
   by vladoh 6y ago

   Yeah, it's a 2 GB file, so it hits the quota limit on the Google Drive pretty fast. There is a problem with the mirror at transfer.army that I'll fix today.
7. 67.▲
   Aphantasia: Text-to-image tool for creating art(github.com)

   14 points by vladoh 6y ago|0 comments
8. 68.▲
   by vladoh 6y ago

   This is one of my projects using OpenAI's CLIP model to do interesting things. So the big credit goes to them! I processed 2M images from the Unsplash dataset with CLIP and stored the feature vector representation of each photo (a 512
9. 69.▲
   Show HN: Search photos on Unsplash using natural language queries(github.com)

   6 points by vladoh 6y ago|3 comments
10. 70.▲
    by vladoh 6y ago

    This is a small side project I built to see how people play the game of Iterated Prisoner's Dilemma. It is funny to see how many people concentrate on beating the bot, instead of maximizing their score... You can find the bot on Twitte
11. 71.▲
    Show HN: Bot that plays Prisoner's Dilemma on Twitter(github.com)

    5 points by vladoh 6y ago|1 comments
12. 72.▲
    by vladoh 6y ago

    This is a small side project I built to see how people play the game of Iterated Prisoner's Dilemma. It is funny to see how many people concentrate on beating the bot, instead of maximizing their score... The code of the bot is availab
13. 73.▲
    Show HN: Twitter bot that plays Prisoner's Dilemma(twitter.com)

    3 points by vladoh 6y ago|1 comments
14. 74.▲
    by vladoh 6y ago

    I think we will get there soon! CLIP is a new model that OpenAI published in January and I'm sure Google is working on similar technology, which can be used for both video and image search.
15. 75.▲
    by vladoh 6y ago

    You feel like this, because you are right :) Just search online for "google captcha self driving".
16. 76.▲
    by vladoh 6y ago

    CLIP is quite a new model published by OpenAI in January. Their work is novel and pushed the state-of-the-art in this area by a lot. I'm sure that Google is also working on similar applications. And I think they already have something
17. 77.▲
    by vladoh 6y ago

    Yeah, indexing all YouTube videos is surely possible, but out of the scope of a personal project :)
18. 78.▲
    by vladoh 6y ago

    I haven't read the Terms of Use in details, but I guess it depends on what you do with the data. I actually don't store, distribute or sell the videos, so I hope it is OK in the scope of such personal project :)
19. 79.▲
    by vladoh 6y ago

    Cool application! I wasn't aware that there are so many images available on Steam...
20. 80.▲
    by vladoh 6y ago

    I think this is a valuable application, but I don't think CLIP is well suited for it. The power of CLIP comes from training a model to jointly "understand" text and images. If you are looking at identifying a particular perso
21. 81.▲
    by vladoh 6y ago

    Thanks for sharing! :) Yes, the feature computation on the images has to be sone only once and the representation is very efficient - 512 float16 values per image.
22. 82.▲
    by vladoh 6y ago

    Yes, this is definitely possible. You can maybe try computing some kind of image distance between frames or some keyframe extraction. Once you compute the features, the search is very efficient! I tried it for searching in the 2M photos dat
23. 83.▲
    by vladoh 6y ago

    There is one caveat to be aware of - the image is cropped to a square in the center and scaled down to 224x224. So small details will be lost, for example if you want to run it on scanned documents. Photos work great though. I tried it on t
24. 84.▲
    by vladoh 6y ago

    I think it can. However, you will likely need a bigger model. Currently, OpenAI shares only their small model and I hope they will soon release bigger ones!
25. 85.▲
    by vladoh 6y ago

    I pushed a small update and you will now see a heatmap displaying the score of the search query for each frame.
26. 86.▲
    by vladoh 6y ago

    Yes, this is the actual problem...
27. 87.▲
    by vladoh 6y ago

    Yes, I know that this is a bit slow. The problem is you really need 1.7.1, because 1.7.0 leads to some strange issues and broken results: https://github.com/openai/CLIP/issues/13#issuecomment-771143...
28. 88.▲
    by vladoh 6y ago

    Not yet, but I had this idea as well. You basically get a score describing how well a phrase is matching each of the images so it won't be difficult to do. I'll look into that!
29. 89.▲
    by vladoh 6y ago

    Hmm, this is strange... The Colab notebook should load even if you are not logged in with your Google account (you will need to log in if you want to run it, though).
30. 90.▲
    by vladoh 6y ago

    This is a demonstration of the abilities of OpenAI's CLIP neural network. The tool will download a YouTube video, extract frames at regular intervals and precompute the feature vectors of each frame using CLIP. You can then use natural