18 ms·
The authors use a GPT model to write Python code that computes the answer to a natural-language query about a given image or video clip. The results are magica
by cs702 4y ago
The authors use a GPT model to write Python code that computes the answer to a natural-language query about a given image or video clip.
The results are magical: https://viper.cs.columbia.edu/static/videos/teaser_web.mp4 https://viper.cs.columbia.edu/static/videos/teaser_web.mp4
- famouswaffles 4y agoMan you're going to love this. https://multimodal-react.github.io/ https://multimodal-react.github.io/ Just incredible
- LrnByTeach 4y agoI suspect GPT5 most likely will have these capabilities that is to hook into external tools such as calculators and other software applications as needed based on the prompts.
- famouswaffles 4y agoYou can already hook GPT models to whatever tools you need. Open ai are focused on improving implicit performance as much as possible.
- goldwelder42 4y agoSince the GPT-4 paper didn't reveal any details of their model, it's possible that GPT-4 is already using some variant of toolformer (https://arxiv.org/abs/2302.04761 https://arxiv.org/abs/2302.04761).
- optimalsolver 4y agoIf it was, its mathematical abilities would be much better than they are.
- MacsHeadroom 4y agoGPT-4's mathematical abilities are exceptionally good compared to GPT-3.5.
- cdchn 4y agoI suspect GPT5 won't have that ability, when used in something like ChatGPT but OpenAI will happily let the people who want to do that themselves do it, and push the consequences to them.
- sharemywin 4y agoAnd cut you off when you when the sh*t hits the fan.
- zamnos 4y agoBingGPT is currently doing this for web searches.
- cdchn 4y agoPulling in web searches is a lot more benign than calling APIs or executing arbitrary code it generates.
- wcoenen 4y agoBing chat already hooks into a web search tool. It shows "Searching for: ..." when it does that. This is kind of the point of Bing chat. edit: a paper about how to hook up LLMs to any external tool https://arxiv.org/abs/2302.04761 https://arxiv.org/abs/2302.04761
- IanCal 4y agoThey can already be given that ability by using something like langchain. You tell the LLM what tools it has available to it and it can call out to them if it wants.
- deleted 4y ago[deleted]
- belter 4y agoDoes anybody else feel glued to the back of their seat, by the accelerating centrifugal forces of the singularity?
- wcoenen 4y agoI think tidal forces are a better analogy. As change accelerates, basically any pre-existing organisational structure will feel tension between how reality used to be and how reality is. Things will get ripped apart, like the spaghettification of objects falling into a black hole.
- xpe 4y agoTidal implies cyclical, so no. This is accretive in a sense, but not in any gradual way.
- wcoenen 4y agoI am not referring to tides, but to the tidal forces that generate them. Tidal forces are the result of a gradient in the field of gravity. When you are close to a black hole, the part of you that is closest, experiences a stronger force of gravity than the rest of your body. This tension rips things apart. Likewise, some parts of our civilization will be more affected by AI than others, causing change there to accelerate. This causes tension with the rest of civilization.
- xpe 4y ago> Tidal forces are the result of a gradient in the field of gravity. Thanks for clarifying that you aren’t referring to the cyclical temporal variation. I see your point. AI advances are not accessible or “felt” the same way across civilizations, cultures, industries, nations, or people.
- cercatrova 4y agoCentrifugal "forces" also imply cycles. The other commenter is correct that it's tidal forces, not tides.
- kaetemi 4y agoBut have you asked GPT yet to write a Python script to ask GPT to write a Python script to ...
- random_cynic 4y agoExcept in this case, the correct answer is really one each. No one responsible will feed kids that young four muffins in one go. :)