3 ms·
with gemini-cli and claude-cli you can now prompt while it prompts ffmpeg, and it does work.
by Keyframe 1y ago
with gemini-cli and claude-cli you can now prompt while it prompts ffmpeg, and it does work.
- NSUserDefaults 1y agoCurious to see how quickly each LLM picks up the new codecs/options.
- baq 1y agothe canonical (if that's the right word for a 2-year-old technique) solution is to paste the whole manual into the context before asking questions
- xnx 1y agoGemini can now load context from a URL in the API (https://ai.google.dev/gemini-api/docs/url-context https://ai.google.dev/gemini-api/docs/url-context), but I'm not sure if that has made it to the web interfaces yet.
- stevejb 1y agoI use the Warp terminal and I can ask it to run —-help and it figures it out
- conradev 1y agoYeah, you can give an LLM queries like “make this smaller with libx265 and add the hvc1 tag” or “concatenate these two videos” and it usually crushes it. They have a similar level of mastery over imagemagick, too!
- turnsout 1y agoYeah, LLMs have honestly made ffmpeg usable for me, for the first time. The difficulty in constructing commands is not really ffmpeg's fault—it's just an artifact of the power of the tool and the difficulties in shoehorning that power into flags for a single CLI tool. It's just not the ideal human interface to access ffmpeg's functionality. But keeping it CLI makes it much more useful as part of a larger and often automated workflow.
- lukeschlather 1y agoIt's funny because GPU stuff like what this article is about is where the LLMs totally fall apart. I can make any LLM produce volumes hallucinations at the drop of a hat by asking it how to construct ffmpeg commands that use hardware acceleration.
- profsummergig 1y agoJust seeking a clarification on how this would be done: One would use gemini-cli (or claude-cli), - and give a natural language prompt to gemini (or claude) on what processing needs to be done, - with the correct paths to FFmpeg and the media file, - and g-cli (or c-cli) would take it from there. Is this correct?
- RedShift1 1y agoYes. It works amazingly well for ffmpeg.
- profsummergig 1y agoThank you.
- logicalmind 1y agoAnother option is to use a non-cli LLM and ask it to produce a script (bash/ps1) that uses ffmpeg to do X, Y, and Z to your video files. If using a chat LLM it will often provide suggestions or ask questions to improve your processing as well. I do this often and the results are quite good.