ShaShekhar

4 ms·

1.
Show HN: Turn documents into lip-synced video readers(shashekhar.github.io)
3 points by ShaShekhar 3mo ago|0 comments
2.
Show HN: Towards AI Governance(github.com)
1 points by ShaShekhar 2y ago|0 comments
3.
by ShaShekhar 2y ago
Let's start an open-source, non-profit AI government. Create LLM agents to represent every politician, decision-maker, and policymaker. By simulating their decision-making processes, we can measure their performance against actual huma
4.
Towards AI Governance, Balaji AI-Biden Challenge(github.com)
1 points by ShaShekhar 2y ago|1 comments
5.
by ShaShekhar 2y ago
instructpix2pix is fine-tuned on sd-v1.5 which is a inpainting model (aware of contexts and semantics) that why it don't require mask.
6.
by ShaShekhar 2y ago
Thanks. Stable diffusion inpainting v1.5. I'd played around this model so much that i ended up using it. I've read both papers SDEdit where you need mask for inpaiting and instructPix2Pix where you don't. I know, i'm a y
7.
by ShaShekhar 2y ago
Right now, the inpainting is done on semantic mask (output from segmentation model). For more complex instruction, we also have to support contextual mask generation, which is an active area of research in the field of Visual Language Model
8.
by ShaShekhar 2y ago
The tools are there, we just have to connect it (check out the TODO section). For more complex instruction like when you want to create the mask, it requires a lot of contextual reasoning which i tried to point out in Research section.
9.
by ShaShekhar 2y ago
I did integrated and tested the microsoft phi3-mini and it works really well. Having freedom to run locally without sharing private photo is my utmost objective.
10.
by ShaShekhar 2y ago
Example instructions: 1. Replace the sky with a deep blue sky then replace the mountain with a Himalayan mountain covered in snow. 2. Stylize the car with a cyberpunk aesthetic, then change the background to a neon-lit cityscape at night. 2
11.
by ShaShekhar 2y ago
I did it intentionally. The video had my voice, but then I decided to replace it with an AI voice.
12.
Show HN: AI assisted image editing with audio instructions(github.com)
95 points by ShaShekhar 2y ago|30 comments