2 ms·

I don't know where you get this opinion from as it doesn't match the landscape that I'm witnessing. Around the huge names are many companies and business units

I don't know where you get this opinion from as it doesn't match the landscape that I'm witnessing. Around the huge names are many companies and business units fine-tuning foundational models on their private datasets for the specific domains they are interested in. I can think of scenarios where someone is interested in training models to generate images with accurate reflections in specific settings.

viraptor 2y ago
There could be edge cases, but fine tuning doesn't normally concentrate on a single specific feature. With positive and negative examples you could definitely train the eyes, but it's not what people usually do. Fine tuning is widely used to provide a specific style, clothes, or other larger scale elements.
- dragonwriter 2y ago
  > There could be edge cases, but fine tuning doesn't normally concentrate on a single specific feature. Normally is being strained here: yes, most finetuning isn't for things like this, but quite a substantial minority is for more accurate rendering of some narrow specific feature, especially ones typically identified as signature problems of AI image gen; publicly identifying this as a way to visually distinguish AI gens makes it more likely that fine tuning effort will be directed at addressing it.
bastawhiz 2y ago
> I don't know where you get this opinion from as it doesn't match the landscape that I'm witnessing. I'm an engineer at an AI company that makes text/image to video models, but go off
- deleted 2y ago
  [deleted]
- deleted 2y ago
  [deleted]
- deleted 2y ago
  [deleted]
- jhanschoo 2y ago
  I may be in agreement, and I was an idiot to misunderstand your comment and reply based on it. I especially agree with the last sentence that models largely learn features in the dataset, but I don't understand why you would describe it as > There's nobody that's like "today we're working on fingernails" or "today we're making hair physics work better" If there were a business case for that, I would characterize curating a dataset of fingernails and fine-tuning or augmentind a model based on that as "today we're working on fingernails". And the same too with eye reflections. So with the right dataset you can get eye reflections right, albeit in a limited domain. (E.g. deepfakes in a similar setting as the training data). In fact you can look at the community that sprung up around SD 1.5 (?) that fine tunes SD with relevant datasets to improve its abilities in exactly a "today we're going to improve its ability to produce these faces" kind of fashion. Where did I misunderstand your comment? I seem to arrive at the completely opposite response from the same fact. I also noticed that you say > the improvements are really just giving the models techniques for more accurately replicating features from reasoning data. You seem to refer to aspects of a model unrelated to dataset quality. But fine-tuning on a curated dataset may be sufficient and necessary for improving eye reflections and fingernails.

viraptor 2y ago

There could be edge cases, but fine tuning doesn't normally concentrate on a single specific feature. With positive and negative examples you could definitely train the eyes, but it's not what people usually do. Fine tuning is widely used to provide a specific style, clothes, or other larger scale elements.

dragonwriter 2y ago
> There could be edge cases, but fine tuning doesn't normally concentrate on a single specific feature. Normally is being strained here: yes, most finetuning isn't for things like this, but quite a substantial minority is for more accurate rendering of some narrow specific feature, especially ones typically identified as signature problems of AI image gen; publicly identifying this as a way to visually distinguish AI gens makes it more likely that fine tuning effort will be directed at addressing it.

bastawhiz 2y ago

> I don't know where you get this opinion from as it doesn't match the landscape that I'm witnessing. I'm an engineer at an AI company that makes text/image to video models, but go off

deleted 2y ago
[deleted]
deleted 2y ago
[deleted]
deleted 2y ago
[deleted]
jhanschoo 2y ago
I may be in agreement, and I was an idiot to misunderstand your comment and reply based on it. I especially agree with the last sentence that models largely learn features in the dataset, but I don't understand why you would describe it as > There's nobody that's like "today we're working on fingernails" or "today we're making hair physics work better" If there were a business case for that, I would characterize curating a dataset of fingernails and fine-tuning or augmentind a model based on that as "today we're working on fingernails". And the same too with eye reflections. So with the right dataset you can get eye reflections right, albeit in a limited domain. (E.g. deepfakes in a similar setting as the training data). In fact you can look at the community that sprung up around SD 1.5 (?) that fine tunes SD with relevant datasets to improve its abilities in exactly a "today we're going to improve its ability to produce these faces" kind of fashion. Where did I misunderstand your comment? I seem to arrive at the completely opposite response from the same fact. I also noticed that you say > the improvements are really just giving the models techniques for more accurately replicating features from reasoning data. You seem to refer to aspects of a model unrelated to dataset quality. But fine-tuning on a curated dataset may be sufficient and necessary for improving eye reflections and fingernails.