3 ms·
From the abstract: “We introduce a loss based on probability density distillation that enables the use of a 2D diffusion model as a prior for optimization of a
by layer8 4y ago
From the abstract: “We introduce a loss based on probability density distillation that enables the use of a 2D diffusion model as a prior for optimization of a parametric image generator. Using this loss in a DeepDream-like procedure, we optimize a randomly-initialized 3D model (a Neural Radiance Field, or NeRF) via gradient descent such that its 2D renderings from random angles achieve a low loss.”
This seems like basically plugging a couple of techniques together that already existed, allowing to turn 2D text-to-image into 3D text-to-image.
- blurbleblurble 4y agoTime and time again these ML techniques are proving to be wildly modular and pluggable. Maybe sooner or later someone will build a framework for end to end text-to-effective-ML-architecture that will just plug different things together and optimize them.
- lbotos 4y agoI think this is what huggingface (github for machine learning) is trying with diffusers lib: https://huggingface.co/docs/diffusers/index https://huggingface.co/docs/diffusers/index They have others as well.
- blurbleblurble 4y agoCool stuff. But who is working on the text-to-ML-architecture thing?
- blurbleblurble 4y agoFascinating stuff! But who is working on the text-to-ML-architecture thing?
- sdan 4y ago> This seems like basically plugging a couple of techniques together that already existed as with a majority of ML research
- anigbrowl 4y agoTrue (I made such a proposal myself a few hours ago, albeit in vaguer terms). The thing is deployment infrastructure is good enough now that we can just treat it as modular signal flows and experiment a lot without having to engineer a whole pile of custom infrastructure for each impulsive experiment.
- ramesh31 4y ago>as with a majority of ML research Plus "we did the same thing, but with 10x the compute resources". But yeah.
- WithinReason 4y agoIsn't that what the Singularity was described as a few decades ago? Progress so fast it's unpredictable even in the short term.
- rileyphone 4y agoSame as it ever was, scientific revolutions arrive all at once, punctuating otherwise uneventful periods. As I understand, the present one is the product of the paper "Attention is all you need": https://arxiv.org/pdf/1706.03762.pdf https://arxiv.org/pdf/1706.03762.pdf.
- visarga 4y ago... that one has 52K citations, and the 2D to 3D paper "NeRF: Representing Scenes as Neural Radiance Fields for View Synthesis" with 1488 citations. https://arxiv.org/abs/2003.08934 https://arxiv.org/abs/2003.08934
- deleted 4y ago[deleted]
- deltasevennine 4y ago> This seems like basically plugging a couple of techniques together that already existed Do this enough times and eventually the thing you have looks indistinguishable from something completely novel.
- beambot 4y ago> This seems like basically plugging a couple of techniques together that already existed [...] In his Lex Fridman interview, John Carmack makes similar assertions about this prospect for AGI: That it will likely be the clever combination of existing primitives (plus maybe a couple novel new ones) that make the first AGI feasible in just a couple thousand lines of code.
- aliqot 4y agoThat's a great example that reminds me of another one: there was nothing new about Bitcoin conceptually, it was all concepts we already had just in a new combination. IRC, Hashing, Proof of Work, Distributed Consensus, Difficulty algorithms, you name it. Aside from Base58 there wasn't much original other than the combination of those elements.
- stavros 4y agoBase58 really should have been base57.
- aliqot 4y agoHello Stavros, I agree. When I look at the goals that base58 sought to achieve, (eliminating visually similar characters) I couldn't help but wonder why more characters were not eliminated. There is quite a bit of typeface androgyny when you consider case and face.
- stavros 4y agoYeah, I don't know why 1 was left in there, seems like a lost opportunity. Discarding l, I, 0, O, but then leaving 1? I wonder why.
- aliqot 4y agoI can only assume it was for a superstitious reason so that the original address prefixes could be a 1. This is the only sense I can make from it.