5 ms·

You prompt this LLM using 3D meshes for it to complete, in the same manner you use language to prompt language specific LLMs.

• owenpalmer 3y ago
  That's what it seems like. Although this is not an LLM. > Inspired by recent advances in powerful large language models, we adopt a sequence-based approach to autoregressively generate triangle meshes as sequences of triangles. It's only inspired by LLMs
  • deleted 3y ago
    [deleted]
  • adw 3y ago
    This is sort of a distinction without a difference. It's an autoregressive sequence model; the distinction is how you're encoding data into (and out of) a sequence of tokens. LLMs are autoregressive sequence models where the "role" of the graph convolutional encoder here is filled by a BPE tokenizer (also a learned model, just a much simpler one than the model used here). That this works implies that you can probably port this idea to other domains by designing clever codecs which map their feature space into discrete token sequences, similarly. (Everything is feature engineering if you squint hard enough.)
  • ShamelessC 3y ago
    The only difference is the label, really. The underlying transformer architecture and the approach of using a codebook is identical to a large language model. The same approach was also used originally for image generation in DALL-E 1.