chaxor

35 ms·

451.
by chaxor 3y ago
I really hope people don't come from R to Julia. People who use R are not good programmers, and will degrade the core of the language and it's principles. It would be a shame to see the equivalent of tacking on 6 different object
452.
by chaxor 3y ago
This is definitely clouded by personal preferences far too much. Acting as if python is void of issues in change over time? We all know the incredible pain of trying to get some ML package running written 3 months ago (let alone 3 years ag
453.
by chaxor 3y ago
In pandas you can chain commands by wrapping the whole command in (). Personally IMO looks far 'cleaner' than all of the ugly %>% everywhere.
454.
by chaxor 3y ago
Lay off the Sim City, Herman Cain
455.
by chaxor 3y ago
It's rigor applied where we don't need it, and ignores where we do (mathematical proofs and NN theory, architecture, hyper parameters, training schemes, etc). I have a somewhat irrational hatred towards almost all of the prompt or
456.
by chaxor 3y ago
You should read some of the papers referred to in the above comments before making that assertion. It may take a while to realize the overall structure of the argument, how the category theory is used, and how this is directly applicable to
457.
by chaxor 3y ago
Are you saying that the new mathematical theorems that were proven using GNNs from Deepmind were not useful? There were two very noteworthy (Perhaps Nobel prize level?) breakthroughs in two completely different fields of mathematics (knot t
458.
by chaxor 3y ago
Of course it predict the next token. Every single person on earth knows that so it's not worth repeating at all. As for the fact that it gets things wrong sometimes - sure, this doesn't say it actually learned every algorithm (i
459.
by chaxor 3y ago
There isn't a DFT directly, it's a more obvious statement here. The circulant matrix (linear graph of words) always has the same eigenvectors and is diagonalized via DFT. The PE in original Viswani is based on this, they just didn
460.
by chaxor 3y ago
I certainly recognize that possibility; but I also realize that systems can be extremely useful , and have a great 'understanding' (for some definition of 'understanding') of linguistic and visual data, without any need
461.
by chaxor 3y ago
What do you think about the papers showing mathematical proofs that GNNs (i.e. GATs/transformers) are dynamic programmers and therefore perform algorithmic reasoning? The fact that these systems can extrapolate well beyond their tr
462.
by chaxor 3y ago
Most of the AI literature has moved past talking about the Turing test. The metric now after goal post moving is "the Embodied Turing test". That is, the test that someone interacting with two different people (standing in front
463.
by chaxor 3y ago
My understanding is that TEPS were used to determine computing for these types operations, rather than FLOPS, as they were more useful specifically for that comparison. There metrics put them in the same order of magnitude; however, as sta
464.
by chaxor 3y ago
It's my understanding that GPLv3 is perfectly fine to make businesses on, you just have to make your code open source. There isn't anything wrong with that, and in today's age, I would actually suggest that's an enormou
465.
by chaxor 3y ago
It is a bogus comparison, because typical language models used already have textual representations, and output textual representations; which is a very small fraction of 'the brain'. An astounding portion of the brain's neu
466.
by chaxor 3y ago
The neurons in Wernicke's area however is a very small subset of this, so since these models aren't doing anything related to taste or smell, etc that number isn't as relevant as you may think it is. The number of neurons mo
467.
by chaxor 3y ago
I would heavily disagree with that - the only reason that you think that is that GPT-4 is available to the public for cheap, whereas Deepminds models have not been released publicly.
468.
by chaxor 3y ago
This idea that ChatGPT is better than the models that Google has is false; but I understand the perception. Deepmind has far better models than OpenAI, and the models OpenAI have made are based on the research done at Deepmind. For example,
469.
by chaxor 3y ago
Their data may not be that much better; however Deepmind is still one of the best institutions that study AI fundamentals. OpenAI works hard and focused towards products, but the academic research is far better from Deepmind. So since Goo
470.
by chaxor 3y ago
If these problems are all very similar in structure, then you may not need an LLM. Simple GloVe or W2V may suffice with a dot product. The. You can plow through a few terabytes by the time the LLM goes through a fraction of that.
471.
by chaxor 3y ago
My point is that there are already mathematical proofs in the literature that show that LLMs literally are doing algorithmic reasoning. This has been proven by category theory, in the area of GNNs (for which transformers are a trivia
472.
by chaxor 3y ago
Are you sure? Have you read through enough literature on GNNs? Transformers are GNNs with attention message passing and positional embeddings. GNNs have also been *mathematically proven * to be dynamic programmers and to *align with algori
473.
by chaxor 3y ago
It's literally the title. Peter Velockovic is probably the most prolific author of this era regarding LLMs, and does not yet realize it. https://arxiv.org/pdf/2203.15544.pdf
474.
by chaxor 3y ago
This seems suboptimal considering the simple output from the original Viswani PE, which is solidly based on a well grounded foundation of eigenvectors for the discrete Fourier transform relation to the circulant matrix of a linear
475.
by chaxor 3y ago
Don't forget that having a GNN (or perhaps Sheaf NN) model the system can allow decomposition such that an analytical expression can be extracted to explain the dynamics of the model quite well. This was shown via Cranmer et al, and c
476.
by chaxor 3y ago
Google in some ways is far better than OpenAI in their AI capabilities, but it mostly comes down to the fact that they weren't making products , when OpenAI was. Deepmind has probably the best research in the AI area fundamentally, an
477.
by chaxor 3y ago
This is just sad. The idea of a "Prompt physician" for anyone or anything referring to the idea is such a 'idiocracy'-esque dystopian future.
478.
by chaxor 3y ago
"The user works in an IDE called Visual Studio Code" I do what now?! Never been so insulted by an LLM like this.
479.
by chaxor 3y ago
It's a bit bizarre (but also very intriguing!) that you would bring up some of the older techniques of NLP, such as TFIDF, Latent Semantic indexing, GloVe, etc (at least that's what I assume you mean when you mention the severely
480.
by chaxor 3y ago
What's 375792*7385482? You can't use paper, or think about it more than a second. If you get it wrong, it's clear that you are not intelligent. See how ridiculous that sounds? CoT or <work> tokens are not 'cheatin

More ›