37ef_ced3

11 ms·

61.
by 37ef_ced3 5y ago
I attempted to port an AVX-512 neural net code generator (it produces stand-alone C code for, say, ResNet-50) to RISC-V vector instructions... but the conversion was unexpectedly complicated. Too time consuming, so I abandoned the project.
62.
by 37ef_ced3 5y ago
Middle bits is not ambiguous, but CoPilot hasn't seen code for that phrase in its training so it has nothing to regurgitate. You spelled out exactly what to do, in term of what it has seen in its training, and it was able to regurgitat
63.
by 37ef_ced3 5y ago
You're not overthinking it. You're correct.
64.
by 37ef_ced3 5y ago
A good solution! You SOLVED the problem. CoPilot got it WRONG. You got it RIGHT. You UNDERSTAND the problem but CoPilot does NOT. Is that clear?
65.
by 37ef_ced3 5y ago
CoPilot's solution is totally wrong. Sorry. CoPilot regurgitated somebody's solution... to a different problem. It's pathetic.
66.
by 37ef_ced3 5y ago
Incorrect. Thank you. CoPilot is helpless if it needs to do more than just regurgitate someone else's code. The training of these models on GitHub, so they regurgitate licensed code without attribution, is the greatest theft of intelle
67.
by 37ef_ced3 5y ago
How do you know the regular expressions are correct, without understanding them?
68.
by 37ef_ced3 5y ago
Because the backspace question (essentially: is T a subsequence of S with a deletion size of N?) probably occurs hundreds of times, in one form or another, within AlphaCode's training corpus. Any leetcode grinder can tell you there are
69.
by 37ef_ced3 5y ago
The difference between me and you is that I implement neural nets professionally. Here is one of my (non-professional) open source projects: https://NN-512.com I'm sure if you understood what the transformer was doing, you
70.
by 37ef_ced3 5y ago
And, to be clear, this is a human solution. Not as efficient as mine, but kudos.
71.
by 37ef_ced3 5y ago
If you ask CoPilot to solve something it hasn't seen, it won't be able to solve it. It's a transformer. Do you understand what that means? It's just matrix multiplication. It generates maximum likelihood token strings, b
72.
by 37ef_ced3 5y ago
It illustrates that CoPilot is generating maximum likelihood token strings and has no real understanding of the code. That's what is happening here. There is no intelligence, just regurgitation. Randomization and maximum likelihood com
73.
by 37ef_ced3 5y ago
This is a toy problem to illustrate that CoPilot cannot write code that requires mathematical reasoning. It regurgitates solutions from the training set, via a mixed internal reresentation.
74.
by 37ef_ced3 5y ago
You can see it happening already. Solutions are posted, and they're wrong. But the CoPilot user can't see the code is wrong.
75.
by 37ef_ced3 5y ago
Ridiculous. It's a joke, right? Perhaps the most inefficient and naive solution ever? CoPilot is regurgitating some solution from its training set, the solution of an inept programmer who would manipulate bits via conversion to string.
76.
by 37ef_ced3 5y ago
All wrong. These "solutions" are not correct.
77.
by 37ef_ced3 5y ago
The example problem (essentially, is T a subsequence of S with deletions of size N) is a classic problem with no doubt dozens of implementations in AlphaCode's training set. And yet, what a garbage solution it produces. To illustrate t
78.
by 37ef_ced3 5y ago
What is the benefit of a taxi being driverless, for the passenger? Is it cheaper?
79.
by 37ef_ced3 5y ago
Because there's a point where additional performance doesn't matter. Using C instead of Go is a mistake for all but the most performance critical applications. Use C for small pieces of code that need maximum performance. Use Go e
80.
by 37ef_ced3 5y ago
Go is fast. Generally speaking, you can expect a well-written Go program to be no more than 50% slower than well-written C. Normally the Go program will only be 5% or 10% slower. Saying this another way, a carefully written C program that t
81.
by 37ef_ced3 5y ago
All wrong. Every solution is garbage.
82.
by 37ef_ced3 5y ago
I guess CoPilot has seen bit swapping in its Python training input but not in its Go training input. The Python code is wrong because the 17th bit is shifted up, not down. Also, the bits are shifted by the wrong amount, not up/down by
83.
by 37ef_ced3 5y ago
Totally wrong, it's garbage. And there you have it, the difference between real intelligence and regurgitation. This is the kind of numerically specific coding that could be the basis of a CAPTCHA that CoPilot can't solve. Sixth
84.
by 37ef_ced3 5y ago
Someone tell me what CoPilot generates for this: // A Go function to swap the sixth bit and seventeenth bit of a 32-bit signed integer. Here is a human solution: func swap(x int32) int32 { const mask = 1 <<
85.
by 37ef_ced3 5y ago
These same C-band 5G frequencies are used in France (and 39 other countries). There are no known interference issues. Everything works fine, every day, for thousands of flights.
86.
by 37ef_ced3 5y ago
There's a 200 MHz guard band between, and (on top of that!) another 200 MHz unused. The altimeters aren't even close to the 5G spectrum. The gap between C-band 5G and the aircraft frequencies is ENORMOUS, wider than anywhere in th
87.
by 37ef_ced3 5y ago
"Unrelated"? Microsoft's automated violation of "no use without attribution" licenses? You can't see the connection? Please. Surely it's obvious to everyone but you.
88.
by 37ef_ced3 5y ago
Yes, you can "donate" someone else's code, knowing Microsoft will violate a use-with-attribution license. You can do it, but it's WRONG. Copilot is trained on public GitHub repositories of any license: https:/&#x2F
89.
by 37ef_ced3 5y ago
Microsoft owns GitHub and you accept their terms of service. Copilot is trained on public GitHub repositories of any license: https://en.m.wikipedia.org/wiki/GitHub_Copilot#Technology If they scrape your website, that&
90.
by 37ef_ced3 5y ago
The larger issue is that anyone using GitHub is donating their work for re-use without attribution through Copilot. In return, you receive hosting from GitHub. The writing is on the wall. You MUST host your own code on a stand-alone website

More ›