abc-1

7 ms·

61.
by abc-1 2y ago
Look at how mathematicians build minimal yet complete definitions for inspiration. An algebraic system can be created with a set of operations such as multiplication and addition, and existing concepts can be mapped to this system, such as
62.
by abc-1 2y ago
Contagion is exactly why interfaces are one of the most important pieces of design and should be given significant thought. A beautiful interface with a suboptimal implementation can be easily cleaned up when time is allotted. The reverse i
63.
by abc-1 2y ago
Recursive self improvement
64.
by abc-1 2y ago
Nine women cannot give birth in one month.
65.
by abc-1 2y ago
And AlphaGo is trained to play Go? The point is training a model through self play to build neural network architectures. If it can play Go and architect chip placements, I don’t see why it couldn’t be trained to build novel ML architecture
66.
by abc-1 2y ago
Why aren’t they using this technique to design better transformer architectures or completely novel machine learning architectures in general? Are plain or mostly plain transformers really peak? I find that hard to believe.
67.
by abc-1 2y ago
Nobody ever really believed this, the truth is rarely in vogue.
68.
by abc-1 2y ago
I do all of the above. Summary comments are incredibly helpful and have been validated by empirical research. Too bad many have drunk deeply from the Clean Code koolaid and can’t be saved.
69.
by abc-1 2y ago
Vector embeddings.
70.
by abc-1 2y ago
If you put a lot of arbitrary constraints to not allow it to be better, sure. Enjoy.
71.
by abc-1 2y ago
A lot of this reads like code search tools could and should be a lot better. They probably will be with AI finding its way into everything. In the old days, people would Hungarian prefix types, but now the IDE mitigates that with color code
72.
by abc-1 2y ago
ORMs do a great job at making easy things even easier and hard things a lot harder. If that sounds like a bad deal to you- it’s because it is!
73.
by abc-1 2y ago
Anyone know any research combining RNN like architecture to transformers? It’d be neat if a layer of a transformer could decide to loop its output vector to a previous layer n number of times to allow it to “think harder”. The implementatio