37ef_ced3

10 ms·

31.
by 37ef_ced3 4y ago
I second this (most excellent) recommendation and suggest, in particular, the band "Windhand". For example, Windhand's song "Three Sisters": https://youtu.be/0FkhnGdwDcw
32.
by 37ef_ced3 4y ago
Yes. Put some ear plugs in and crank up the Elder or Pelican. Way up. Filtered through (muffled by) ear plugs, heavy metal is a good accompaniment to software work.
33.
by 37ef_ced3 4y ago
I didn't mean to insult you. My apologies. All I meant was: it's not hard to write your weights to a file as floats and fread() them into a struct. I view this as the simplest possible universal interface. And you're right: N
34.
by 37ef_ced3 4y ago
According to the benchmarks, pdqsort only really helps for Go's integer sort. The fastest way to sort integers is a radix-256 increasing-significance radix sort, and that has been a well-known fact since the 1960's. In other words
35.
by 37ef_ced3 4y ago
NN-512 was monetized by making its author a Senior Architect at the most important company in the machine learning space, a company whose hardware and software you almost certainly use. NN-512 was an EXTREMELY profitable project for its aut
36.
by 37ef_ced3 4y ago
Related: Generate fully specialized, stand-alone, human-readable C code for AVX-512 neural net inference: https://NN-512.com Far outperforms TensorFlow, PyTorch, etc. Code generator is also stand-alone (no dependencies) and is w
37.
by 37ef_ced3 4y ago
Do something where there's no training data available. The AI companies are re-encoding large corpora of human creative work as a kind of compressed, conceptually-indexed representation. This allows that work to be mixed and the patter
38.
by 37ef_ced3 5y ago
Here is a compiler (written in Go) that also generates and serves its own website with no dependencies: https://nn-512.com/browse/NN-512#46
39.
by 37ef_ced3 5y ago
Go is a distillation of many decades of software engineering experience. The people behind Go (e.g., Russ Cox) have learned from history. The peanut gallery loves to complain about superficial aspects of Go. Typically these are people with
40.
by 37ef_ced3 5y ago
Do whatever works for you. I use Vim on a concatenation. It's a simple technique that allows me to search, read, annotate, and understand how everything fits together in a medium sized C++ codebase full of templates (i.e., a pile of ga
41.
by 37ef_ced3 5y ago
Concatenate all the source code files into a single file, with pathnames inserted between files. Then use Vim to read the concatenation and (regexp) search.
42.
by 37ef_ced3 5y ago
You're talking to a transformer language model.
43.
by 37ef_ced3 5y ago
In Go we use ^ for bitwise-NOT.
44.
by 37ef_ced3 5y ago
Because it's 32-bits wide in memory. The effective mantissa is like FP16 but it's padded out to be the same size as FP32. In other words, there's 1 sign bit, 8 exponent bits, 10 mantissa bits that are USED, and 13 mantissa bi
45.
by 37ef_ced3 5y ago
Fast CPU transformers: https://bellard.org/libnc Fast CPU convolutions: https://NN-512.com Both are completely stand-alone (no external dependencies).
46.
by 37ef_ced3 5y ago
Anecdotally, I run a several servers hosting several websites and several Android app back-ends. Every few weeks they are attacked: 12 hours of attempted logins, port scanning, etc. It's perfectly normal and nothing new.
47.
by 37ef_ced3 5y ago
Please compare against https://NN-512.com
48.
by 37ef_ced3 5y ago
Complication without benefit.
49.
by 37ef_ced3 5y ago
You need 128 random bits to seed the generator (i.e., two uint64 variables). The bits1 and bits2 arguments to pcg32.New() should each be 64 bits of "noise". They may be drawn from /dev/urandom or whatever. You can use cr
50.
by 37ef_ced3 5y ago
Use PCG: https://www.pcg-random.org/ Here is a stand-alone implementation of PCG32 in Go: package pcg32 type Src [2]uint64 func New(bits1, bits2 uint64) *Src { return &Src{bits1, bits2 | 1} } func (
51.
by 37ef_ced3 5y ago
A bad programmer can make a mess in any language, including Go. A great example is this .map().filter().reduce() joke we're looking at today. Well-written Go is absolutely sublime.
52.
by 37ef_ced3 5y ago
The goal is publicity. The brag is the most important thing. Just like with the Thai cave rescue.
53.
by 37ef_ced3 5y ago
Too complicated. Rust is more similar to C++ than it is to C.
54.
by 37ef_ced3 5y ago
Consider using Go instead, as a replacement for C.
55.
by 37ef_ced3 5y ago
I use the Go font: https://go.dev/blog/go-fonts Free and beautiful.
56.
by 37ef_ced3 5y ago
The compiler generates and serves its own website with no dependencies. For personal projects (including NN-512) I use Mercurial for version control, not git. But in any case I don't want the compiler (or the website it generates) to d
57.
by 37ef_ced3 5y ago
Related: https://NN-512.com is a compiler that generates C99 code for neural net inference. It takes as input a simple text description of a convolutional neural net inference graph. It produces as output a human-readable, stand
58.
by 37ef_ced3 5y ago
For example, my https://NN-512.com is served by a Nanode in Linode's Fremont datacenter (45.56.92.68). That same Nanode has been running the back-end of an Android app for almost 5 years, on another port.
59.
by 37ef_ced3 5y ago
I love Linode. Strongly recommended. For many years, I have run all my websites and services (back-ends for apps, etc.) on a few $5/month Nanodes. For temporary/experimental stuff I sometimes use Vultr and Digital Ocean, but Linod
60.
by 37ef_ced3 5y ago
Thanks. Yes. Let me give you an example of the difficulties: The NN-512 code generator knows (with AVX-512) it can do an efficient (up to) 16x16 transpose, and makes heavy use of lane permutations. But with RISC-V vector instructions, you d

More ›