chewxy

8 ms·

31.
by chewxy 3y ago
The peppy, upbeat, ultra-American tone that the LLMs produce can be somewhat toned down with good prompting but ultimately, it does stink of the refinement test set.
32.
by chewxy 3y ago
Meanwhile I want my emacs to look more like this https://imgur.com/a/h0jA1ro (in case anyone thinks that's serious, it's a joke. I only use Cool Retro Term for presentations) edit: apparently my emacs works w
33.
by chewxy 3y ago
We're rebranding mode collapse as MAD now?
34.
by chewxy 3y ago
> Coding in its purest form is a kind of translation, from natural language requirements to more precise computer languages Unfortunately not so true. A simple way to check this is to look at what the brain is doing. Coding barely trigge
35.
by chewxy 3y ago
GopherConAU organizer here. Here's the whole playlist. I am not sure why I cannot make it public. https://www.youtube.com/playlist?list=PLN_36A3Rw5hFsJqqs7olO...
36.
by chewxy 3y ago
文明昆明 (wenming Kunming) is such an amazing rhyming couplet
37.
by chewxy 3y ago
Writing code uses the multiple demand network of the brain while writing prose uses mainly the language centres of the brain. Writing code is very much not the same as writing prose. Source: https://www.cs.cmu.edu/%7Eckaestn
38.
by chewxy 3y ago
An alternative process is to call describe-function, use embark-collect to put all the auto suggestions into a buffer and memorise all functions. Edit: I just did that and when I called count words to count lines that are in the buffer, Ema
39.
by chewxy 3y ago
which-key helps a lot with prefix commands. But doesn't help when you don't know the variants of I search that have silly default key bindings like the aforementioned C-M-@
40.
by chewxy 3y ago
emacs' discoverability has been quite terrible. A couple years back I wrote half of a package to do ascii art before I discovered artist-mode. And I had been using emacs for close to a decade by then. This year I discovered ace-window
41.
by chewxy 3y ago
If you mean non-computer games: Magic the Gathering and Go are my top picks. I'm not good at either (due to lack of time to practise) but they are my go-to games when I and an opponent have coincident free time. For computer games, I&#
42.
by chewxy 3y ago
Models controlled by large for-profit entities not being a problem? Llocallamas are nice and great but pretraining was still done by Meta. Same with SDs. Users of generative AI models are at the whim of conglomerates.
43.
by chewxy 3y ago
That's quite correct. The IP1 and IP2 areas are usually associated with mathematics and production of motor cues around mathematics and stories. The Broca's and Vernicke's Areas are associated with language understanding and
44.
by chewxy 3y ago
I use a ~Nreal~ Xreal Air as my secondary monitor. When I don't want people to look, I simply lower the brightness of my primary laptop monitor to be a black screen.
45.
by chewxy 3y ago
TL;DR: LLMs are autocomplete on steroids, but stranger-than-expected steroids means people overhype it. I'll share my point of view, and leave you to your own conclusions. 1. A sequence learner is anything that can learn a continuation
46.
by chewxy 3y ago
The GPTs are good at interpolative and extrapolative generalization, owing to the manifold of the training data. They can't do abstractive, inductive, abductive generalizations. And those are the more common forms of generalizations th
47.
by chewxy 3y ago
I'm curious how you went. Here's my attempt: https://github.com/chewxy/hm , the core of which (i.e. the interface type) is what powers most of the languages I wrote (different languages I wrote have different
48.
by chewxy 3y ago
If you use an ErgodoxEZ I've actually implemented the layout: https://github.com/chewxy/keyboards/tree/main/ergodox-ez I have one for zmk too but I haven't committed/pushed it yet
49.
by chewxy 3y ago
Oh what a trip down memory lane. Software of that era had really interesting UI and UX. I made a winamp skin that was a blob (of my face, or perhaps my dad's) after using Kai's Power Goo.
50.
by chewxy 3y ago
I note something very interesting in the AI hype, and I would like someone to help explain it. Whenever there's a news or article noting the limits of current LLM tech (especially the GPT class of models from OpenAI), there's alwa
51.
by chewxy 3y ago
the problem with the critique of "oh they didn't use the correct prompts" is that prompt engineering is highly dependent on the model. You could technically create an LLM that would not work with the "let's think th
52.
by chewxy 3y ago
You could measure the efficiency of a language by computing how many bits are required to store the semantics of a word/phrase/sentence losslessly. Assuming ideal encoding to bits of course. Think of things like perplexity and the
53.
by chewxy 3y ago
Add something like this? (add-to-list 'display-buffer-alist '("\\*Magit*\\*" (display-buffer-reuse-window display-buffer-in-direction (direction . bottom) (window . roo
54.
by chewxy 3y ago
One thing emacs sorely lacks is support for VS Code's LiveSharing protocol. Otherwise I use emacs for everything
55.
by chewxy 3y ago
There are many lambda calculi. THE lambda calculus refers to the original lambda calculus as defined by Church.
56.
by chewxy 3y ago
You can think of prompt engineering as mining the model for what it knows (I hesitate to call it knowledge). Thus prompt engineering is highly specific to the model. Good thing we only have a handful of models trained in very similar ways h
57.
by chewxy 3y ago
The stop words bit is a bit wtf. Someone didn't do their homework
58.
Are emergent abilities of large language models a mirage?(arxiv.org)
154 points by chewxy 3y ago|130 comments
59.
by chewxy 3y ago
Cars are small and for the most part everyone in the car faces the same direction as the car itself. When you have a ship, you have 3 frames of references to contend with (self, ship, cardinal)
60.
by chewxy 3y ago
In Malaysian/Singaporean English there's a term: gostan (read "go stun"), which means to reverse. I was curious about it's etymology and went to research it. It came from "go astern", with "astern&quo

More ›