> To test GPT-4's ability to generate a complex program, ... I wonder how much the complexity of the various ecosystems we find ourselves in contribute to the

> To test GPT-4's ability to generate a complex program, ... I wonder how much the complexity of the various ecosystems we find ourselves in contribute to the lack of effectiveness of the language model. The task at hand really shouldn't be considered complex. Making and registering a command to do this in Emacs is essentially (defun inc-heading () (interactive) (save-excursion (search-backward-regexp "^\\# ") (insert "#"))). No project structure, no dependencies, no tooling: something a LLM should have no problem doing.