4 ms·
Here's an example of how easy it is to generate code on NetBSD using an open LLM: Last login: Fri May 17 23:58:08 2024 from 10.10.10.129 NetBSD 9.2 (GE
by jart 2y ago
Here's an example of how easy it is to generate code on NetBSD using an open LLM:
Last login: Fri May 17 23:58:08 2024 from 10.10.10.129
NetBSD 9.2 (GENERIC) #0: Wed May 12 13:15:55 UTC 2021
Welcome to NetBSD!
We recommend that you create a non-root account and use su(1) for root access.
$ ./curl -L -o tinyllama https://huggingface.co/Mozilla/TinyLlama-1.1B-Chat-v1.0-llamafile/resolve/main/TinyLlama-1.1B-Chat-v1.0.Q5_K_M.llamafile
$ chmod +x tinyllama
$ ./tinyllama -e -p '```c\nvoid *memcpy(void *dst,' -r '```\n' --temp 0 --log-disable
<s> ```c
void *memcpy(void *dst, const void *src, size_t n) {
char *d = (char *)dst;
const char *s = (const char *)src;
while (n--) {
*d++ = *s++;
}
return dst;
}
```
$
I think tinyllama and llamafile are much more culturally compatible with NetBSD's values than something like Microsoft Copilot.
- never_inline 2y agoI don't see your point. This is first semester CS code copying character by character. With some unrolling with uint64_t you can it will be sped up by 4 times at least, and even more so using SIMD. I don't know if your LLM can generate anywhere near a real world function in OS standard libraries.
- hedora 2y agoAlso, the issue isn’t the quality of the LLM output, or whether you’re rooting for MS or Meta (e.g., there’s a vscode port these days). The issue is that the copyright on that code is extremely questionable, and FreeBSD chose not to pirate source code from other operating systems a long time ago.