3 ms·

AVX Bitwise ternary logic [VPTERNLOGD] instruction busted (2024)

peter_d_sherman 2mo ago
This article (comparing the x86 AVX-512F instruction VPTERNLOGD to Amiga's Blitter) is not the end of the discussion for this instruction, it's actually the beginning... See, VPTERNLOGD is a ternary bitwise instruction. In theory, that means that it could (in theory, temporarily ignoring other factors like streaming, parallelism, memory access speed, etc.) replace the Matrix Multiply (aka "MatMul") component of LLM's, if, if and only if the weights in an LLM are changed to ternary (-1,0,1)... Matrix Multiply is at the core of all GPU's and AI accelerators -- so alternatives to it, such as VPTERNLOGD (especially on older/cheaper hardware, as x86 AVX-512F apparently dates back to 2016), as well as Ternary LLM's -- may be worth a little investigation... Yes, ternary LLM's do come with their own set of problems(!) -- but as a strictly-for-intellectual-curiosity x86 instruction, I think that VPTERNLOGD is pretty interesting... Related: "NativeTernary: A Self-Delimiting Binary Encoding with Unary Run-Length Hierarchy Markers for Ternary Neural Network Weights, Structured Data, and General Computing Infrastructure": https://arxiv.org/pdf/2604.03336 https://arxiv.org/pdf/2604.03336 VPTERNLOGD/VPTERNLOGQ — Bitwise Ternary Logic https://www.felixcloutier.com/x86/vpternlogd:vpternlogq https://www.felixcloutier.com/x86/vpternlogd:vpternlogq Microsoft BitNet - Official inference framework for 1-bit LLMs https://github.com/microsoft/bitnet https://github.com/microsoft/bitnet Ternary Mirror-symmetrical Arithmetic And Its Application To Digital Signal Processing by Alexey Stakhov (related: Nikolay Brousentsov, the "ternary principle" aka "Brousentsov's principles"): https://computeroptics.ru/eng/KO/PDF/KO21/KO21334.pdf https://computeroptics.ru/eng/KO/PDF/KO21/KO21334.pdf DeepSilicon (YC S24): https://news.ycombinator.com/item?id=41490196 https://news.ycombinator.com/item?id=41490196

This article (comparing the x86 AVX-512F instruction VPTERNLOGD to Amiga's Blitter) is not the end of the discussion for this instruction, it's actually the beginning... See, VPTERNLOGD is a ternary bitwise instruction. In theory, that means that it could (in theory, temporarily ignoring other factors like streaming, parallelism, memory access speed, etc.) replace the Matrix Multiply (aka "MatMul") component of LLM's, if, if and only if the weights in an LLM are changed to ternary (-1,0,1)... Matrix Multiply is at the core of all GPU's and AI accelerators -- so alternatives to it, such as VPTERNLOGD (especially on older/cheaper hardware, as x86 AVX-512F apparently dates back to 2016), as well as Ternary LLM's -- may be worth a little investigation... Yes, ternary LLM's do come with their own set of problems(!) -- but as a strictly-for-intellectual-curiosity x86 instruction, I think that VPTERNLOGD is pretty interesting... Related: "NativeTernary: A Self-Delimiting Binary Encoding with Unary Run-Length Hierarchy Markers for Ternary Neural Network Weights, Structured Data, and General Computing Infrastructure": https://arxiv.org/pdf/2604.03336 https://arxiv.org/pdf/2604.03336 VPTERNLOGD/VPTERNLOGQ — Bitwise Ternary Logic https://www.felixcloutier.com/x86/vpternlogd:vpternlogq https://www.felixcloutier.com/x86/vpternlogd:vpternlogq Microsoft BitNet - Official inference framework for 1-bit LLMs https://github.com/microsoft/bitnet https://github.com/microsoft/bitnet Ternary Mirror-symmetrical Arithmetic And Its Application To Digital Signal Processing by Alexey Stakhov (related: Nikolay Brousentsov, the "ternary principle" aka "Brousentsov's principles"): https://computeroptics.ru/eng/KO/PDF/KO21/KO21334.pdf https://computeroptics.ru/eng/KO/PDF/KO21/KO21334.pdf DeepSilicon (YC S24): https://news.ycombinator.com/item?id=41490196 https://news.ycombinator.com/item?id=41490196