2 ms·

Go performance is terrible for numeric stuff though, no SIMD support.

• pclmulqdq 1y ago
  There are Go SIMD libraries now, and there's also easy use of C libraries via Cgo.
• DiabloD3 1y ago
  (given the context of LLMs) Unless you're doing CPU-side inference for corner cases where GPU inference is worse, lack of SIMD isn't a huge issue. There are libraries to write SIMD in Go now, but I think the better fix is being able to autovectorize during the LLVM IR optimization stage, so its available with multiple languages. I think LLVM has it now, its just not super great yet.
• 9rx 1y ago
  That's not really true, but we're talking about a Python replacement for scripting tasks, not core compute tasks, anyway. It is not like Python is the paragon of SIMD support. Any real Python workloads end up being written in C for good reason, using Python only as the glue. Go can also interface with C code, and despite all the flack it gets for its C call overhead it is still significantly faster at calling C code than Python is.
  • adastra22 1y ago
    For the record of people reading this, I wrote a multithreaded SIMD-heavy compute task in Go, and it suffered only 5% slowdown vs the original hand-optimized C++ version. The low level SIMD stuff was called out to over the c FFI bridge; golang was used for the rest of the program.
• wild_egg 1y ago
  Lots of packages out there using SIMD for lots of things. You can always drop into straight assembly if you need to as well. Go's assembler DX is quite nice after you get used to it.
• pjmlp 1y ago
  Go itself no, but luckily like in any compiler toolchain, there is an Assembler available.