5 ms·

Very interesting as usual from Fabrice Bellard, but I'm a little bit disappointed this time, because libnc is a closed source DLL. Nevertheless it will be inter

Very interesting as usual from Fabrice Bellard, but I'm a little bit disappointed this time, because libnc is a closed source DLL. Nevertheless it will be interesting to compare it to the amazing work of Georgi Gerganov: GGML Tensor Library. Both are heavily optimized, supports AVX intrinsics and are plain C/C++ implementation without dependencies.

ggerganov 4y ago
I expect LibNC will be better in every aspect: performance, accuracy, determinism. But hopefully with time we will close the gap.
- hardwaresofton 4y ago
  refreshingly humble take -- thanks for your hard work. The work you've done and put out in the open is massive.
- liuliu 4y ago
  The comparison table from the ts_server site looks awesome though. I wish we could generate one for llama.cpp, unfortunately too busy with other things at the moment.
  - ggerganov 4y ago
    Hey liuliu, would love if you join the project when you find the time - your work is really inspiring!
    - liuliu 4y ago
      Thank you for the compliment! Definitely would love to contribute in some ways, once we have the benchmark, I have some ideas :)
vidarh 4y ago
ChatGPT is pretty good at disassembling x86, and is able to give reasonable descriptions of what the code is doing (e.g try "disassemble the following bytes in hex and explain what they appear to be doing: [bytes from a binary in hex]") I'm curious how soon someone uses these models to effectively ruin the ability to use releasing binaries as an obfuscation method.
- datpiff 4y ago
  Using ChatGPT as a disassembler seems like a dumb idea when free disassemblers already exist. What possible advantage does it give?
  - vidarh 4y ago
    The ability to explain the code, and extract higher level understanding. Disassembling into raw instructions is the most trivial part of reverse engineering an application. Hence "and explain what they appear to be doing" bit. For the pieces I've tested, it often recognises the source language, and could give ideas about what the code was for and what it did.
    - datpiff 4y ago
      > Disassembling into raw instructions is the most trivial part So why not do it in the proven-correct tools and give ChatGPT the instructions? I'm all for finding neat use cases but I wouldn't use an AI chatbot as a calculator...
      - vidarh 4y ago
        You could do that too, but that is entirely missing the point, which is that ChatGPT is capable of inferring higher level semantics from the instructions and explain what the code is doing. You're getting hung up on a minor, unimportant detail.
        datpiff 4y ago
volodia 4y ago
There are also equally easy to use open source systems, check out this one for example: https://github.com/kuleshov/minillm https://github.com/kuleshov/minillm

ggerganov 4y ago

I expect LibNC will be better in every aspect: performance, accuracy, determinism. But hopefully with time we will close the gap.

hardwaresofton 4y ago
refreshingly humble take -- thanks for your hard work. The work you've done and put out in the open is massive.
liuliu 4y ago
The comparison table from the ts_server site looks awesome though. I wish we could generate one for llama.cpp, unfortunately too busy with other things at the moment.
- ggerganov 4y ago
  Hey liuliu, would love if you join the project when you find the time - your work is really inspiring!
  - liuliu 4y ago
    Thank you for the compliment! Definitely would love to contribute in some ways, once we have the benchmark, I have some ideas :)

vidarh 4y ago

ChatGPT is pretty good at disassembling x86, and is able to give reasonable descriptions of what the code is doing (e.g try "disassemble the following bytes in hex and explain what they appear to be doing: [bytes from a binary in hex]") I'm curious how soon someone uses these models to effectively ruin the ability to use releasing binaries as an obfuscation method.

datpiff 4y ago
Using ChatGPT as a disassembler seems like a dumb idea when free disassemblers already exist. What possible advantage does it give?
- vidarh 4y ago
  The ability to explain the code, and extract higher level understanding. Disassembling into raw instructions is the most trivial part of reverse engineering an application. Hence "and explain what they appear to be doing" bit. For the pieces I've tested, it often recognises the source language, and could give ideas about what the code was for and what it did.
  - datpiff 4y ago
    > Disassembling into raw instructions is the most trivial part So why not do it in the proven-correct tools and give ChatGPT the instructions? I'm all for finding neat use cases but I wouldn't use an AI chatbot as a calculator...
    - vidarh 4y ago
      You could do that too, but that is entirely missing the point, which is that ChatGPT is capable of inferring higher level semantics from the instructions and explain what the code is doing. You're getting hung up on a minor, unimportant detail.
      - datpiff 4y ago

volodia 4y ago

There are also equally easy to use open source systems, check out this one for example: https://github.com/kuleshov/minillm https://github.com/kuleshov/minillm