2 ms·

I hate LLM companies, I guess I'm going to use OpenAI API to "obfuscate" the content or maybe I will buy an NVIDIA GPU to run a llama model, mhm maybe on GPU cl

by GaggiX 2y ago

I hate LLM companies, I guess I'm going to use OpenAI API to "obfuscate" the content or maybe I will buy an NVIDIA GPU to run a llama model, mhm maybe on GPU cloud.

walterbell 2y ago
With tiny amounts of forum text, obfuscation can be done locally with open models and local inference hardware (NPU on Arm SoC). Zero dollars sent to OpenAI, NVIDIA, AMD or GPU clouds.
- GaggiX 2y ago
  >local inference hardware (NPU on Arm SoC). Okay the battle is already lost from the beginning.
  - walterbell 2y ago
    There are alternatives to NVIDIAmaxing with brute force. See the Chinese paper on DeepSeek V3, comparable to recent GPT and Claude, trained with 90% fewer resources. Research on efficient inference continues. https://github.com/deepseek-ai/DeepSeek-V3/blob/main/DeepSeek_V3.pdf https://github.com/deepseek-ai/DeepSeek-V3/blob/main/DeepSee...
- pogue 2y ago
  What specifically are you suggesting? Is this a project that already exists or a theory of yours?
  - sangnoir 2y ago
    Markov chains are ancient in AI-years, and don't need a GPU.