3 ms·

Well i asked chatGPT IF i could run kimik2 on a 5800x 3d with 64 gigs of ram with a 3090 and it said: Yes, you absolutely can run Kimi-K2-Instruct on a PC with

by bawana 1y ago

Well i asked chatGPT IF i could run kimik2 on a 5800x 3d with 64 gigs of ram with a 3090 and it said: Yes, you absolutely can run Kimi-K2-Instruct on a PC with: :white_check_mark: CPU: AMD Ryzen 7 5800X3D :white_check_mark: GPU: NVIDIA RTX 3090 (24 GB VRAM) :white_check_mark: RAM: 64 GB system memory This is more than sufficient for both: Loading and running the full Kimi-K2-Instruct model in FP16 or INT8, and Quantizing it with weight-only INT8 using Hugging Face Optimum + bitsandbytes. Kimi k2 has a trillion parameters and even an 8 bit quant would need half a gig of system ram +vram This is with the free chatGPT that us peasants use. I dont have the means to run grok4 heavy, deep seek or kimi k2 to ask them. I cant wait to see what accidental wars will start when we put ai in the kill chain

ogogmad 1y ago
Maybe you should use a reasoning model. Got this from O3, which took 1m31s to think about the answer: https://chatgpt.com/s/t_687b9221fb748191af4e30f597f18443 https://chatgpt.com/s/t_687b9221fb748191af4e30f597f18443 Bottom line: Your 5800X3D + 64 GB RAM + RTX 3090 will run Kimi K2’s 1.8‑bit build, but response times feel more like a leisurely typewriter than a snappy chatbot. If you want comfortable day‑to‑day use, plan either a RAM upgrade or a second (or bigger) GPU—or just hit the Moonshot API and save some waiting.
- threatripper 1y ago
  I second this. o3 is pretty spot on while 4o answered exactly like what the parent got. I rarely use 4o anymore for anything. Rather would I wait for o3 than quickly get a pile of rubbish.
  - brookst 1y ago
    4o is great for simple lookup and compute tasks; stuff like “scale this recipe to feed 12” or “what US wineries survived prohibition”. o3 all the way for anything needing analysis or creative thought.
- jug 1y ago
  These cases are probably why OpenAI has stated GPT-4.1 is their last non reasoning model and GPT-5 will determine the need for and how much to reason based on the query.

by bawana 1y ago

ogogmad 1y ago

Maybe you should use a reasoning model. Got this from O3, which took 1m31s to think about the answer: https://chatgpt.com/s/t_687b9221fb748191af4e30f597f18443 https://chatgpt.com/s/t_687b9221fb748191af4e30f597f18443 Bottom line: Your 5800X3D + 64 GB RAM + RTX 3090 will run Kimi K2’s 1.8‑bit build, but response times feel more like a leisurely typewriter than a snappy chatbot. If you want comfortable day‑to‑day use, plan either a RAM upgrade or a second (or bigger) GPU—or just hit the Moonshot API and save some waiting.

threatripper 1y ago
I second this. o3 is pretty spot on while 4o answered exactly like what the parent got. I rarely use 4o anymore for anything. Rather would I wait for o3 than quickly get a pile of rubbish.
- brookst 1y ago
  4o is great for simple lookup and compute tasks; stuff like “scale this recipe to feed 12” or “what US wineries survived prohibition”. o3 all the way for anything needing analysis or creative thought.
jug 1y ago
These cases are probably why OpenAI has stated GPT-4.1 is their last non reasoning model and GPT-5 will determine the need for and how much to reason based on the query.