3 ms·

Local LLMs

• DonHopkins 10mo ago
  Be sure to bring an extra power strip for all your plugs and adaptors. https://www.tomshardware.com/pc-components/gpus/tiny-corp-successfully-runs-an-nvidia-gpu-on-arm-macbook-through-usb4-using-an-external-gpu-docking-station https://www.tomshardware.com/pc-components/gpus/tiny-corp-su...
  • lostmsu 10mo ago
    My laptop runs gpt-oss 120B with none of that. Don't know how long though. I suspect a couple of hours continuous.
    • HWR_14 10mo ago
      Which laptop?
      • lostmsu 10mo ago
        ROG Flow Z13 with maxxed out RAM.
        • red-iron-pine 10mo ago
          how is anyone going to be able to take a test with all of the noise from that fan as it cranks through tokens?
          • DonHopkins 10mo ago
            Offer to make everyone espresso and macchiato with you GPU cooling module. They won't be able to hear the fan over the grinder and pump and milk foamer!
          • lostmsu 10mo ago
            You can make it as slow as you want. At half TDP it is silent.
        • HWR_14 10mo ago
          Nice laptop. I love my current laptop in general, but it is lagging in performance.