4 ms·

Is this just llmfit but a web version of it? https://github.com/AlexsJones/llmfit https://github.com/AlexsJones/llmfit

• deanc 7mo ago
  Yes. But llmfit is far more useful as it detects your system resources.
  • dgrin91 7mo ago
    Honestly I was surprised about this. It accurately got my GPU and specs without asking for any permissions. I didnt realize I was exposing this info.
    • dekhn 7mo ago
      How could it not? That information is always available to userspace.
      • bityard 7mo ago
        "Available to userspace" is a much different thing than "available to every website that wants it, even in private mode". I too was a little surprised by this. My browser (Vivladi) makes a big deal about how privacy-conscious they are, but apparently browser fingerprinting is not on their radar.
        • swiftcoder 7mo ago
          It's pretty hard to avoid GPU fingerprinting if you have webgl/webgpu enabled
        • dekhn 7mo ago
          We switched to talking about llmfit in this subthread, it runs as native code.
    • rithdmc 7mo ago
      Do you mean the OPs website? Mine's way off. > Estimates based on browser APIs. Actual specs may vary
    • spudlyo 7mo ago
      I run LibreWolf, which is configured to ask me before a site can use WebGL, which is commonly used for fingerprinting. I got the popup on this site, so I assume that's how they're doing it.
      • deleted 7mo ago
        [deleted]
    • johnisgood 7mo ago
      Why were you surprised? You can check out here how it does that: https://github.com/AlexsJones/llmfit/blob/main/llmfit-core/src/hardware.rs#L1318 https://github.com/AlexsJones/llmfit/blob/main/llmfit-core/s... To detect NVIDIA GPUs, for example: https://github.com/AlexsJones/llmfit/blob/main/llmfit-core/src/hardware.rs#L258 https://github.com/AlexsJones/llmfit/blob/main/llmfit-core/s... In this case it just runs the command "nvidia-smi". Note: llmfit is not web-based.
  • Someone1234 7mo ago
    I feel like they both solve different issues well: - If you already HAVE a computer and are looking for models: LLMFit - If you are looking to BUY a computer/hardware, and want to compare/contrast for local LLM usage: This You cannot exactly run LLMFit on hardware you don't have.
    • shrinks99 7mo ago
      Yes, but you can get LLMFit to recommend hardware requirements with `llmfit plan --context <TOKENS> <MODEL>`.
• rootusrootus 7mo ago
  That's super handy, thanks for sharing the link. Way more useful than the web site this post is about, to be honest. It looks like I can run more local LLMs than I thought, I'll have to give some of those a try. I have decent memory (96GB) but my M2 Max MBP is a few years old now and I figured it would be getting inadequate for the latest models. But llmfit thinks it's a really good fit for the vast majority of them. Interesting!
  • hrmtst93837 7mo ago
    [flagged]