3 ms·

I created "apfel" https://github.com/Arthur-Ficial/apfel https://github.com/Arthur-Ficial/apfel a CLI for the apple on-device local foundation model (Apple inte

by franze 7mo ago

I created "apfel" https://github.com/Arthur-Ficial/apfel https://github.com/Arthur-Ficial/apfel a CLI for the apple on-device local foundation model (Apple intelligence) yeah its super limited with its 4k context window and super common false positives guardrails (just ask it to describe a color) ... bit still ... using it in bash scripts that just work without calling home / out or incurring extra costs feels super powerful.

AbuAssar 7mo ago
nice project, thanks for sharing. any plans for providing it through brew for easy installation?
- franze 7mo ago
  good idea
- woadwarrior01 7mo ago
  There's a very similar afm CLI that can be installed via Homebrew. https://github.com/scouzi1966/maclocal-api https://github.com/scouzi1966/maclocal-api
  - franze 7mo ago
    done brew tap Arthur-Ficial/tap brew install Arthur-Ficial/tap/apfel
    - jedahan 7mo ago
      No need for the extra tap step, this works fine alone: brew install Arthur-Ficial/tap/apfel
- grosswait 7mo ago
  Looks like they just added homebrew tap to the instructions
LeoDaVibeci 7mo ago
Honestly I can't believe Apple put that foundation model product out the door. I was so excited about it, but when I tried it, it was such a disappointment. Glad to hear you calling that out so I know it wasn't just me. Looks like they have pivoted completely over to Gemini, thank god.
- franze 7mo ago
  yeah, it is super limited but also you can now do cmd(){ local x c r a; while [[ $1 == -* ]]; do case $1 in -x)x=1;shift;; -c)c=1;shift;; *)break;; esac; done; r=$(apfel -q -s 'Output only a shell command.' "$*" | sed '/^```/d;/^#/d;s/^[[:space:]]*//;/^$/d' | head -1); [[ $r ]] || { echo "no command generated"; return 1; }; printf '\e[32m$\e[0m %s\n' "$r"; [[ $c ]] && printf %s "$r" | pbcopy && echo "(copied)"; [[ $x ]] && { printf 'Run? [y/N] '; read -r a; [[ $a == y ]] && eval "$r"; }; return 0; } cmd find all swift files larger than 1MB cmd -c show disk usage sorted by size cmd -x what process is using port 3000 cmd list all git branches merged into main cmd count lines of code by language without calling home or downloading extra local models and well, maybe one day they get their local models .... more powerful, "less afraid" and way more context window.
  - beepbooptheory 7mo ago
    What is the AI doing here? Or is this just like being cheeky?
    - dgacmu 7mo ago
      The pile of shell and sed is cleaning up the ai output and then running it in the shell. The instruction to the AI was to create _a_ shell command. So it's a random shell command generator (maybe).
      - corndoge 7mo ago
        that part is the system prompt, the script is a function that takes a prompt describing a shell command as an argument
3yr-i-frew-up 7mo ago
[dead]
JumpCrisscross 7mo ago
…is it a reference to apfelwein?
- deleted 7mo ago
  [deleted]
- franze 7mo ago
  just german for apple, cause reasons
  - JumpCrisscross 7mo ago
    I thought it was a reference to Wine, the Linux Wine, and then thought of apfelwein. Nvm!
chid 7mo ago
this is real neat. I'll give it a spin.
podlp 7mo ago
Neat! I’ve actually been building with AFM, including training some LoRA adapters to help steer the model. With the right feedback mechanisms and guardrails, you can even use it for code generation! Hopefully I’ll have a few apps and tools out soon using AFM. I think embedded AI is the future, and in the next few years more platforms will come around to AI as a local API call, not an authorized HTTP request. That said, AFM is still incredibly premature and I’m experimenting with newer models that perform much better.
_doctor_love 7mo ago
Dieser apfel ist sehr lecker!
newman314 7mo ago
This is quite interesting. I wonder if AFM is smart enough to do spam classification.
Multiplayer 7mo ago
this is great! Incredibly fast and is working pretty well running loads on my m4 max studio. Weirdly though I'm getting things like this: Apple FM is fast and free but has a hard limitation — it can't process prompts with Spanish/non-English words, which is a dealbreaker for California and Southwest real estate where half the street names are Spanish.

by franze 7mo ago

AbuAssar 7mo ago

nice project, thanks for sharing. any plans for providing it through brew for easy installation?

franze 7mo ago
good idea
woadwarrior01 7mo ago
There's a very similar afm CLI that can be installed via Homebrew. https://github.com/scouzi1966/maclocal-api https://github.com/scouzi1966/maclocal-api
- franze 7mo ago
  done brew tap Arthur-Ficial/tap brew install Arthur-Ficial/tap/apfel
  - jedahan 7mo ago
    No need for the extra tap step, this works fine alone: brew install Arthur-Ficial/tap/apfel
grosswait 7mo ago
Looks like they just added homebrew tap to the instructions

LeoDaVibeci 7mo ago

Honestly I can't believe Apple put that foundation model product out the door. I was so excited about it, but when I tried it, it was such a disappointment. Glad to hear you calling that out so I know it wasn't just me. Looks like they have pivoted completely over to Gemini, thank god.

franze 7mo ago
yeah, it is super limited but also you can now do cmd(){ local x c r a; while [[ $1 == -* ]]; do case $1 in -x)x=1;shift;; -c)c=1;shift;; *)break;; esac; done; r=$(apfel -q -s 'Output only a shell command.' "$*" | sed '/^```/d;/^#/d;s/^[[:space:]]*//;/^$/d' | head -1); [[ $r ]] || { echo "no command generated"; return 1; }; printf '\e[32m$\e[0m %s\n' "$r"; [[ $c ]] && printf %s "$r" | pbcopy && echo "(copied)"; [[ $x ]] && { printf 'Run? [y/N] '; read -r a; [[ $a == y ]] && eval "$r"; }; return 0; } cmd find all swift files larger than 1MB cmd -c show disk usage sorted by size cmd -x what process is using port 3000 cmd list all git branches merged into main cmd count lines of code by language without calling home or downloading extra local models and well, maybe one day they get their local models .... more powerful, "less afraid" and way more context window.
- beepbooptheory 7mo ago
  What is the AI doing here? Or is this just like being cheeky?
  - dgacmu 7mo ago
    The pile of shell and sed is cleaning up the ai output and then running it in the shell. The instruction to the AI was to create _a_ shell command. So it's a random shell command generator (maybe).
    - corndoge 7mo ago
      that part is the system prompt, the script is a function that takes a prompt describing a shell command as an argument

3yr-i-frew-up 7mo ago

[dead]

JumpCrisscross 7mo ago

…is it a reference to apfelwein?

deleted 7mo ago
[deleted]
franze 7mo ago
just german for apple, cause reasons
- JumpCrisscross 7mo ago
  I thought it was a reference to Wine, the Linux Wine, and then thought of apfelwein. Nvm!

chid 7mo ago

this is real neat. I'll give it a spin.

podlp 7mo ago

Neat! I’ve actually been building with AFM, including training some LoRA adapters to help steer the model. With the right feedback mechanisms and guardrails, you can even use it for code generation! Hopefully I’ll have a few apps and tools out soon using AFM. I think embedded AI is the future, and in the next few years more platforms will come around to AI as a local API call, not an authorized HTTP request. That said, AFM is still incredibly premature and I’m experimenting with newer models that perform much better.

_doctor_love 7mo ago

Dieser apfel ist sehr lecker!

newman314 7mo ago

This is quite interesting. I wonder if AFM is smart enough to do spam classification.

Multiplayer 7mo ago

this is great! Incredibly fast and is working pretty well running loads on my m4 max studio. Weirdly though I'm getting things like this: Apple FM is fast and free but has a hard limitation — it can't process prompts with Spanish/non-English words, which is a dealbreaker for California and Southwest real estate where half the street names are Spanish.