4 ms·
I did consider it at one point the problem is that the prompt and instruction following for formating and extracting tags, nouns etc and the json returns are un
by arisAlexis 2mo ago
I did consider it at one point the problem is that the prompt and instruction following for formating and extracting tags, nouns etc and the json returns are unreliable if you switch models and especially if it's an older model. right now i'm using Gemma 4 and works smoothly so it would need to be BYOK for gemma only which is doable. If more people ask I could do it sure.
- sgc 2mo agoI would not use a personal journaling app that didn't give me that type of control, so here's one more asking :)
- arisAlexis 2mo agothe best would be on device inference only but we need maybe 6 months for a small model to match capabilities yet. I wanted to do it like that but even my pixel 10 suffered.