brittlewis12

5 ms·

1.
by brittlewis12 1y ago
chat completions is stateless — you must provide the entire conversation history with each new message; openai stores nothing (at least nothing that the downstream product _can use_) beyond the life of the request. responses api, by contras
2.
by brittlewis12 2y ago
simple as two config options in `.zed/settings.json` (or `~/.config/zed/settings.json`): ``` { "telemetry": { "diagnostics": false, "metrics": false } } ``` for anyone who wants
3.
by brittlewis12 3y ago
I’m very sorry to hear you had such a poor experience as well. I’m sure it’s little consolation at this point having been inconvenienced as you have — it’s certainly not what I aim for in my work! I’ve just submitted a new update for review
4.
by brittlewis12 3y ago
Quick follow-up: I’ve just submitted a new update for review with a few small but hopefully noticeable changes, thanks to your feedback: 1. StableLM Zephyr 3b Q4_K_M is now the built-in model, replacing the Q6_K variant. 2. More aggressive
5.
by brittlewis12 3y ago
Sorry for the confusing experience, and thank you for sharing this! I’ve just submitted a new update for review with a few small but hopefully noticeable changes, thanks in no small part to your feedback: 1. StableLM Zephyr 3b Q4_K_M is now
6.
by brittlewis12 3y ago
FYI, just submitted a new update for review with a few small but hopefully noticeable changes, thanks in no small part to your feedback: 1. StableLM Zephyr 3b Q4_K_M is now the built-in model, replacing the Q6_K variant. 2. More aggressive
7.
by brittlewis12 3y ago
Thank you so much for taking the time to try it out!
8.
by brittlewis12 3y ago
Oh man I’m a big fan, swyx!! Latent Space & AI.engineer are fantastic resources to the community. Thank you for the kind words & the prompt! It’s still early days, but at a high level, I have a few goals: - expand accessibility and
9.
by brittlewis12 3y ago
Yes of course, I would very much appreciate that, if you’d be so generous — thank you! You can email britt [at] bl3 [dot] dev
10.
by brittlewis12 3y ago
That’s great to hear. I’m sorry again about that poor experience, and please do reach out if you have any other feedback! Britt
11.
by brittlewis12 3y ago
Conceptually, to the best of my understanding, nothing too serious; perhaps the inefficiency of processing a larger input than necessary? Practically, a few things: If you want to have your cake & eat it too, they recommend Enumerated S
12.
by brittlewis12 3y ago
I’m very sorry about your experience. That’s definitely not what I was aiming for, and I can imagine that was a nasty surprise. Any hang like that is unacceptable, full stop. My understanding is Metal is currently causing hangs on devices w
13.
by brittlewis12 3y ago
Wow, thanks so much for taking the time to test it out and share such great feedback! Thrilled about all those developments! More model options as well as link-based GGUF downloads on the way. On the 7b models: I’m very sorry for the poor e
14.
by brittlewis12 3y ago
TL;DR: No, nearly all these apps will use GPU (via Metal), or CPU, not Neural Engine (ANE). Why? I suggest a few main reasons: 1) No Neural Engine API 2) CoreML has challenges modeling LLMs efficiently right now. 3) Not Enough Benefit (Fo
15.
by brittlewis12 3y ago
you can absolutely access and continue all your past chats in cnvrs! would love to hear what you think: https://testflight.apple.com/join/ERFxInZg
16.
by brittlewis12 3y ago
would love for you to give cnvrs a shot! - save characters (system prompt + temperature, and a name & cosmetic color) - download & experiment with models from 1b, 3b, & 7b, and quant options q2k, q4km, q6k - save, search, contin