calum-bird

4 ms·

1.
by calum-bird 2y ago
Do you have any resources you can share on managing the enclave’s public key? We found documentation to be sparse.
2.
Dream Added Humans to Minecraft(youtube.com)
3 points by calum-bird 2y ago|0 comments
3.
Show HN: Zero data retention LLMs as a service(trelent.com)
1 points by calum-bird 2y ago|0 comments
4.
by calum-bird 2y ago
So typically these providers only offer ZDR to "managed" customers, after a lengthy application process. For example, on Azure, "managed" means companies with >$1m, possibly more now, in annual spend. They don't
5.
by calum-bird 2y ago
We (disclosure: founder) do something similar at Trelent[1] but with an emphasis on security. Paid accounts can use OpenAI & Anthropic models, free ones just OpenAI. We have 3.5 sonnet live already. If you want to try it out lmk! Also t
6.
by calum-bird 3y ago
For efficiency, 132B. That way, at inference-time you get the speed of 36B params because you are only "using" 36B params at a time, but the next token might (and frequently does) need a different set of experts than the one befor
7.
BYOK Encryption Isn't Enough(trelent.com)
3 points by calum-bird 3y ago|0 comments
8.
Show HN: Trelent - Your team's fully-encrypted AI assistant(trelent.com)
5 points by calum-bird 3y ago|0 comments
9.
by calum-bird 3y ago
Trelent | Founding Engineer | REMOTE (US/Canada preferable) | $100k+ I am the founder of Trelent. We’re building a useful agent for RPA, with a distinctly structured & hierarchical approach to working with LLMs. We have pilot custo
10.
by calum-bird 4y ago
Copilot does inline completion right now - they implemented it into copilot as a pilot program[0] before OAI went live with that new model IIRC. [0]: https://openai.com/blog/gpt-3-edit-insert/
11.
by calum-bird 5y ago
Haha indeed, NLP is fun!
12.
by calum-bird 5y ago
Our website has a little more @ www.trelent.net. Working on a better way to showcase more examples. Will be inherently bias as we're selecting them (even if we try to take a fair sample of good/bad results), so best would be for y
13.
by calum-bird 5y ago
Totally get that. Working on locally-hosted version for enterprise use-case with this in mind. We are either paid in dollars or data, and I'd rather be transparent about that then hide it deep in a Privacy Policy.
14.
by calum-bird 5y ago
Haha I wish! That's just loading the weights for inference :)
15.
by calum-bird 5y ago
Please note: this does make use of a remote server, so use with caution. Working on locally-hosted version for anyone with ~48GB of VRAM (and change) to spare.
16.
Show HN: VS Code Extension to Document Code(marketplace.visualstudio.com)
9 points by calum-bird 5y ago|9 comments