sachamorard

6 ms·

1.
Promising inference software, written in Zig(zml.ai)
4 points by sachamorard 3mo ago|0 comments
2.
by sachamorard 3mo ago
What does that have to do with the topic? Someone is sharing something serious on this thread, I don't see how your message helps.
3.
by sachamorard 3mo ago
It's far from being a foolish idea, and it seems to me that the project correctly documents its own limitations. It's rare to see a README list so precisely where the tool falls short. Then, yes, input tokens are cheaper than outp
4.
by sachamorard 6mo ago
More info in the GitHub repo, in the reports folder (sorry, I'm not sure I can add the link here without being flagged). "Codex + Edgee consumes roughly half the fresh tokens of the normal Codex baseline. Output tokens are margina
5.
by sachamorard 6mo ago
The compaction problem described here is worse than it looks because of the asymmetry between the compactor and the reader. The model doing the compaction has full access to everything, it can see all six rules in the policy, the exact budg
6.
Retry and fallback strategies for LLM requests(edgee.ai)
4 points by sachamorard 6mo ago|1 comments
7.
Show HN: Edgee – We Made Claude Pro Last 26.5% Longer(youtube.com)
8 points by sachamorard 7mo ago|0 comments
8.
by sachamorard 7mo ago
Cool idea. I have had rather a bad experience with semantic caching. Do you have benchmarks that demonstrate the effectiveness?
9.
by sachamorard 7mo ago
Really cool concept! The spatial sorting into llms.txt is a clever touch. ;)
10.
by sachamorard 8mo ago
That's exactly the trade-off we're pointing at. One nuance we've been seeing in practice is that the "utility" of a token isn't purely semantic: some tokens carry behavioral constraints (negations, numeric boun
11.
Token Compression, achieving more with less(edgee.ai)
8 points by sachamorard 8mo ago|3 comments
12.
Optimizing AI Inference with Edge Computing(edgee.cloud)
8 points by sachamorard 1y ago|0 comments
13.
Edgee Announces Edge Functions Components Powered by WebAssembly(edgee.cloud)
6 points by sachamorard 1y ago|0 comments
14.
Replacing Javascripts SDKs with WebAssembly Components at Edge(fastly.com)
6 points by sachamorard 1y ago|1 comments
15.
Server-Side Tagging versus Edge Component Platform(edgee.cloud)
6 points by sachamorard 1y ago|0 comments
16.
How WebAssembly Components Can Replace JavaScript SDKs?(edgee.cloud)
6 points by sachamorard 2y ago|0 comments
17.
by sachamorard 2y ago
For years, JavaScript SDKs have been the go-to solution for integrating third-party services into web applications: analytics, A/B testing, tracking, personalization, and more. Let's hope Edgee Components will help developers to u
18.
Things you didn't know about WebAssembly(edgee.cloud)
1 points by sachamorard 2y ago|1 comments
19.
by sachamorard 2y ago
WebAssembly could change how we build and deploy applications, offering cross-platform portability, near-native performance, and enhanced security. Our latest article delves into five lesser-known aspects of Wasm, providing code examples an
20.
by sachamorard 2y ago
Excellent article, Alex! It does a good job of outlining the differences between edge computing and cloud computing. A conversation that becomes increasingly relevant as architectures evolve.
21.
by sachamorard 2y ago
On the other hand, what I find interesting is not at all the political substance of what Macron says, but rather the fact that he agreed to take part in a format that usually welcomes very different people.
22.
French President Macron is guest on a podcast usually reserved for entrepreneurs(gdiy.fr)
2 points by sachamorard 2y ago|3 comments
23.
by sachamorard 2y ago
The well-known podcast GDIY (Do It Yourself Generation in English) hosted French President Emmanuel Macron and has just published the episode. What's really crazy is that this podcast usually hosts European entrepreneurial figures. In
24.
Fastly CDN to Accelerate LLM(investors.fastly.com)
3 points by sachamorard 2y ago|1 comments
25.
by sachamorard 2y ago
Fastly just dropped a new feature called "AI Accelerator." I haven’t had the chance to play around with it yet, but I’m really keen to see how they're managing to speed up inference processes with clever caching. Sounds prett