ttul

53 ms·

751.
by ttul 3y ago
If you send through Cloudflare Workers using MailChannels, the sending is free with no cap.
752.
by ttul 3y ago
The key differences between multi-head attention in Transformers and the proposed multi-scale retention (MSR) in RetNets are: - Retention replaces the softmax in attention with an exponential decay along the sequence dimension. This allows
753.
by ttul 3y ago
And given that the inference code has access to the entire vector, it's the logical place to put this filtering... OpenAI and other LLM APIs probably don't want to return the entire token probability vector to the user because it&
754.
by ttul 3y ago
A convenience feature in any inference API would be to specify a shortcut to a standardized grammar such as HTML, JSON, Python, etc. It is frankly strange to me that OpenAI have not already done this, considering the obvious effort they und
755.
by ttul 3y ago
I read the code. Guidance seems designed to work well with OpenAI's chat completion API. When you ask Guidance to choose from a set of options, it breaks the list into a tree of tokens and then walks this tree, providing the next set o
756.
by ttul 3y ago
Oh well, it’s good enough for writing automated responses to scam and cold prospecting emails…
757.
by ttul 3y ago
The mixture of experts approach was found to be inferior than a straightforward transformer. However, researchers discovered that MoE models give substantially better results when guided by fine-tuning. My guess is that GPT-4 was an experim
758.
by ttul 3y ago
I ought to have noted sarcasm.
759.
by ttul 3y ago
I tried the prime number problem and GPT-4 nailed it. I’m not sure whether they are testing things correctly… “ Sure, let's go step by step. A prime number is a number greater than 1 that has no positive divisors other than 1 and itsel
760.
by ttul 3y ago
Those are definitely “step two” once you have managed to get the relevant services running. Fortunately, spam and basic phishing filtering isn’t too hard at small scale. You can get free access to very high quality blocklists for non-commer
761.
by ttul 3y ago
The developer is a beast. This is a huge project to build from scratch. So much territory to cover.
762.
by ttul 3y ago
Thank you. The journal article is a whole lot less sensational. “ In this Article, we argue that venture predation can harm consumers, distort market incentives, and misallocate capital away from genuine innovations. We consider reforms to
763.
by ttul 3y ago
As a choral singer, if there’s an app that one day allows me to sing with a fake choir of extremely good singers, I would enjoy doing that all day long. And it would allow my actual choir to practice way more, making our performances far be
764.
by ttul 3y ago
Are you truly that stupid to think that the following is true: 1. That an actual cartel rep would be the person you are talking to, vs. someone undercover with law enforcement who is merely lining up facts with which to arrest and charge yo
765.
by ttul 3y ago
First, fentanyl is only one of many adjuvants that are mixed with illegal street drugs. Far more exotic compounds exist and are circulating. The issue is that illegal drug labs aren’t necessarily mixing the adjuvant in correctly. There can
766.
by ttul 3y ago
Instead of risking your life, ruining your career, and ending up on do-not-fly lists, why not get involved in politics? If your idea has merit, promote it through the actual democratic process. Your concept of working with cartels is beyond
767.
by ttul 3y ago
<sarcasm> Oh, hello Chris. I work for yet another competing cartel and we would also _love_ to get in touch and discuss the idea in detail. To skip the formalities and get right down to business, we’ve already got someone watching you
768.
by ttul 3y ago
If they are asking about price early in the discussions, it can be a buying signal. It indicates that someone there intends to buy and needs to know what kinds of haggling they’ll have to do internally to get it approved. Enterprises are ju
769.
by ttul 3y ago
Sure there is pain, but 5,000 seats all at once is usually worth it. The thing to avoid like the plague is RFPs. They will kill your startup faster than anything. Your customers should be early adopters and early markets do not do RFPs.
770.
by ttul 3y ago
Your journey will be unique, so take everyone’s advice with a grain of salt. However, here is one thing I have learned about pricing after two decades of recurring revenue software and services: you can ALWAYS raise your price. Many people
771.
Ask HN: A good place to discuss AI papers
3 points by ttul 3y ago|3 comments
772.
by ttul 3y ago
In the 1990s, even as a software developer, I never answered emails after working hours. Why? Because we didn’t have access to the office mail server outside the office. It was physically impossible to work from home. Add to this the fact t
773.
by ttul 3y ago
I don’t deal with Istio daily but I observed it sucked up a vast number of hours. Mysterious cracks seem to lurk in its bowels but nobody has any idea precisely where because it’s such a complex beast. Beware.
774.
by ttul 3y ago
The figure is slightly misleading because it’s a measure of year-on-year change in CPI, rather than being a point-in-time measurement, as many assume it to be. June’s one month CPI increase was 0.2%, coming on the heels of May at 0.1%. The
775.
by ttul 3y ago
I wonder how long it will be before Google Workspace just has this feature for your Docs. It can't be long... Question-answering against external docs is something Google could easily add. I worry about the defensibility of startups wo
776.
by ttul 3y ago
Tax incentives for property investing are ridiculous in many countries. In Canada, the capital gains on the sale of your primary residence are tax-free. You just have to live there for about a year. People move annually, flipping as they go
777.
by ttul 3y ago
Chain of thought is an in-context technique. The ensemble of models concept that GPT-4 supposedly uses works within the model itself. My understanding of the relevant papers is poor, but my impression is that there are layers that help the
778.
by ttul 3y ago
If this is indeed the secret sauce behind GPT-4, I would expect it to be replicated in short order, hopefully in open source. Iteration on this more successful architecture will then proceed more rapidly since the architecture will be open
779.
by ttul 3y ago
Story time. At ActiveState, my colleague and I - both fresh out of school - were tasked with building a regular expression debugger for the Komodo editor. We hired the legendary Perl guru Mark Jason Dominus to hack some hooks into Perl’s re
780.
by ttul 3y ago
I'd settle for being able to live not in a tent or van short-term.

More ›