mediaman

16 ms·

241.
by mediaman 3y ago
The industry is troubled both by hype marketers who believe LLMs are superhuman intelligence that will replace all jobs, and cynics who believe they are useless word predictors. Some workloads are well-suited to LLMs. Roughly 60% of applica
242.
by mediaman 3y ago
What are they going to investigate? The FTC is going to render contractual terms negotiated in good faith between well-represented and sophisticated commercial buyers “just because”? If a big buyer wants better terms, the seller might give
243.
by mediaman 3y ago
I think most of them allow for that. Works in vscode and vscode-derived (e.g., cursor) editors.
244.
by mediaman 3y ago
Seconding Supermaven here, from the guy that made Tabnine. Supermaven has a 300k token context. It doesn't seem like it has a ton of intelligence -- maybe comparable to copilot, maybe a bit less -- but it's much better at picking
245.
by mediaman 3y ago
Generally, it seems that people are starting to see more problems when making vectors of fewer than 1,000 dimensions binary.
246.
by mediaman 3y ago
LLMs are quite good at text based tasks such as summarization and extracting entities. These generally don't require advanced logic or thought, though they can require some moderate reasoning ability to summarize two slightly conflicti
247.
by mediaman 3y ago
As a point of reference on pricing, convertAPI charges $0.05 per document conversion at their most expensive tier, and with any level of fixed commitment ($80 - $300 per month) it goes down to $0.016-0.006 per document. Their PDF conversion
248.
by mediaman 3y ago
The creator of tabnine also just released supermaven. I’ve liked it so far because it’s fast and holds a lot more of my project in context (300k tokens) so it’s better at using data structures or functions I’ve defined elsewhere.
249.
by mediaman 3y ago
People here upset about refusals seem to not understand the market for AI, who the customers are, or where the money is. The target market is large companies who will pay significant sums of money to save hundreds of millions, or billions,
250.
by mediaman 3y ago
People like us are not the real users. Corporate users of AI (and this is where the money is) do want safe models with heavy guardrails. No corporate AI initiative is going to use an LLM that will say anything if prompted.
251.
by mediaman 3y ago
There is a lot of emerging evidence that ability to reason, and ability to compare within-context dramatically declines with large context. It is unable to find edits: https://twitter.com/mengdi_en/status/176333824
252.
by mediaman 3y ago
Right now I just throw the different questions together in a single embedding for a given chunk, with the idea that there’s enough dimensionality to capture them all. But I haven’t tested embedding each question, matching on that vector, an
253.
by mediaman 3y ago
A lot of people in RAG already do this. I do this with my product: we process each page and create lists of potential questions that the page would answer, and then embed that. We also embed the actual text, though, because I found that onl
254.
by mediaman 3y ago
Agreed with this. The leading ability AI (in terms of cognitive power) will, generally, cost more per token than lower cognitive power AI. That means that at a given budget you can choose more cognitive power with fewer tokens, or less cogn
255.
by mediaman 3y ago
Knowledge transfer over generations is a function of the brain. Other species have much more limited ability to transfer knowledge intergenerationally, and that is because the human brain's capability for symbolic language is much more
256.
by mediaman 3y ago
3.5 has JSON mode as of the November release, but only in the November-dated model: gpt-3.5-turbo-1106. I found it to reliably produce JSON correctly, but I've found 3.5 to be a poor performer at things like entity extraction and follo
257.
by mediaman 3y ago
This study had management consultants use GPT4 on a variety of different management consultant tasks. Some were more creative in nature, and some were more analytical. For example, ideas on marketing sneakers versus an analysis of store per
258.
by mediaman 3y ago
RAG, at its core, is a very human way of doing research, because RAG is essentially just building a search mechanism for a reasoning engine. Much like human research. Your boss asks you to look into something, and you do it through a combin
259.
by mediaman 3y ago
When people say "inflation is easing," they do not mean negative inflation. We have a word for that: deflation. "Inflation is easing" means the rate of inflation is declining. If they meant deflation, they would say defl
260.
by mediaman 3y ago
What's the commercial office tenants' incentive to bail out CME debt funds?
261.
by mediaman 3y ago
Several OpenAI employees have said on Twitter that they are looking into this and developing a fix. It sounds as though it was not an intentional regression since they are implicitly acknowledging it. Could be an unintentional side effect o
262.
by mediaman 3y ago
The problem with this analysis is the premise: that it "takes time to hire someone." This is not an interview process for hiring a junior dev at FAANG. If you're Sam & Greg, and Satya gives you an offer to run your own op
263.
by mediaman 3y ago
Yes, all the reporting pointed to his attempts to raise money externally for an AI chip company, and specifically soliciting sovereign wealth funds. I could understand board concerns about him being spread too thin, but more chip competitio
264.
by mediaman 3y ago
These are extremely safe conjectures. 84% of OpenAI employees have signed a statement that they will leave OpenAI if the board does not resign. The letter they signed states that Microsoft has made an open offer to any OpenAI employee. And
265.
by mediaman 3y ago
It sounds like you have a pretty antiquated view of manufacturing. It looks nothing like what you are calling it: "low value commodity bodies to screw things on." No offense to you in particular, but it sounds like you haven'
266.
by mediaman 3y ago
You don't see value in retrieval augmented generation? It seems like one of the major use cases in knowledge management in larger organizations that is hard to replicate without an LLM. They also seem to work very well for summarizing
267.
by mediaman 3y ago
There have been two criticisms of this paper floating around. 1. The test mechanism is to use prediction of sinusoidal series. While it's certainly possible to train transformers on mathematical functions, it's not clear why findi
268.
by mediaman 3y ago
Their system also does not seem to support techniques like hybrid search, automated cleaning/modifying of chunks prior to embedding, or the ability to access citations used, all of which are pretty important for enterprise search. Coul
269.
by mediaman 3y ago
In my own RAG implementations in the industrial sector, I've found it effective to first have the AI decide whether it needs to search at all. If it doesn't, the answers are much better.
270.
by mediaman 3y ago
PTO is paying people to not work. There is no financial difference between paying someone to not work one day every two weeks, and having them show up that day but not do anything (which we can agree would be unproductive). Paying someone t

More ›