sdesol

19 ms·

241.
by sdesol 2y ago
> Human brains are unpredictable. Look around you. As it was mentioned by others, we've had thousands of years to better understand how humans can fail. LLMs are black boxes and it never ceases to amaze me how they can fail in such
242.
by sdesol 2y ago
Can you ask for the prompt when chatting?
243.
by sdesol 2y ago
why not s11?
244.
by sdesol 2y ago
Yes and no. I've found the order in which you give instructions matters for some models as well. With LLMs, you really need to treat them like black boxes and you cannot assume one prompt will work for all. It is honestly, in my experi
245.
by sdesol 2y ago
I haven't found a model at the price point of GPT-4o mini that is as capable. Based on the hype surrounding Llama 3.3 70B, it might be that one though. On Deepinfra, input tokens are more expensive, but the output token is cheaper so
246.
by sdesol 2y ago
> For example, write a simple pipeline where Claude would scrutinize OpenAI's answers and vice versa. I'm working on a naive approach to identify errors in LLM responses which I talk about at https://news.ycombinator
247.
by sdesol 2y ago
For regular users I agree, for businesses, it will have to be a shotgun approach in my opinion. Edit: I should add, for businesses, it isn't about better, but more about risk as the better model can still be wrong.
248.
by sdesol 2y ago
For those not familiar with DuckDB, it's an amazing database, but it is not a replacement for SQLite, if you are looking for a lightweight server side DB. I'm in love with the DuckDB client and use it to query SQLite databases, bu
249.
by sdesol 2y ago
> We'll have to see if the bump to $22 this year ends up happening. I can't read the article. Any mention of the API pricing?
250.
by sdesol 2y ago
> cheapest AI model when asking questions and then switch to the more expensive if it doesn't work. The thing is, more expensive isn't guaranteed to be better. The more expensive models are better most of the time, but not all
251.
by sdesol 2y ago
Yes, that is the point. The customer service person would be most able to determine if what the LLM said makes sense or not. My point is, we are sold automation instead of a power tool.
252.
by sdesol 2y ago
I've said before, but I'm not convinced LLM should be public facing. I know some companies have been burned by them and in my opinion, LLM should be about helping customer support people find answers faster.
253.
by sdesol 2y ago
> Achieving accuracy with RAG and LLMs is a challenging task that requires balancing precision and recall The challenge is domain knowledge and not tech in my opinion. There are dozens if not hundreds of companies providing RAG and LLM,
254.
by sdesol 2y ago
Well if you ask GPT-4o the following: Give me keywords to search for based on this sentence "international relations about the country with the capital city of Ankara" You get the following: - Turkey international relations - Anka
255.
by sdesol 2y ago
I think anything requiring strong reasoning will probably have issues. However, I think most Enterprises is only interested in knowing that the summary of a document doesn't contain hallucinations, which I think most models will proba
256.
by sdesol 2y ago
Probably in a couple of weeks. It's taken a while to finalize the UX but I know what it should look like now.
257.
by sdesol 2y ago
I'm working on a rather naive approach that is focused on identifying errors in a LLM response by using LLMs. What I can share right now are screenshots with regards to how it works. The basic idea is you can use other high-quality mod
258.
by sdesol 2y ago
> Different models have different strengths and weaknesses I would add different errors as well. Here are two examples where GPT-4o and Claude 3.5 Sonnet cannot tell that "GitHub" is spelled like "GitHub". GPT-4o: h
259.
by sdesol 2y ago
In addition to what you said, faster searches can also provide different search options. For example, if you can execute five similar searches in the same time that it would take to execute one. You now have the option to ask "Can I l
260.
by sdesol 2y ago
> Who cares if a LLM can spit out an opinion on some political sensitive subject? Other governments?
261.
by sdesol 2y ago
> I think the process could be automated It can definitely be automated in my opinion, if you go with a supermajority workflow. Something that I've noticed with LLMs is it's very unlikely for all high-quality LLM models to be
262.
by sdesol 2y ago
If you look at my post history, you can see an example of how claude and openai can not tell that GitHub is spelled correctly. The end result won't make a difference but it raises questions regarding how else it can misinterpret things
263.
by sdesol 2y ago
Something that I'm working on is making it easy to fix spelling and grammatical errors in documents that can affect BM25 and embeddings. So in addition to generating keyword/metadata with LLM, you could also ask it to clean the d
264.
by sdesol 2y ago
> Hypothetical answer generation from a query using an LLM, and then using that hypothetical answer to query for embeddings works really well. This is honestly wear I think LLM really shines. This also gives you a very good idea if your
265.
by sdesol 2y ago
Expect to be able to try it by the end of this month if I am lucky. It will be a simple one line docker pull command or if you want to install it, use npm.
266.
by sdesol 2y ago
Yes I agree if the prompt that was used was less strict with regards to verb tense, prepositions and so forth. I wrote this prompt for use for technical writing, which may not fit the style of the author.
267.
by sdesol 2y ago
I guess I was a bit direct but I don't fully understand the down vote. I was not implying that the README was bad and it does have corrections that would improve it. My reason for not raising a PR is some repo owners don't care a
268.
by sdesol 2y ago
This ultimately why I believe Microsoft and Apple will be the big winners. I suspect a lot of companies will want Microsoft and Apple to sign off on things and Microsoft and Apple are going to make sure they get their cut. We may need a ne
269.
by sdesol 2y ago
Once you have created your README, you might want to consider using a tool that I'm currently working on. I'm focused on fixing the "garbage in, garbage out" problem for RAG by focusing on spelling and grammar, among oth
270.
by sdesol 2y ago
We are entering the nondeterministic programming era in my opinion. LLM applications will be designed with the idea that we can't be 100% sure and what ever solution can provide the most safe guards, will probably be the winner.

More ›