sdesol

18 ms·

211.
by sdesol 2y ago
No, it is much more involved and not all providers allow the necessary tweakings. This means you will need to use local models (with hardware caveats) which will require us to ask: - Are local models good enough? - What are we giving up fo
212.
by sdesol 2y ago
> Cheap code can be had by hiring in cheap locations (outsourced for example). If you outsource and like what you get, you would assume the place you outsourced to can help provide continued support. What assurance do you have with LLMs?
213.
by sdesol 2y ago
> unhampered by OpenAI’s schedule Sure, but if the advancements are to catch up to OpenAI, then major improvements by other vendors are nice and all, but I don't believe that was what the commenter was implying. Right now the leader
214.
by sdesol 2y ago
> assuming you have full control over which compiler youre using for each step ;) With existing tools, we know if we need to do something, we can. The issue with LLMs, is they are very much black boxes. > What's to say LLMs will
215.
by sdesol 2y ago
> we can expect major improvements every few months. I'm not sure this is grounded in reality. We've already seen articles related to how OpenAI is behind schedule with GPT-5. I do believe things will improve over time, mainly
216.
by sdesol 2y ago
> Machine -> Asm -> C -> Python -> LLM (Human language) Something that you neglected to mention is, with every abstraction layer up to Python, everything is predictable and repeatable. With LLMs, we can give the exact same in
217.
by sdesol 2y ago
I would say this is true until we hit a "oh shit, they can really sue us, even if we warn them" moment. I'm imagining legislation will come into play that will make it less ideal for business critical solutions. I know Air C
218.
by sdesol 2y ago
I asked a bunch of LLMs using your prompt. The only change was to just use meters. https://beta.gitsense.com/?chat=bb57a248-e14a-4f33-bbe9-2fa9... 1622m is most agreed upon. The interesting numbers are the ones with less t
219.
by sdesol 2y ago
Thanks for the info on local LLMs. Based on my chats with multiple LLMs, the biggest issue appears to be hardware. Non-deterministic hardware: All LLMs mentioned that modern computing hardware, such as GPUs or TPUs, can introduce non-deter
220.
by sdesol 2y ago
I agree with this. I keep harping on this, but we are sold automation instead of a power tool. If you have domain knowledge in the problem that you are solving, then LLMs can become an extremely valuable aid.
221.
by sdesol 2y ago
> LLMs are, at their core, search tools. This is the wrong take. Search tools are deterministic unless you purposely inject random weights into the ranking. With search tools, the same search query will always yield the same search resu
222.
by sdesol 2y ago
I asked a bunch of models to review the Phind response at https://beta.gitsense.com/?chats=a5d6523c-0ab8-41a8-b874-b31... The left side contains the Phind response that I got and the right side contains a review of the resp
223.
by sdesol 2y ago
> whether Kotaemon as a standalone tool will be needed for much longer. I think a lot of AI startups will find themselves in this situation. Searching and summarizing docs is a no-brainer for OpenAI, Anthropic, etc. The only issue they
224.
by sdesol 2y ago
> Perhaps stemming from the over-broad term “AI”. No, I think if we follow the money, we will find the problem.
225.
by sdesol 2y ago
Like I've said before, this isn't a physical good that is being sold. LLM is knowledge and many governments and people are going to be concerned with how and who is packaging it. Using LLMs created by China will mean certain even
226.
by sdesol 2y ago
> if today you told me you had a website that was 100% technologically identical to Amazon, but you were willing to make slightly less money, you'd still have no products It is widely understood that you really can't compete wi
227.
by sdesol 2y ago
> Then again I'd suggest that the majority of people participating on those sites are already employed, so they're not doing it for that benefit. But the company benefits from less confusion and a better user experience. Compan
228.
by sdesol 2y ago
I have that in the chat app that I am working on. https://beta.gitsense.com/?chat=51219672-9a37-442d-80a3-14d8... It provides a summary of all the responses and if you click on "Conversation" in the user message b
229.
by sdesol 2y ago
I will not be surprised if Open AI, Claude, Meta and others use the feedback system to drive corrections. Basically, if we use the API, we may never get the best answer, but it could also be true that all feedback will be applied to future
230.
by sdesol 2y ago
We are definitely heading into untreaded territory. It is one thing to use Chinese EVs, but using a knowledge system that will be censored (not that other countries won't be censored) and trained in a way that may not align with a nati
231.
by sdesol 2y ago
Most people may not care but that doesn't matter if the government cares. I will not be surprised if countries restrict LLMs to trusted countries in the future. Unless there is a regime change in China, seeing it adopted in other coun
232.
by sdesol 2y ago
Canada would be reluctant. So would Europe, South Asia and so forth. The biggest hurdle for China is the CCP. It is one thing to use physical products from China but relying on the CCP for knowledge may be a step too far for many nations.
233.
by sdesol 2y ago
Not prohibit training, but make it illegal for US companies to embed, use or distribute LLMs created by China. Basically the general consumer will need to go through the effort of use the LLM that they want, which we know means only a small
234.
by sdesol 2y ago
Here's more LLMs https://beta.gitsense.com/?chats=ba5f73ac-ad76-45c0-8237-57a... The left window contains all the models that were asked and the right window contains a summary of the LLM responses. GPT-4o mini got it
235.
by sdesol 2y ago
> That's a very small price to pay for what we all stand to gain. Sure, if AI was made free for everybody (or only be charged for cost to run). With Stack Overflow, GitHub and others, there is a mutual understanding that contributin
236.
by sdesol 2y ago
> China would still pose a problem Not if regulation prohibits LLMs from China, which isn't that far fetched to be honest. I think LLM will turn into a commodity product and if you want to dominate with a commodity product, you need
237.
by sdesol 2y ago
With StackOverflow, GitHub, etc. you would likely have people reach out to you for opportunities. With AI, if you contribute to StackOverflow and if it gets picked up by AI, people may or may not know.
238.
by sdesol 2y ago
> I didn't start contributing to make money Your intentions might not have been to make money, but you were creating social credit that could be redeemed for a higher and better paying job. With GitHub, Stack Overflow, etc., you ar
239.
by sdesol 2y ago
I agree LLMs are good at text processing and I believe they will obsolete jobs that really should be obsoleted. Unless OpenAI, Anthropic and other AI companies come up with a breakthrough on reliability, I think it will be fair to say they
240.
by sdesol 2y ago
I think your point stands, but your example shows that anyone using those calculators daily should not be concerned. Those that need precision to the 6+ decimal places for complex equations should know not to fully trust consumer-grade calc

More ›