byzantinegene

6 ms·

91.
by byzantinegene 5mo ago
it's also worth keeping in mind that alot of the 'improvements' are actually advancements in harnesses and tools.
92.
by byzantinegene 5mo ago
alot of investor money is hinging on models performing better every release.
93.
by byzantinegene 5mo ago
yes, which is why the revenue growth story is not looking so great for Anthropic/OpenAI, when open-source alternatives are not far behind with much lower costs.
94.
by byzantinegene 5mo ago
the other day there was a hackernews comment about ai-generated music, and this poster claimed that a friend generated ai music and got as much enjoyment as actual ones composed by musicians. I suppose this falls under the same camp..
95.
by byzantinegene 5mo ago
8B models would be consider obsolete in the world of 2T models, at least if we're talking about the competitiveness of OpenAI/Anthropic. The only reason why they are valued so highly is their supposed dominance at the top end.
96.
by byzantinegene 5mo ago
except this isn't a solution. taking away sources just creates another problem down the road. there's no information to crawl from if no one is building websites to crawl from.
97.
by byzantinegene 5mo ago
very good point, but I think the message has been complicated long before AI slop, from the rise of tablets and social media platforms.
98.
by byzantinegene 5mo ago
china?
99.
by byzantinegene 5mo ago
not if china gets into the picture
100.
by byzantinegene 5mo ago
exactly, the people who copy-paste AI responses are typically the ones who don't do due diligence in verifying the responses.
101.
by byzantinegene 5mo ago
I would be curious to see if the current AI valuations continue to balloon if everyone eventually shifts to local models. Hardware demand would still be high, but circular financing might no longer continue,
102.
by byzantinegene 5mo ago
why not? if he's hired to do the task he's supposedly an expert in, and that is now done by AI, what's stopping the company from replacing him with any other person at a lower cost that operates the same AI?
103.
by byzantinegene 5mo ago
this seems to happen far more than i would like
104.
by byzantinegene 5mo ago
this pretty much sums up what i feel about AI currently. It made my life significantly easier for most tasks I already breeze through, yet tasks I used to struggle with are still the equally difficult
105.
by byzantinegene 5mo ago
vast majority of average users don't use llms for coding, and for those purposes, local llms with low param count are a far cry from SOTA models.
106.
by byzantinegene 5mo ago
i'm not sure the tradeoff in code readability is worth it as of now.
107.
by byzantinegene 5mo ago
i would argue we don't need anything near Opus to be productive. Sonnet is plenty productive enough
108.
by byzantinegene 6mo ago
what are those limitations we're talking about? seems most of those the original limitations that people complained about were resolved through workarounds like tools and skills which are more software-engineering than llm advancement.
109.
by byzantinegene 6mo ago
it is a fruitless endeavour to try to appeal to a crowd that does not and will never understand the fundamentals of how llms work.
110.
by byzantinegene 6mo ago
you have 35 years of experience and have already built up the learning capability and general framework to acquire new knowledge. you know how to use agentic coding as a tool to supplement your work. the juniors who start today don't h
111.
by byzantinegene 6mo ago
we're already doing that, it's called distillation and how models like deepseek are trained.
112.
by byzantinegene 6mo ago
factor in depreciation and energy costs, and a subscription might just be cheaper.
113.
by byzantinegene 6mo ago
your spec is a guideline, not something the LLM has to adhere to. it is definitely not guaranteed to work without error
114.
by byzantinegene 6mo ago
you don't need to build systems from scratch to acquire problem-solving skills. even routine maintenance problems require to dig into documentation, look at github issues, and do root-cause analysis. These skills are eliminated from re
115.
by byzantinegene 6mo ago
seems like what you're suggesting to token efficiency is to simply use less of it?
116.
by byzantinegene 6mo ago
in theory yes, but all the money is going into AI or AI-adjacent startups that no one would actually build a product that solves problems if it doesn't incorporate AI in it.
117.
by byzantinegene 6mo ago
the near term is not an issue, because most ai code is still reviewed by experienced engineers with experience. the problem comes in the future where junior engineers who never acquired enough experience to handle engineering problems
118.
by byzantinegene 6mo ago
IMO this is the only way model providers can survive in the long run, bank on their users overreliance on them resulting in diminishing capabilities. This gives them leverage to increase prices without any pushback
119.
by byzantinegene 6mo ago
you're right but for now it doesn't matter if both competitors are running on infinite vc money, we as consumers benefit from it. it only matters if they cause negative externalities in the meantime
120.
by byzantinegene 6mo ago
how have you coded before the era of llms?

More ›