bwfan123

22 ms·

391.
by bwfan123 1y ago
Why isnt there more investments into semi-synchronous training - is it that the convergence is iffy ? Also, it would be great to refactor this code into a typed language, so it is easier to reason about and maintain.
392.
by bwfan123 1y ago
I dont think you understand the problem. And neither did I when a loved one suffered through something like this. What you miss is that solutions like the one you suggest simply cannot be implemented by those that are suffering. Folks who h
393.
by bwfan123 1y ago
If a third of microsoft's code looks like this copilot generated PR [1] the company is going to go down the tubes soon. And I hope this happens, so, these corporate chiefs learn a harsh lesson when they are ejected for forcing stupidit
394.
by bwfan123 1y ago
code-reviews are not a good use-case for LLMs. here's why: LLMs shine in usecases when their output is not evaluated on accuracy - for example, recommendations, semantic-search, sample snippets, images of people riding horses etc. code
395.
by bwfan123 1y ago
We also need an inverse turing test. ie, detect humans pretending to be AI. Like the case recently of builder.ai which had humans pretending to be ai. Turing was a visionary - but even he could not imagine a time when humans pretend to be b
396.
by bwfan123 1y ago
Einstein did not get an academic job after his PhD. If it can happen to Einstein, it can happen to the average PhD of today. But, PhDs are over-qualified for the average job (as was Einstein when he worked as a patent clerk), and employers
397.
by bwfan123 1y ago
> Using a formal language is a feature, not a bug. It is a cornerstone of all human engineering and scientific activity and is the _reason_ why these disciplines are successful A similar argument was also made by Dijkstra in this brief e
398.
by bwfan123 1y ago
> The reality is that there's not a single critical component anywhere that is built on LLMs. Remember that there are billion dollar usecases where being correct is not important. For example, shopping recommendations, advertizing,
399.
by bwfan123 1y ago
> Am I all of a sudden the one lacking imagination? No, The reality of what these tools can do is sinking in.. The rubber is meeting the road and I can hear some screaching. The boosters are in 5 stages of grief coming to terms with what
400.
by bwfan123 1y ago
thanks !
401.
by bwfan123 1y ago
Thanks for the mention. I loved the book [1], and it started me off on a journey to spark intuition, and sensory (visual) connection. On another note, I was shocked to find that some members of my family have aphantasia which is a complete
402.
by bwfan123 1y ago
> It affects people too. Something I learned halfway through a theoretical physics PhD in the 1990s was that a 50-page paper with a complex calculation almost certainly had a serious mistake in it that you'd find if you went over it
403.
by bwfan123 1y ago
you left out the other llm-apology: But humans can fail too !
404.
by bwfan123 1y ago
> I might starting calling this "the original sin" with LLMs... not validating the output. I would rephrase it - the original sin of llms is not "understanding" what they output. By "understanding" it is mea
405.
by bwfan123 1y ago
Finally some real pushback to the whole agentic mania - from an actor who is incentivized to push the narrative. Following the recent apple paper - some realism is being injected into the hype. 58% success rate on a task is close to a coin
406.
by bwfan123 1y ago
There used to be a time when hw vendors begudgingly put out sample driver code which contained 1 file with 5000 lines of C code - which just about barely worked. The quality of software was not really a priority, as most of the revenue was
407.
by bwfan123 1y ago
Indeed. the user-facing software stack componentry - pytorch and jax/xla - are owned by meta, and google and open sourced. Further, the open-source models (llama/deepseek) are largely hw agnostic. There is really no user or eco-sy
408.
by bwfan123 1y ago
There is a large number of wannabe hands-on coders who have moved on to become management - and they all either have coder-envy or coder-hatred. To them, gen-ai is a savior - Earlier, they felt out of the game - now, they feel like they can
409.
by bwfan123 1y ago
> If not, what fundamental building blocks are missing to get there If I were to guess, the missing building block is the ability to abstract - which is the ability to create a symbol to represent something. Concrete example of abstracti
410.
by bwfan123 1y ago
> but humans cant do it either This argument is tired as it keeps getting repeated for any flaws seen in LLMs. And the other tired argument is: wait ! this is a sigmoid curve, and we have not seen the inflection point yet. If someone hav
411.
by bwfan123 1y ago
there is enough hype already - with AGI being promised as imminent. this work balances the hype and shows fundamental limitations so the AI hypesters are checked. why be salty ?
412.
by bwfan123 1y ago
The hype cycle is running on FOMO. "as a developer, you will be left behind" And is sustained by fear tactics. "there wont be any developer jobs left" Giant investments are being made, and a lot of people's outcomes
413.
by bwfan123 1y ago
Have you read the hilarious PRs that copilot put out last week ? it is here for your reference [1]. The humor is in the giant gap between what it can do, and what the hype says it can do. Can you show me 1 PR put out by any agent in any op
414.
by bwfan123 1y ago
agree - it is written like clickbait or worse like a sponsored piece. > But “hallucination” is the first thing developers bring up when someone suggests using LLMs, despite it being (more or less) a solved problem. really ? what is the a
415.
by bwfan123 1y ago
Can we have a rule which says - "those who have not coded for a living shall not make sweeping statements about the future of coding" ? All sorts of academic and management folks are coming out of the woodwork making predictions a
416.
by bwfan123 1y ago
> valued, on the other hand, means that you are brought into more conversations, not just to execute, but to help shape the direction This article is heavy on emotional persuation, but rationally, it is not even operationally defining th
417.
by bwfan123 1y ago
I would describe it differently - "another day, another dollar" - where work is done as required - no more no less. Corps know this, and try to incentivize employees to bring some passion to work - via equity ownership - so, incen
418.
by bwfan123 1y ago
> but I do think perhaps AI has given the lazy and prideless an even lower energy route to... I'm not sure. What is the goal? Our natural state tends to laziness - both mentally and physically. There are exceptions of-course. What
419.
by bwfan123 1y ago
> The eternal hope is that someday, somehow, we will be able to invent a natural language way of communicating something precise like a program, and it's just not going to happen what we operationally mean by "precise" inv
420.
by bwfan123 1y ago
Have you wondered why japan, which is a powerhouse of electronics and manufacturing does not have any large software companies ? Software is different from manufacturing. The mindset, mentality, and culture required to do new software for a

More ›