singingfish

4 ms·

1.
by singingfish 9d ago
I'm only concerned with the input efficiency, but the output energy efficiency is quite bad too. I can not see a pathway to generating economies of scale for this stuff.
2.
by singingfish 12d ago
Maybe I shouldn't have been pissed of by your commient. In which case - the excess costs of the training, output, feedback, and training cycle of artificial neural networks seem to prohibit the nightly training consolidation cycle (i.
3.
by singingfish 12d ago
I can't make sense of your comment. Firstly because of the obvious massive over-build of GPU infrastructure the AI companies are engaging in. Secondly because the instance of the LLM in the data centre that users interact with is on
4.
by singingfish 13d ago
I can't see a pathway for these things to be able to learn from experience in any meaningful way - the energy budget seems to prohibit it. Artificial neural networks are already many orders of magnitude more energy intensive than natu
5.
by singingfish 1mo ago
Meta's bots are spectatularly awful, and if your organisation needs to use facebook advertising, they're also unblockable. There are ways around it that doesn't exactly block them but does clearly communicate they should GTF
6.
New Modern Glossary of Computer Science(unfuck.i.ng)
3 points by singingfish 1mo ago|0 comments
7.
Brief Observations on Life(unfuck.i.ng)
4 points by singingfish 2mo ago|1 comments
8.
by singingfish 2mo ago
It was brought to my attention that the phrase "terminal, degenerative, sexually transmitted condition" returned no results from my search engine. So I tried to fix it.
9.
by singingfish 3mo ago
as a rule the interviewee should be assessing for goodness of fit, as well as the interviewer. If my simplified nuanced answer to why I limit my usage of LLMs was poorly received, I wouldn't want to take a job somewhere likely to make
10.
by singingfish 11mo ago
aka LLMs can not learn from experience - this is a fundamental limitation. c.f - individuals with Korsakov's syndrome - who also confabulate in a similar manner.
11.
by singingfish 11mo ago
Both Yamaha and Roland keep a long back catalogue of reasonably priced parts for at least their mid-range pianos and up as well. I should check Korg too I guess.
12.
by singingfish 11mo ago
I've had some impressive customer service from Yamaha concerning decades old saxophones that they have zero prospect of generating revenue from in the future, for an unrelated (musical) data point.
13.
by singingfish 1y ago
Of course they do - it's the same as bookmakers or other gambling syndicates, it only makes sense to operate at a certain scale otherwise the rounding errors and stochasticity will kill you.
14.
by singingfish 1y ago
If you want to just stop yourself from shooting yourself in the foot in your current checkout and maintain privacy around your own stupidity, you can add patterns to `.git/info/exclude`
15.
by singingfish 1y ago
and long may he idle
16.
by singingfish 1y ago
dumb, sick, stupid, other adjectives - generally not negative although could be in the right context - both in the Australian and North West England (where Matt was from) context. Just watch out for being called a fucking cunt. In almost
17.
by singingfish 1y ago
and child prodigies are notorious "arseholes" QED.
18.
by singingfish 1y ago
I totally get it, some people found his mess very difficult and it could easily lead into a death spiral. Others had a very different experience. He was certainly someone needed to be managed by those who knew him well from time to time,
19.
by singingfish 1y ago
Matt taught me everything I know about how to make commercial programming creative, engaging, artistic/craftsman type activity, aligned with my desire to keep everything open source to the maximum extent practical. Another former colle
20.
by singingfish 1y ago
Matt was a child prodigy, and child prodigies have it notoriously tough. He and I worked closely for a while. There is someone else important in my life that has somewhat close to mst's intellectual gifts, and similarly to mst they a
21.
by singingfish 1y ago
Yeah, there's useful, but not that useful. It help to think of them as "language extrusion confabulation machines" to understand the actual limitations.
22.
by singingfish 2y ago
In other news, water is wet and the sun rises every morning.
23.
by singingfish 2y ago
What about extra feed - grain or silage or whatever? Or do they keep stocking density low?
24.
by singingfish 2y ago
Tyre is clearly the correct spelling. I quickly tire of anyone claiming otherwise. Gaol is an archaic spelling which I've found incredibly confusing ever since I was a small kid a long long time ago.
25.
by singingfish 2y ago
All that fertiliser that gets put into Cattle grazing lands increases the methane and other emissions, so your read on this is to a significant extent incorrect.
26.
by singingfish 2y ago
Was just talking to a Cambodian wildlife biologist about this very thing last night. In a South East Asian context rather than North American that is.
27.
by singingfish 2y ago
me? No. Ex trainee neruopsychologist and failed academic who was in the right place at the right time back in the mid 90s who didn't pick up computers for professional interest until the mid-late 2000s after getting excited by Neil St
28.
by singingfish 2y ago
Yeah the internal representation of organic neural networks are also weird - check out the signal processing that occurs between the retina and the various parts of the visual cortex before any decent information can emerge from the signal
29.
by singingfish 2y ago
The reasoning is quite subtle, and because I'm not a very coherent guy I have problems expressing it. In the LLM space there are a whole bunch of pitfalls around overfit (largely solvable with pretty standard statistical methods) and
30.
by singingfish 2y ago
Yeah, give 'em small constrained jobs where the lack of coherent internal representation is not a problem. I was involved in ANN and equivalent based face recognition (not on the computational side, on the psychophysics side) briefly.

More ›