jononor

16 ms·

241.
by jononor 1y ago
Would have loved to get some more insights. Cost estimates, before and after, for example. But also if any architectural changes where needed, or what kind of other challenges and learnings they got from the migration.
242.
by jononor 1y ago
ChatGPT and Claude do the same. And I have noticed that model performance can often degrade a lot before such a hard limit. So even when not hitting the hard limit, splitting out to a new session can be useful. Context management is the new
243.
by jononor 1y ago
Agreed. I chose gevent over asyncio for a backend in 2019, and we still using it. Works pretty well. No plans to phase out gevent just yet. Though the community has clearly centered on asyncio by now. So if I were to start a new backend tod
244.
by jononor 1y ago
And spaces could be variable in the number of "sub-spaces" used. Each could be say 1/8 of a regular space.
245.
by jononor 1y ago
Some percentage will not comply. Either in bad faith or just lazyness/incompetence/accident/whatever. But as long as that number is relatively low and a decent chunk pays "their dues", it is not really a problem.
246.
by jononor 1y ago
Why is "AI" (current LLM based systems) a danger on the level comparable to nukes? Not saying that it is not, just would like to understand your reasoning.
247.
by jononor 1y ago
I agree with your reasoning. But the conclusion seems to be throwing the baby out with the bathwater? The same line of thought can be used for any (new) tool, say a calculator, a computer or the internet. Shouldn't we try to find respo
248.
by jononor 1y ago
I like the idea. But it is missing something to actually get money out of companies, I think? Because even when there are people in a company that are nominally willing to pay, there is usually so much friction/hassle to actually get
249.
by jononor 1y ago
One nice thing about GitHub sponsorship is that there is only one bill for the sponsor, and one can support NN projects/creators there. I think it is even bundled with the regular Github invoice?
250.
by jononor 1y ago
I would only say that they have become maintainers if they consistently do so, over time. Including helping out in areas which is not directly useful to them. And thinking about the whole picture, not just individual features and bugs. And
251.
by jononor 1y ago
Another very good way to lie is to set up the framing such that any interpretation of any fact skews in your desired direction. Including which things are to be considered important/relevant, what kind of argument is considered val
252.
by jononor 1y ago
I concur. This post of one being welcoming, accepting and encouraging is appreciated. What is the opposite of "gatekeeping"?
253.
by jononor 1y ago
That expert systems were not financially viable in the 80-90ies does not mean that LLM-as-modern-expert-systems cannot be now. The addressable market for such solutions has expanded enormously since then, thanks to PCs, servers, and mobile
254.
by jononor 1y ago
Superhuman capability within the tasks that are well represented in the dataset, yes. If one takes the view that intelligence is the ability to solve novel problems (ref F. Chollet), then the amount of data alone might not take us to supe
255.
by jononor 1y ago
If OpenAI would publish the models before the competition, then one could verify that they were not tinkered with. Assuming that there exists a way for them to prove that a model is the same, at least. Since the weights are not open, the mo
256.
by jononor 1y ago
This is solvable? They could post a hash of the solutions publicly, and reveal the contents of the solution after one week.
257.
by jononor 1y ago
It would leave a lots of general purpose GPU-based compute. That is useful and enduring infrastructure? These things are used for many scientific and engineering problems - including medicine, climate modeling, material science, neuroscienc
258.
by jononor 1y ago
A) We are out of the Internet-scale-for-free data. Of course the companies deploying LLM based systems at massive scale are of course ingesting a lot of human data from their users, that they are seeking to use to further improve their mode
259.
by jononor 1y ago
What exactly do you mean by replace? Replace in particular roles (causing the humans to shift into new roles), or replace as in nothing useful left for humans to do? Those are two very different trajectories. So far in the industrial revolu
260.
by jononor 1y ago
What would the "horse" equivalents be in this AI tech shift? Legit question - getting reasonable answers here might help us understand where we are going. For sure it is not computers. Or software systems. We will for sure have wa
261.
by jononor 1y ago
Ahahaha, that is legit a nice framing and "business model" for a Patreon in the AI space. Drinking from the firehose and washpanning it, so that not everyone has to do the same.
262.
by jononor 1y ago
Yeah, spending a few hours trying things out will be worth much more than spending hours reading about it.
263.
by jononor 1y ago
It is pretty easy and convenient to write extensions using pybind11, including passing numpy arrays. It takes 10 lines in setup.py and around 10 lines in a .cpp file, run setup.py build_ext to build it. Not quite the convenience of inline -
264.
by jononor 1y ago
The Internet was also very expensive in its infancy. Dialup charged by the minute for mere kilobytes. The cost per MB dropped by a factor 1000x over the course of 30 years. It took billions in investments, and millions of people working on
265.
by jononor 1y ago
Just as one example, MicroPython is deployed in several satellites (cubesats). There are some conference talks and podcasts about it.
266.
by jononor 1y ago
Lua is a great language, including for embedded. And I am sure that their Lua-based product is good also. But this article was not very convincing as to why it "beats MicroPython". The criticisms are vague or not correct. Extendin
267.
by jononor 1y ago
No, just saying that a claim of qualia would require some sort of evidence or methodical argument. And that LLM outputs professing feelings or other state-of-mind like things should by default be assumed to be explained by that the training
268.
by jononor 1y ago
Nothing an LLM says can in itself, right now, be used as evidence of what they 'feel'. It is not established that there is any linking of their output to anything else than the training process (data, loss function, optimizer, e
269.
by jononor 1y ago
Big party for Altman et al these days, who have been advocating (lobbying) a lot for this. The US, and the world at large needs more electricity, and nuclear probably does have it's place in the mix. Just hope we do not spend all the n
270.
by jononor 1y ago
Did 6 years as bicycle mechanic/sales in highschool, was ok, could do again. Electronics engineering - presumably in this scenario the software aspects might be reduced, but probably longer before LLMs can do board design, debugging, t

More ›