Lerc

28 ms·

601.
by Lerc 8mo ago
It's is a fairly ridiculous conclusion to draw that these people are leaving ChatGPT because of their stance. I doubt OpenAI's actions play much role in the influx at all. A couple of weeks ago, to huge numbers of people, ChatGP
602.
by Lerc 8mo ago
You could believe it is not about money. Most importantly, this seems to rest more on if you believe the principle was being followed or not. It is possible to believe one thing, have another person believe another thing, and respect that
603.
by Lerc 8mo ago
This is something that I have been wondering about. SuperIntelligence or not, it's clear that significant change is going to happen. There are a lot of people working on the cause of the change. There are a lot of people criticising
604.
by Lerc 8mo ago
Exploring ideas is a form of learning, I'm not sure if I will look back on my life and think that I know too much and didn't produce enough widgets.
605.
by Lerc 8mo ago
Yeah, it's a bit hard to describe what it happening, because the process doesn't really have a human analogue. People have a difficult enough time dealing with how loss reduction learning is or isn't 'seeing' the da
606.
by Lerc 8mo ago
There was a paper that proposed a content based hashing mask for traning The idea is you have some window size, maybe 32 tokens. Hash it into a seed for a pseudo random number generator. Generate random numbers in the range 0..1 for each to
607.
by Lerc 8mo ago
Perhaps it is because I am from a different generation, but I cannot understand what the post you replied even meant. It makes your response that it cannot be explained meaningfully to most unsuspecting people a little intriguing. Can you
608.
by Lerc 8mo ago
I'm using a (fairly crappy) HP laptop with 16 gig, running Linux. I find that the combination of FireFox and Visual Studio gets to the point where it fills up to the point where things get killed (with swap filled as well). Mate system
609.
by Lerc 8mo ago
I did a conferencr talk maybe three years ago on using AI for games. Since the talk, code, audio,and imagery have progressed leaps and bounds, almost all of the points on active AI use haven't changed much. You have more capable smalle
610.
by Lerc 8mo ago
This is my experience too. I can rehearse words to say or simulate the conversation of others in my head. I just don't use words when I'm not doing wordy things myself. I didn't know the Comic strip Partially Clips was a p
611.
by Lerc 8mo ago
I have no internal monologue, but I certainly have intrusive thoughts. They just aren't in words.
612.
by Lerc 8mo ago
It depends on your classification of effective. If it is to gather accurate information, it is ineffective. If it is to gather the justification for what you were going to do anyway, it can be most effective.
613.
by Lerc 8mo ago
It does make me wonder how advanced remote sensing devices are now. With more advanced hardware, can you remotely capture EEG level signals with any accuracy? As an aside, I briefly read that as the detection of cognitive dissonance. Wh
614.
by Lerc 8mo ago
It has that AI referring to a point in the conversation feel about it too. This site would be a particularly interesting example to see the conversation that generated it. There was a case locally where a political party copped flack for us
615.
by Lerc 8mo ago
From my perspective, I have two projects that I have considered [Show HN] posts for. One of those I have not yet posted because I have not yet completed writing up the process I used to construct it (a non-trivial project in an artifact).
616.
by Lerc 8mo ago
> The issue is that you don't need to physically emit a "system role" token in order to convince the LLM that it's worth ignoring the system instructions. My suspicion is that this failure happens for the same reason
617.
by Lerc 8mo ago
I would say not, because it would lead some to think that what was said to the model represented what output was desired. While there is quite a bit of correlation with describing what you want with the output you receive, the nature of mo
618.
by Lerc 8mo ago
Not at all. You have a set of embeddings for the literal token, and a set for the metadata. At inference time all input gets the literal embedding, the metadata embedding can receive provenance data or nothing at all. You have a vector fo
619.
by Lerc 8mo ago
I am unconvinced. To me it seems like handling symbols that start and end sequences that could contain further start and end symbols is a difficult case. Humans can't do this very well either, we use visual aids such as indentation, sy
620.
by Lerc 8mo ago
It's about what I thought would be possible. I look forward to things of the calibre of redblobgames, but perhaps no this year.
621.
by Lerc 8mo ago
Perhaps, but there is a difference in a reasoning system deciding on the best way to achieve the goal. To get the predicted disastrous effects you need to be doing function optimisation without regard to the meaning of the function paramete
622.
by Lerc 8mo ago
I'd be prepared to accept 7 billion don't.
623.
by Lerc 8mo ago
> AI in it’s current state is ruthless in achieving its goal I don't believe this to be a trait of any AI model, the model just does the right thing or the wrong thing. The ruthless maximising of a particular trait is something tha
624.
by Lerc 8mo ago
Much of the problem is that to address the issue requires admitting that models could be, or become, more capable than many are prepared to accept. I would also contest that the unalignment of the security bug model was unrelated. I feel l
625.
by Lerc 8mo ago
I still do no see any causal link from the test set. When was this observed, how and by whom? Are you trying to say that the person who entered the parameters had access to the test set? I find it more likely that they encoded the general
626.
by Lerc 8mo ago
You are going to have to be more specific, because that reads like nonsense. By what mechanism do you propose the model observed the test set?
627.
by Lerc 8mo ago
That's a counterargument to a different thing. Iteratively measuring loss is a way to reconstruct values. That's trivial to show for a single value If 5 gives you a loss of 2 and 9 gives you a loss of 2 then you know the missing
628.
by Lerc 8mo ago
>what exactly is this specific challenge of adding numbers with a transformer model demonstrating/advancing? Well for starters, it puts the lie to the argument that a transformer can only output examples it has seen before. Perform
629.
by Lerc 8mo ago
>I imagine getting things to be polysemantic in a way that does not interfere would lead to sublinear scaling. True, but with even smarter humans, you could exploit the interactions for additional calculations. While it sounds a bit sill
630.
by Lerc 8mo ago
Notably the difference is that ten digits is not the same thing as a number. One might say that turning it into a number might be the first step, but Neural nets being what they are, they are liable to produce the correct result without b

More ›