3 ms·
For it to follow the instructions I had for it. Call me naive and stupid for thinking the 1M context window on the brand new model would actually, y'know, work.
by fragmede 8mo ago
For it to follow the instructions I had for it. Call me naive and stupid for thinking the 1M context window on the brand new model would actually, y'know, work.
- Natfan 8mo agowhy would further chance at context pollution be a good thing? i feel like it is easier for data to get lost in a larger context
- quesera 8mo agoThat's a bit anthropomorphic though. When LLMs become able to reflectively examine their own premises and weight paths, they will exceed the self-awareness of ordinary humans.
- grey-area 8mo agoIt doesn’t reason or explicitly follow instructions, it generates plausible text given a context.
- hgoel 8mo agoJust dealt with this last night with Claude repeatedly risking a full system crash by failing to ensure that the previous training run of a model ended before starting the next one. It's a pretty strange issue, makes me feel like the 1M context model was actually a downgrade, but it's probably something weird about the state of its memory document. I wasn't even very deep into the context.