edit: Some of this language was a tad harsh and cynical. Apologies, was in a bit of a mood. I'll leave it as-is for posterity. > We have experimented with this

edit: Some of this language was a tad harsh and cynical. Apologies, was in a bit of a mood. I'll leave it as-is for posterity. > We have experimented with this and are releasing an API that you can explore to see if this chunking strategy works for you. Call me when you release literally any details at all. Even better - call when you've open sourced your code. It's kind of hard to just take your word for it when it comes to a alleged superior method. Demo's are interesting but again, I don't really trust that even those results do what you claim (semantic chunking). The best way to do that is with a rigorous evaluation and probably good old fashioned "read and compare" by a human being. Somehow, I doubt that this UMAP technique always maps directly to semantically important aspects of a narrative, at least not in a way that is substantially more accurate and useful than previous methods. I'd be happy to be proven wrong, but again this blog post is _extremely_ light on details. Hell, even saying "we don't want to release our algorithm because of the competitive landscape" as OpenAI does would be more useful than this.