heisenburgzero

4 ms·

1. 1.▲
   by heisenburgzero 1y ago

   In my own experience, if the problem is not solvable by a LLM. No amount of prompt "engineering" will really help. Only way to solve it would be by partially solving it (breaking down to sub-tasks / examples) and let it run i
2. 2.▲
   by heisenburgzero 1y ago

   So did you just combine Title+Abstracts+Authors into a single chunk and embed them or embedded them individually?
3. 3.▲
   by heisenburgzero 2y ago

   I always wondered where to start learning reverse-engineering. Most people will say learn Assembly first. But from there on, there seems to be not much more concrete information online. Do people just figured it out by trial & error lik
4. 4.▲
   by heisenburgzero 3y ago

   Thanks. "In-context learning" was the phrase I was looking for. Also, I found these 2 links pretty good too. 1. http://ai.stanford.edu/blog/understanding-incontext/ 2. http://ai.stanford.edu&#
5. 5.▲
   by heisenburgzero 3y ago

   I think some earlier NLP applications have something called "Unknown token", which they will replace any unseen word. But for recent implementations, I don't think they are being used anymore. It still baffles me why such sto
6. 6.▲
   by heisenburgzero 3y ago

   Not completely related. Does anyone know where I can find articles / papers that discuss why transformers, while acting as merely "next token predictor" can handle questions with: 1. Unknown words (or subwords/tokens) th
7. 7.▲
   by heisenburgzero 3y ago

   Thanks, that make sense. I think my comment was not worded properly. I was thinking "geometry properties = linear properties", what I really should say is: Why does the latent space has geometry properties where we could use funct
8. 8.▲
   by heisenburgzero 3y ago

   Why does the embeddings have linear properties such that you can use functions like cosine similarity to compare? It seems that after the signal going through so many non-linear activation layers, the linear properties should have been brok
9. 9.▲
   by heisenburgzero 6y ago

   This is not the first time something is fishy. Back in the early stages of the repo. They were advertising on the front page that they are achieving similar MAP to the original C++ version. But only to be found out they haven't train i
10. 10.▲
    by heisenburgzero 10y ago

    where did ).exe came from? I thought you need to use VBscript of some sort to download a file from command line.