0x008

8 ms·

61.
by 0x008 2y ago
What can OpenAI realistically do about it except block the user account? I think the TOS should have no effect on the license and copyright of the resulting model, since outputs of AI Models cannot be copyrighted (at least in the US).
62.
by 0x008 2y ago
They are based on llama2 architecture which performs a lot worse.
63.
by 0x008 3y ago
Why should the release GPT-5 if GPT-4 is still at the top of all benchmarks? 95% of the population who are not techies will probably use ChatGPT anyway for everything. I think they are pretty much the leading LLM company in most ways. It is
64.
by 0x008 3y ago
Then you might want to look into query routing or function calling.
65.
by 0x008 3y ago
tl;dr we only need a vector database if we want to do semantic vector-embedding search AND our dataset is too large for memory long answer: RAG is just a pattern of working with LLMs, independent of particular database technologies. Basical
66.
by 0x008 3y ago
I think no matter how large the context windows will get and no matter how fast the inference speeds will get, there will always be break-point where the context we have will be so large, that either cost or inference time are not a good ex
67.
by 0x008 3y ago
Speaking as software-developers we have to see RAG as kind of a caching-mechanism. Instead of computing every token every time on the whole context, we can grab a cache to make some shortcut. We do the same in software development all the t
68.
by 0x008 3y ago
For that a model needs to recursively parse its output. That is not possible with the current architectures, we need Agent Frameworks for that.
69.
by 0x008 3y ago
That is actually already what is happening, tools like llama_index are trying to provide all the necessary integrations.
70.
by 0x008 3y ago
What people are not always considering is that RAG has many more applications than just selecting the relevant context chunks. After all, the R in RAG is not for Vector Search, it is for "Retrieval". With RAG tools that exist toda
71.
by 0x008 3y ago
I don't understand why knowledge graph would be an alternative to RAG? Knowledge graphs can (and are already) used as part of a RAG pipeline.
72.
by 0x008 3y ago
There is also the problem that most of the LLMs of today will somehow lose (or ignore) the middle if the context and prefer beginning and/or end.
73.
by 0x008 3y ago
The use case of “counting objects” is basically completely solved already by yolov8. There is no need to use an LLM for that.
74.
by 0x008 3y ago
/r/localllama is probably the place where you want to ask your questions. They are very up to date and lots of good recommendations there.
75.
by 0x008 3y ago
Of all the off the shelf text splitters I have tried, the recursive character splitter actually performs really well. Especially if the chunk size is so large you will likely have more than the actual needed context in a chunk anyway. Regar
76.
by 0x008 3y ago
It’s probably Retrieval Augmented Generation? Just wanted to put this here in case somebody is not familiar with this pattern.
77.
by 0x008 3y ago
Where would I keep them instead? I always wonder. Let’s say I am developing an app against OpenAI API. Where do I put the OpenAI API Key in VS Code? As far as I know .env file is the main supported way of setting environmental variables in
78.
by 0x008 3y ago
This is a very similar idea to ensemble models, which have been used for a long time in ML and proven to be very good. You average out the results of several predictors (or you let them vote and pick the most common prediction value), there
79.
by 0x008 3y ago
> Not really sure what you might consider difficult about pyenv - compiling from source - need to install build-essentials on docker images which takes up lot of space and takes a long time
80.
by 0x008 3y ago
it's not a bug, it's a feature. just install the different python versions by downloading the binaries or through your package manager and run python3.<whatever_version_you_want> -m venv and the virtual environment will auto
81.
by 0x008 3y ago
Now you have poetry installed for every version of python and need to keep track of updating all of those poetry installs. Python really makes things difficult :D
82.
by 0x008 3y ago
The tool is cool, but very US-centric. There is no possibility to select the Azure Datacenter.. I think pricing is different from NA to EU, if I am not mistaken.
83.
by 0x008 3y ago
apparently GPT-4.5 is only due end of the year, so it will take some more time until GPT5 is released
84.
by 0x008 3y ago
I would be very cautious when you learn a new skill like talking to random people and building new connections - which can be extremely rewarding - and connecting that in your brain to alcohol.
85.
by 0x008 3y ago
That is actually possible. You could summarize each book first and then group them and summarize the groups etc. Divide and conquer approach. This could be easily implemented with langchain for example.
86.
by 0x008 3y ago
I look up articles about topics I am intersted in HN and read the comments. Sometimes I use HN search to look for good threads about a topic.
87.
by 0x008 3y ago
Mixed results. I think llama2 in general is pretty bad, especially at anything else than english. I've had very good results with Mixtral for Chat. Of course all of them feel like a Frankenstein compared to actual ChatGPT. They feel si
88.
by 0x008 3y ago
I tried to use codellama 34B and I think it is pretty bad. For Example I asked it to convert a comment into a docstring and it would hallucinate a whole function around it.
89.
by 0x008 3y ago
That is actually the same idea as the (now) popular "Mixture of Experts" approach.
90.
by 0x008 3y ago
As others already pointed out the simple answer is that "purpose" is a concept that only exists within a rational mind. And rational minds are only known to exist in humans so far. Where does it leave us? Unless you believe in dei

More ›