5 ms·
Inform us when you figured out a way to host something with the quality of ChatGPT internally :-)
by meghan_rain 4y ago
Inform us when you figured out a way to host something with the quality of ChatGPT internally :-)
- bob1029 4y agoEven if we had a 100% private ChatGPT instance, it wouldn't fully cover our internal use case. There is way more context to our business than can fit in 4/8/32k tokens. Even if we could fit the 32k token budget, it would be very expensive to run like this 24/7. Fine-tuning a base model is the only practical/affordable path for us.
- cmelbye 4y agoYou can retrieve information on demand based on what the user is asking, like this: https://github.com/openai/chatgpt-retrieval-plugin https://github.com/openai/chatgpt-retrieval-plugin
- visarga 4y agoYou can use chatGPT inside Azure, like any other service. It's not the same one used by OpenAI, and there are different guarantees. > ChatGPT is now available in Azure OpenAI Service https://azure.microsoft.com/en-us/blog/chatgpt-is-now-available-in-azure-openai-service/ https://azure.microsoft.com/en-us/blog/chatgpt-is-now-availa...
- meghan_rain 4y agoSorry but the whole point is to not use a closed source third party API with a dubious privacy police ran buy a multinational surveillance capitalism megacorporation.
- sebzim4500 4y agoTheir probably already using AWS/GCP/Azure, so trusting Azure is not going to be considered nearly as big a deal as trusting OpenAI.
- judge2020 4y agoWhen you use it via the first-party Azure service, the data you input is de-facto guaranteed to not be fed back into the model, so you don't expand your circle of trust by feeding MSFT with your code.
- knodi123 4y agoI can host llama's 7b model internally. It hallucinates more often than not and has a tendency to ramble, but dammit it's local and secure!
- walthamstow 4y agoWhat's it like with code, documentation, regex, etc? That's all I use ChatGPT for. I don't need it to be able to write poetry.
- beiller 4y agoI did not verify this regex, on the very surface scan seems OK: ./main -m ./models/7B/ggml-model-q4_0.bin -t 4 --temp 0.7 --top_k 40 --top_p 0.5 --repeat_last_n 256 --repeat_penalty 1.17647 -n 1024 -p $'Here is a handy short form regex to validate an email address: ' Here is a handy short form regex to validate an email address: ^([a-zA-Z0-9_.+-]+@[a-zA-Z0-9.-]+\.[a-z\.]{2,6})+$ The first character can be either uppercase or lower case. The second group must contain at least one letter and the third group may contain any number of characters (up to 5). The last part ensures that it ends with @ followed by two more letters separated by dots. If you want to make sure that your input string contains only valid characters for emails then use this regex instead: \A[\w.]@[\w.]\.\w{1,4}\z
- bob1029 4y agoThis looks like good performance. We are keeping an open mind with regard to actually-open alternatives.
- mewpmewp2 4y agoThere are much longer top level domains than 6 characters though. And the second one is confusing me. It seems to be matching a single character only for the initial portion? Neither of them seem good, and especially the last one. And the way it describes both seems off as well. I would have to say it brings more harm than good based on that.
- chrismorgan 4y ago
- philsquared_ 4y agoJust use the API? It deletes your data after 30 days...