26 ms·
Amazing project! I really appreciate this simple and good idea to manage API keys/tokens in the era of LLM. Personally, I'm often anxious about the safety of m
by xy-li 3y ago
Amazing project!
I really appreciate this simple and good idea to manage API keys/tokens in the era of LLM. Personally, I'm often anxious about the safety of my own keys/tokens across several platforms. Recent news about some open-source projects that abuse the secret keys also recall me of the leakage concern. More details can be referenced in this post https://gist.github.com/win3zz/0a1c70589fcbea64dba4588b93095855 https://gist.github.com/win3zz/0a1c70589fcbea64dba4588b93095... and a relevant paper: https://arxiv.org/abs/2309.02926 https://arxiv.org/abs/2309.02926 Many risks are avoidable if the developer team deploys their service properly. I believe a good tool like this project is also an in-demand solution to reduce the concern and burden during their R&D stage.
- forrestbao 3y agoThank you very much! Appreciate your comment and encouragement. I conceived this idea while working on a project with multiple people to evaluate multiple LLMs. Too many API keys floating here and there in the code. So I said, what if we could use only one master key for all the APIs and hide the real key from users. Then, LlaMakey was born.