harsh_neeraj

4 ms·

1. 1.▲
   by harsh_neeraj 1y ago

   Just checked out the repo — looks good. Only thing I'd suggest is maybe plug in LiteLLM for a more generalized inference setup. Could make things more flexible
2. 2.▲
   by harsh_neeraj 2y ago

   Yes, I was talking specifically about the log analysis part. Yes it is a good idea and will be a useful service. Especially where we need to configure servers on cloud, it can be implemented that it can decide the packages required as well
3. 3.▲
   by harsh_neeraj 2y ago

   Hello, Given that the majority of businesses have private subnets, I believe the primary question for which everyone is searching for a solution is how to access any LLM in a private subnet. Your suggestion can be put into action if this pr