4 ms·

is there away to run this on AWS instead. we were looking to explore Llama2 for internal use

• froggychairs 3y ago
  OpenAI models are exclusively Azure only. Llama2 should have an AWS option I believe?
• axpy906 3y ago
  Use SageMaker: https://www.philschmid.de/sagemaker-llama-llm https://www.philschmid.de/sagemaker-llama-llm
• villgax 3y ago
  Have your engineers set this up internally https://huggingface.co/spaces/huggingface-projects/llama-2-7b-chat https://huggingface.co/spaces/huggingface-projects/llama-2-7...
  • speedgoose 3y ago
    You can’t really replace ChatGPT 4 with llama2 7B.
    • villgax 3y ago
      Yeah right try getting the same answer after two months
• klysm 3y ago
  Msft spent a lot of money to ensure that was not an option w chatgpt
  • RockyMcNuts 3y ago
    https://about.fb.com/news/2023/07/llama-2/ https://about.fb.com/news/2023/07/llama-2/ https://huggingface.co/blog/hugging-face-endpoints-on-azure https://huggingface.co/blog/hugging-face-endpoints-on-azure You can of course run Llama2 in Azure, but you can't host OpenAI models in AWS
• braydenm 3y ago
  Amazon Bedrock makes Claude 2 available, as well as some other models.
• gdiamos 3y ago
  We can run llama 2 on an AWS vm if you have enough GPUs: https://lamini.ai/ https://lamini.ai/ Install in 10 minutes. Make sure you have enough GPU memory to fit your llama model if you want good perf