2 ms·

Just run them on AWS

• pogue 3y ago
  Can you expand more on how that's done or point me in the direction to a guide?
  • dr_kiszonka 3y ago
    Possibly the easiest way would be to run them in a notebook on Amazon SageMaker. https://aws.amazon.com/sagemaker/notebooks/ https://aws.amazon.com/sagemaker/notebooks/
    • dvfjsdhgfv 3y ago
      So you just start a notebook and then what?
      • dr_kiszonka 3y ago
        You then download a model you want, say, Llama 2. Install a Python package to interact with the model (possibly `pip install llama-cpp-python`) and have fun.
• PeterStuer 3y ago
  How would AWS run the user's models locally (as per the question)?