3 ms·
A package called localllm (three l's in the middle, nice) which is focused on running models in GCP. > run LLMs locally on CPU and memory, right within the Goo
by IanCal 3y ago
A package called localllm (three l's in the middle, nice) which is focused on running models in GCP.
> run LLMs locally on CPU and memory, right within the Google Cloud Workstation
And in the code https://github.com/GoogleCloudPlatform/localllm/blob/main/querylocal.py https://github.com/GoogleCloudPlatform/localllm/blob/main/qu... there's just a shebang halfway down?
import sys
def main(argv):
pass
if __name__ == '__main__':
main(sys.argv)
#!/usr/bin/env python3
This is awful. Did bard write this?