3 ms·
The announcement doesn't specify, but it looks like they are using a llama finetune for this (and basically llama.cpp exposed with gRPC)
by garblegarble 2y ago
The announcement doesn't specify, but it looks like they are using a llama finetune for this (and basically llama.cpp exposed with gRPC)