4 ms·

When I tried the medium model here it seemed to make more mistakes than the GPU version. Any idea why that would be?

• ggerganov 4y ago
  I have only implemented the Greedy decoder which is worse compared to the BeamSearch decoder in most cases.
  • pbowyer 4y ago
    Yes this does make a difference to the results. I'm loving the speed of your C++ version but it'd be fab to have the BeamSearch decoder if we can?