3 ms·
Ex-NVIDIA employee here who worked on inference software. When it comes to inference software and models, NVIDIA's strategy is advancing the state of the art in
by hector_vasquez 1mo ago
Ex-NVIDIA employee here who worked on inference software. When it comes to inference software and models, NVIDIA's strategy is advancing the state of the art in the open model realm. They are building software and services business for those markets that need to be competitive on their own merits, and quantization and precision tuning are techniques they use themselves constantly.