3 ms·
toven from openrouter, leading the team working with our providers - very interested in some of the things found in the report, I dug in to the image failures s
by pingtoven 22d ago
toven from openrouter, leading the team working with our providers - very interested in some of the things found in the report, I dug in to the image failures specifically, and in that case we have data showing deepinfra was correctly parsing images when the endpoint went live in july, but today fails those tests. we'll work on testing images and reasoning effort etc running constantly as chris mentions in point 3.
(screenshot showing our internal testing of deepinfra image inputs: https://raw.githubusercontent.com/ping-Toven/images/main/image-input-test-failures.png https://raw.githubusercontent.com/ping-Toven/images/main/ima... )