3 ms·
>A friend who developed NoCha [1] is running the model on that benchmark [...] Please do update us on the result.
by moralestapia 2y ago
>A friend who developed NoCha [1] is running the model on that benchmark [...]
Please do update us on the result.
- nsagent 2y agoNot looking good. Apparently the model was broken when they released it yesterday. The version they uploaded 8hrs ago only has an 8k context length, so we can't test it on the novels. Here's the updates to the model config on huggingface: https://huggingface.co/mattshumer/Reflection-Llama-3.1-70B/commit/2d5b978a1770d00bdf3c7de96f3112d571deeb75 https://huggingface.co/mattshumer/Reflection-Llama-3.1-70B/c...