5 ms·
>Reddit comments show our fixes make Phi-4 inference much better I’d like to try ‘Reddit comments show my fixes make app better’ in my next review
by wsintra2022 2y ago
>Reddit comments show our fixes make Phi-4 inference much better
I’d like to try ‘Reddit comments show my fixes make app better’ in my next review
- danielhanchen 2y agoFixed versions are also independently scored by Hugging Face's Open LLM Leaderboard: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard#/?search=phi-4 https://huggingface.co/spaces/open-llm-leaderboard/open_llm_... The Reddit LocalLlama community is actually pretty cool - tonnes of research actually comes from the community - for example kaiokendev's linear RoPE scaling, YaRN, NTK Aware RoPE Scaling, many LLM benchmarks - many researchers use LocalLlama to share research and discuss on new stuff. I know a lot of AI researchers use the "LocalLlama vibe check" which essentially is an anecdotal approach to LLM evaluation - ie instead of relying on Chat LMsys or LLM benchmarks, 3rd party crowd sourced vibe checks sometimes do much better.
- danielhanchen 2y agoAs an update - the Phi-4 team is actively working on incorporating all fixes! See https://huggingface.co/microsoft/phi-4/discussions/21 https://huggingface.co/microsoft/phi-4/discussions/21