3 ms·
Nice, standardization is essential. Without it things could get overly complicated and hard to develop technology to support the consumption of data outside of
by Sparkyte 3y ago
Nice, standardization is essential. Without it things could get overly complicated and hard to develop technology to support the consumption of data outside of the convention. Although I would assume that there will be updates continually to the model.
- larodi 3y agothis all is based on the voluntary work of many researchers in academia and opensource, and now these big companies are 'standardizing' stuff they did not invent, but was invented despite them going in other market directions..
- buildbot 3y agoNot true in this case, it was developed in the industry. https://azure.microsoft.com/en-us/blog/fostering-ai-infrastructure-advancements-through-standardization/ https://azure.microsoft.com/en-us/blog/fostering-ai-infrastr... "Building on years of design space exploration and research at Microsoft, Microscaling technology enables sub 8-bit formats while also enhancing the strength and ease-of-use of existing 8-bit formats such as FP8 and INT8. These advancements also help contribute to broader sustainability goals like reducing the environmental impact of AI technologies as demand continues to grow by improving the energy efficiency of AI in datacenters as well as on many AI endpoints." Of course, it was not the first block floating point, those have been around since the 1963! https://en.wikipedia.org/wiki/Block_floating_point https://en.wikipedia.org/wiki/Block_floating_point.