3 ms·
It's not flaw/bug it's a feature especially from engineering point of view. If you think about it LLM is a true form of big data. Not only the data is big, the
by teleforce 3y ago
It's not flaw/bug it's a feature especially from engineering point of view. If you think about it LLM is a true form of big data. Not only the data is big, the memory processing requirement is big as well, and that's the very definition of big data. Because of this big data requirement, Intel latest Xeon CPU has memory fabric very close to the processor and with the advent of CXL 3.0 this new feature of high-speed memory access is going to be norm rather the exception.
Another example is that big data is now trending for seismic research [1]. I'm not the author for this paper but currently we are working on offline big data for earthquakes and the results are very promising for prediction (several hours/days in advance i.e. not forecasting for months/years). Not only we use recorded big data for earthquakes in many earthquake prone countries e.g Turkey, but the technique that we are using namely time-frequency analysis requires big memory processing. Hopefully we can get fund for further research into the real-time big data collection and processing based on our offline data results. The main aim is to provide early detection and warning to the residences for the upcoming big earthquake (> 7 magnitude) with very good accuracy in a timely manner, to reduce the potential casualties.
[1]Big Data Seismology:
https://agupubs.onlinelibrary.wiley.com/doi/abs/10.1029/2021RG000769 https://agupubs.onlinelibrary.wiley.com/doi/abs/10.1029/2021...