Cane_P

3 ms·

1.
by Cane_P 2y ago
SOCAMM will enter production in the end of the year: https://www.tomshardware.com/pc-components/dram/nvidia-repor... The CEO of SK Hynix have confirmed that it is in the works: https://www.mk.co.kr&#x2F
2.
by Cane_P 2y ago
It clearly have two ports. Just watch on the right side of the picture: https://www.storagereview.com/wp-content/uploads/2025/01/Sto... You will however get half of the bandwidth and a lot more latency i
3.
by Cane_P 2y ago
DIGITS isn't that impressive... It is a RTX 5070 Ti laptop GPU (992 TOPS, clocked less than 1% higher, to reach 1000 TOPS/1 PFLOP. As a reference RTX 5090 desktop have 3352 TOPS, more than 3x...), with 128 GB of unified memory. Ju
4.
by Cane_P 2y ago
Seeing as it is going to deliver 1 PFLOP, it will need to have similar speed as the "native" (GDDR) counterpart otherwise it will only be able to hit that performance as long as all data is in the cache... My guess is that they wi
5.
by Cane_P 2y ago
They won't have different models, in any other ways than if you want more storage (up to 4 TB, we don't know the lowest they will sell) and cabling necessary for connecting two DIGITS (it won't be included in the box). We alr
6.
by Cane_P 2y ago
You can connect two, and get 256 GB. But it will still not be enough to run it in native format. You will still need to use lower quant.
7.
by Cane_P 2y ago
CPU (20 ARM cores), GPU (1 PFLOP of FP4) and memory (128 GB) seems fixed, so the only configurable parts would be storage (up to 4TB) and cabling (if you want to connect two DIGITS). We kind of know what storage cost in a store and we know
8.
by Cane_P 2y ago
If you read their documentation, then you see that what they are referring to, is when they run 30k instances in parallel. "Now, let’s turn off the viewer, and change batch size to 30000 (consider using a smaller one if your GPU has a
9.
by Cane_P 2y ago
1k calorie (often just called a Calorie) is the amount of energy needed to raise 1 litre of water by 1 degree Celsius.