5 ms·

Summary: The chip's impressive speed gains are because it uses on-chip SRAM instead of off-chip DRAM. The chip is able to fit much more into SRAM because the c

by jph 11y ago

Summary: The chip's impressive speed gains are because it uses on-chip SRAM instead of off-chip DRAM. The chip is able to fit much more into SRAM because the chip uses network compression, pruning, quantization, Huffman encoding, etc.

6502nerdface 11y ago
Also, the on-board RAM is SRAM rather than DRAM.
- fpgaminer 11y ago
  Where does it say that? On-board SRAM would be very strange, as it's incredibly expensive and not at all performant compared to DRAM.
  - nl 11y ago
    From the paper's abstract: This allows fitting the model into on-chip SRAM cache rather than off-chip DRAM memory
    - fpgaminer 11y ago
      Exactly, that says "on-chip SRAM" not "on-board SRAM". Very different things, and my point stands.
      - nl 11y ago
        Pretty sure from the context the OP was saying on board the chip.
johnzabroski 11y ago
Also, that this is another example of more specialized chip sets eating away at general purpose CPU/GPU market share.
sawwit 11y ago
> Static random-access memory (static RAM or SRAM) is a type of semiconductor memory that uses bistable latching circuitry (flip-flop) to store each bit. SRAM exhibits data remanence,[1] but it is still volatile in the conventional sense that data is eventually lost when the memory is not powered. The term static differentiates SRAM from DRAM (dynamic random-access memory) which must be periodically refreshed. SRAM is faster and more expensive than DRAM; it is typically used for CPU cache while DRAM is used for a computer's main memory. WP