NM_Ricky

9 ms·

1.
Show HN: Running LLMs on CPUs(huggingface.co)
1 points by NM_Ricky 3y ago|0 comments
2.
8x Acceleration for LLM Inference on CPUs(arxiv.org)
2 points by NM_Ricky 3y ago|0 comments
3.
by NM_Ricky 3y ago
For anyone interested in SparseGPT, on May 25th, the author of the SparseGPT paper will show you how you can download an optimized and open-sourced LLM and run it on CPUs at GPU speeds using DeepSparse. Confirm your spot: https:/&#x2F
4.
Achieving 1,000X CPU Performance Boost with Sparse Models in MLPerf(neuralmagic.com)
1 points by NM_Ricky 4y ago|1 comments
5.
by NM_Ricky 4y ago
Exciting news! Our latest MLPerf™ Inference v3.0 results showcase a 6X improvement in just six months, catapulting our CPU performance to an astonishing 1,000X increase and reducing power consumption by 92%. Our sparsified BERT NLP model ac
6.
by NM_Ricky 4y ago
thank you for the heads up, here is the revised version of the doc: https://drive.google.com/file/d/1OcHn2NWWnLGBCBLYsHg7xdOMVse...
7.
by NM_Ricky 4y ago
yes personas are in there, btw, this repo is awesome for it.
8.
by NM_Ricky 4y ago
Happy to introduce one of the most comprehesive ChatGPT cheat sheets: a 30 pg. paper highlighting various prompts to manage ChatGPT for generating text. The document not only highlights what ChatGPT can generate but also how it can generat
9.
ChatGPT Cheat Sheet(drive.google.com)
332 points by NM_Ricky 4y ago|142 comments
10.
Show HN: Sparse Transfer 1000s of Hugging Face Models
1 points by NM_Ricky 4y ago|0 comments
11.
by NM_Ricky 4y ago
You can now load multiple transformers (each model has a unique sparsification recipe) on top of the DeepSparse server behind Streamlit, and it's open-source. This was battle tested on a 16GB of RAM with only 4 vCPU virtual machine. Th
12.
Sparseserver.ui – test the performance of Sparse Transformers(github.com)
2 points by NM_Ricky 4y ago|1 comments