9 ms·

30 and 40 series only? My 2080 Ti scoffs at the artificial limitation

by navjack27 3y ago

phone8675309 3y ago
Don't worry, they'll be happy to charge you $750 for an entry level card next generation that can run this.
- tekla 3y ago
  Yes peasants, Nvidia requires you to buy the latest and greatest expensive luxury gear, and you will BEG for it.
  - nickthegreek 3y ago
    You can use an older 3-series card. No latest & greatest required.
- nickthegreek 3y ago
  A 4060 8gb is $300.
- haunter 3y ago
  Cheapest 40xx is $288 https://pcpartpicker.com/products/video-card/#c=552&sort=price&page=1 https://pcpartpicker.com/products/video-card/#c=552&sort=pri... Chepest 8GB 30xx is $220 https://pcpartpicker.com/products/video-card/#sort=price&c=518 https://pcpartpicker.com/products/video-card/#sort=price&c=5...
andy_xor_andrew 3y ago
so they branded this "Chat with RTX", using the RTX branding. Which, originally, meant "ray tracing". And the full title of your 2080 Ti is the "RTX 2080 Ti". So, reviewing this... - they are associating AI with RTX (ray tracing) now (??) - your RTX card cannot chat with RTX (???) wat
- startupsfail 3y ago
  No support for bf16 in a card that was released more than 5 years ago, I guess? Support starts with Ampere? Although you’d realistically need 5-6 bit quantization to get anything large/usable enough running on a 12GB card. And I think it’s just CUDA then, so you should be able to use 2080 Ti.
- 0x457 3y ago
  > I pull my PC with Intel 8086 out of closet > I try to run windows 10 on it > It doesn't work > pff, Intel cpu cannot run OS meant for intel CPUs wat Jokes aside, nvidia been using RTX branding for products that use Tensor Cores for a long-time now. Limitation due to 1st gen tensor cores not supporting precisions required.
- a13o 3y ago
  The marketing whiff on ray tracing happened long ago. DLSS is the killer app on RTX cards, another 'AI'-enabled workload.
- nottorp 3y ago
  That was my first question, does it display pretty ray traced images instead of answers?
- Havoc 3y ago
  RTX is a brand more than ray tracing. It is largely an arbitrary generational limit
speckx 3y ago
I, too, was hoping that my 2080 Ti from 2019 would suffice. =(
operator-name 3y ago
Yeah, seems a bit odd because the TensorRT-LLM repo lists Turing as supported architecture. https://github.com/NVIDIA/TensorRT-LLM?tab=readme-ov-file#precision https://github.com/NVIDIA/TensorRT-LLM?tab=readme-ov-file#pr...

30 and 40 series only? My 2080 Ti scoffs at the artificial limitation

phone8675309 3y ago

Don't worry, they'll be happy to charge you $750 for an entry level card next generation that can run this.

tekla 3y ago
Yes peasants, Nvidia requires you to buy the latest and greatest expensive luxury gear, and you will BEG for it.
- nickthegreek 3y ago
  You can use an older 3-series card. No latest & greatest required.
nickthegreek 3y ago
A 4060 8gb is $300.
haunter 3y ago
Cheapest 40xx is $288 https://pcpartpicker.com/products/video-card/#c=552&sort=price&page=1 https://pcpartpicker.com/products/video-card/#c=552&sort=pri... Chepest 8GB 30xx is $220 https://pcpartpicker.com/products/video-card/#sort=price&c=518 https://pcpartpicker.com/products/video-card/#sort=price&c=5...

andy_xor_andrew 3y ago

so they branded this "Chat with RTX", using the RTX branding. Which, originally, meant "ray tracing". And the full title of your 2080 Ti is the "RTX 2080 Ti". So, reviewing this... - they are associating AI with RTX (ray tracing) now (??) - your RTX card cannot chat with RTX (???) wat

startupsfail 3y ago
No support for bf16 in a card that was released more than 5 years ago, I guess? Support starts with Ampere? Although you’d realistically need 5-6 bit quantization to get anything large/usable enough running on a 12GB card. And I think it’s just CUDA then, so you should be able to use 2080 Ti.
0x457 3y ago
> I pull my PC with Intel 8086 out of closet > I try to run windows 10 on it > It doesn't work > pff, Intel cpu cannot run OS meant for intel CPUs wat Jokes aside, nvidia been using RTX branding for products that use Tensor Cores for a long-time now. Limitation due to 1st gen tensor cores not supporting precisions required.
a13o 3y ago
The marketing whiff on ray tracing happened long ago. DLSS is the killer app on RTX cards, another 'AI'-enabled workload.
nottorp 3y ago
That was my first question, does it display pretty ray traced images instead of answers?
Havoc 3y ago
RTX is a brand more than ray tracing. It is largely an arbitrary generational limit

speckx 3y ago

I, too, was hoping that my 2080 Ti from 2019 would suffice. =(

operator-name 3y ago

Yeah, seems a bit odd because the TensorRT-LLM repo lists Turing as supported architecture. https://github.com/NVIDIA/TensorRT-LLM?tab=readme-ov-file#precision https://github.com/NVIDIA/TensorRT-LLM?tab=readme-ov-file#pr...