kkzz99

9 ms·

61.
by kkzz99 3y ago
You may not know, but China has also adopted pretty elaborate privacy laws called Personal Information Protection Law(PIPL) which is pretty close to GDPR.
62.
by kkzz99 3y ago
The blatant white-washing of corrupt oligarchs by the usual suspects is truly off the charts.
63.
by kkzz99 3y ago
How does that work when the card only has 230MB of SRAM?
64.
by kkzz99 3y ago
How does the Groq PCIE Card work exactly? Does it use system ram to stream the model data to the card? How many T/s could one expect with e.g. 36000Mhz DDR4 Ram?
65.
by kkzz99 3y ago
I don't think this is the argument you think it is...
66.
by kkzz99 3y ago
American weapons, American ISR, American planning, American funding... US politicians talk about a "good investment" and "to the last Ukrainian". I don't understand how you could NOT call it a US-proxy war.
67.
by kkzz99 3y ago
Its because they don't want you to actually use it and see how far behind they are compared to other companies. These announcement are meant to placate investors. "See, we are doing a lot of SotA AI too".
68.
by kkzz99 3y ago
You have to specify the amount of layers to put on the GPU with ollama. Ollama defaults to far less layers compared to what is actually possible.
69.
by kkzz99 3y ago
You use the vector embedding only for retrieval of the actual text, which then gets injected into the prompt.
70.
by kkzz99 3y ago
Huh, why would using uuidv4 be a problem? Collisions?
71.
by kkzz99 3y ago
RTX 3090 has 24GB of memory, a quantized llama70b takes around 60GB of memory. You can offload a few layers on the gpu, but most of them will run on the CPU with terrible speeds.
72.
by kkzz99 3y ago
Which is very ironic, when you compare 1st tier chinese cities with 1st tier US cities, you could probably say the same thing.
73.
by kkzz99 3y ago
Correct, the US is not a reliable partner and should be viewed very warily.
74.
by kkzz99 3y ago
Market is more dominated by Adidas.
75.
by kkzz99 3y ago
Mistrals biggest risk factor is the EU. The overzealous regulation could be stifling innovation, especially open source.
76.
by kkzz99 3y ago
Doesn't matter what hardware they release if the software doesn't support it.
77.
by kkzz99 3y ago
Do these AI accelerators even support common implementations for LLM inference or stable diffusion models? Last time I checked, AMD's support was terrible.
78.
by kkzz99 3y ago
No matter how many times I clicked the back button it wouldn't let me return to hn. Its a terrible implementation.
79.
by kkzz99 3y ago
China filed more IP than rest of world combined in 2022. There is no reason to keep it secret with IP-Laws and Patents. https://www.chinadaily.com.cn/a/202312/12/WS6577b803a31040ac...
80.
by kkzz99 3y ago
For Chinese EV insights I recommend https://twitter.com/tphuang
81.
by kkzz99 3y ago
It was primarily the USSR that liberated us from fascism, while the USSR stopped its occupation of east Germany, the US never stopped. And wasn't it Christina Nuland that said "Fuck the EU" while instigating the Ukraine Coup
82.
by kkzz99 3y ago
In my opinion, the US is as much a foreign adversary as China. The US isn't subsidizing defense, its occupation and hegemony.
83.
by kkzz99 3y ago
I mean, sounds like you haven't kept up with Chinese EV innovation...
84.
by kkzz99 3y ago
Doesn't really look like a cooldown cycle for me in China. The competition is extreme there. Weekly new releases with another cool state-of-the-art feature. Pure innovation going on there, which makes me, as a German, kinda worried...
85.
by kkzz99 3y ago
This is no different then me being a German owning an Android or Iphone, which is going to ping back home to some servers in the US.
86.
by kkzz99 3y ago
Usually, for efficiency, you use quantized models. Quantized models reduce the number of bits available for each parameter, saving space and reduce RAM usage.
87.
by kkzz99 3y ago
How are yearly interest payments of 1tn$USD sustainable?
88.
by kkzz99 3y ago
Will that not change with the new EU rules?
89.
by kkzz99 3y ago
We are talking about very big models which training requires an enormous amount of hardware. Not sure how scalable HuggingFace transformer for training such models is.
90.
by kkzz99 3y ago
Looks like hardware vs. software abstraction. Considereing the perspective of an LLM startup: Would you rather write 20k LOC of complex code that would make you be able to more easily switch hardware platforms - or - write 600 LOC of less c

More ›