elorant

13 ms·

301.
by elorant 2y ago
The motherboard has 7 PCie slots and there are 8 GPUs. So where does the spare one connect to? Is he using two GPUs in the same slot limiting the bandwidth?
302.
Meta and Google staff are getting jealous of wealthy Nvidia peers(fortune.com)
10 points by elorant 2y ago|4 comments
303.
by elorant 2y ago
Anna's archive has some 300M pdfs.
304.
Mars: Evidence detected of lake beneath planet's surface(cnn.com)
2 points by elorant 2y ago|0 comments
305.
by elorant 2y ago
You can get a 30TB nvme at about $3k. So that’s probably four times that? I would guess around $15k.
306.
by elorant 2y ago
That AI will be democratized with the free models and every big player like OpenAI will implode at some point because they’re burning too much capital.
307.
by elorant 2y ago
Who cares about the interface? Not everyone is interested in conversational tasks. Corporations in particular need LLMs to process their data. A restful API is more than enough.
308.
by elorant 2y ago
They aren’t in terms of profitability, but they are in terms of future revenue. If most early adopters start self-hosting models then a lot of future products will be build outside of OpenAI’s ecosystem. Then corporations will also start se
309.
by elorant 2y ago
How is throughput per watt affordable? Each card has a TDP of 275 watts, and a maximum draw of 375. If you try to run a big model like Llama-3 400B you're looking at a cluster with 1,8k cards, and a total power draw of nearly 500KWs pe
310.
by elorant 2y ago
They provide those numbers too. Memory bandwidth is at whooping 80 TBs/second.
311.
by elorant 2y ago
There’s no comparison between those two though. You can go and get an RTX 3060 with $300 and run Llama3 8B. To do the same with Groq’s chips you’d need to buy 25 of them at $20k each. To run something like the 70B model you need at least $6
312.
by elorant 2y ago
I live in Greece. While a lot of what the article says resonates with me, there’s a small detail that changes everything. Climate change. The last two years I haven’t eaten a decent tomato during summer. We had excessive heat waves the last
313.
Intel axes 15,000 jobs after sales tumble(bbc.com)
4 points by elorant 2y ago|1 comments
314.
Chipmaker Nvidia reportedly under DOJ antitrust investigation(qz.com)
14 points by elorant 2y ago|2 comments
315.
by elorant 2y ago
Well it is slow. You have to render the page through a headless browser which is resource intensive.
316.
Intel class action lawsuit investigation begins(tomshardware.com)
9 points by elorant 2y ago|0 comments
317.
by elorant 2y ago
There’s nothing surprising here. Facebook isn’t appealing to young people and user engagement is falling. Right now they’re just throwing ideas on a wall to see what sticks. Threads didn’t quite took off either.
318.
by elorant 2y ago
It gets better. Why not build a few hundred different fake personas and then start dating with a variety of real persons to exploit their weaknesses.
319.
by elorant 2y ago
You don’t feel paranoid because the discovery phase is gradual. You don’t wake up one morning and find a loophole. It takes time exploring it from different angles. And that time provides you with the mindset not to worry about the conseque
320.
Bye Bye Superbugs? New Antibiotic Is Virtually Resistance-Proof(iflscience.com)
2 points by elorant 2y ago|0 comments
321.
OpenAI launches prototype of rival to Google search engine(qz.com)
1 points by elorant 2y ago|0 comments
322.
by elorant 2y ago
Every content that exists on the web could now be rewritten and repurposed by LLMs. This could lead into an explosion of web sites that could easily double in size every few years. Good luck indexing all that crap and deciding what is dupli
323.
by elorant 2y ago
I have had similar experiences with pretty much every model. Even heuristics seem to work better than LLMs on summarization.
324.
by elorant 2y ago
For years now antivirus solutions have ridiculous amount of control over the OS. I accidentally installed an adware antivirus the other day that was bundled-up with a third party software, and I had to boot to Linux to manage to completely
325.
by elorant 2y ago
How can an antivirus update affect Azure's servers?
326.
by elorant 2y ago
For the rest of the market you push the agenda of regulation because AI is potentially dangerous. More regulation means that the technology becomes less usable and its adoption is stalled. And that's something that Google is promoting
327.
by elorant 2y ago
I see it the other way around. They’re sabotaging AI in order to maintain their dominance on search. If AI was to advance in some future form it might even substitute search altogether. By making it less reliable you keep your cash cow secu
328.
by elorant 2y ago
I got that answered too https://ibb.co/9W610KB https://ibb.co/rw22gcq https://ibb.co/bWxSK0X
329.
by elorant 2y ago
I can't replicate it. I asked Gemini Pro 1.5 and it answered just fine with detailed instructions for various download scenarios.
330.
Microsoft and Apple reject OpenAI board seats amid antitrust concerns(qz.com)
1 points by elorant 2y ago|0 comments

More ›