kkielhofner

9 ms·

61.
by kkielhofner 2y ago
Given how absurd Instagram/social media already is (entire cottage industries of "private jet" stages in warehouses, etc) it will arguably be a benefit for society when it completely jumps the shark and anyone can generate ov
62.
by kkielhofner 2y ago
Sample size of one but I know someone who went from FAIR to OpenAI.
63.
by kkielhofner 2y ago
I completely understand what you mean by intake over time. Caffeine pills are more like take a pill, wait X minutes, and then get the sensation of “oh, there it is” as it all “hits” at once. There are more expensive time release variants bu
64.
by kkielhofner 2y ago
> highly profitable substance Yes and no. I've been a fan of caffeine pills for years. They are very cheap, readily available (portable), and most importantly to me offer completely consistent dosing. With caffeine pills I'm ab
65.
by kkielhofner 2y ago
Her bank tried... She lives across the country from me and I flew to see her to help put her life back together. It was very involved: pretty much had to reconstruct her entire digital life. New phone numbers, e-mail addresses, online accou
66.
by kkielhofner 2y ago
The ROI on scams based in Indian call centers is already huge. They recently took my mom for $25k for what was a few hours of “work” over the span of two days. When I reviewed their communications and got the full story from my mom they’re
67.
by kkielhofner 2y ago
With the wide availability of countless drugs that impair driving (that may not even be detectable on a urine/blood panel) and obviously don’t register on a breathalyzer you absolutely can be charged with and convicted of DUI based on
68.
by kkielhofner 2y ago
The SIM swapping scandals many mobile carriers have had (as one example) don't show humans as being capable gates to these kinds of things.
69.
by kkielhofner 2y ago
> What many here on HN don't realize is some significant portion of call center activity is people asking things like "Whats my balance?". Exactly. We all have some level of knowledge and experience with things we consider
70.
by kkielhofner 2y ago
> Nvidia have invested a lot in CUDA, This is a significant understatement. For quite some time Jensen has been saying repeatedly that 30% of their R&D spend is on software. With the money-printing machine that is Nvidia if that hold
71.
by kkielhofner 2y ago
Agreed! There is an extremely strong safety and process culture in the US nuclear industry.
72.
by kkielhofner 2y ago
I was just in a nuclear power plant in the US. Needless to say several things stuck out but I was actually pretty surprised about their phone policy. I was allowed to keep my phone the entire time and allowed to take pictures of everything
73.
by kkielhofner 2y ago
> The customers at the national labs are not going to be sharing custom HPC code with AMD engineers, if for no other reason than security clearances. Nuclear stockpile modeling code, or materials science simulations are not being shared
74.
by kkielhofner 2y ago
I'm not sure why you're getting downvoted. It's very clear that Nvidia is moving towards directly offering cloud services[0]. [0] - https://www.nvidia.com/en-us/data-center/dgx-cloud/
75.
by kkielhofner 2y ago
Who is "they"? RTX 4090s are terrible for this task. Off the top of my head: - VRAM (obviously). Isn't that where the racks come in? Not really. Nvidia famously removed something as basic as NVLink between two cards from the
76.
by kkielhofner 2y ago
> I think groq doesn't use quantization, so the gap between your hardware and groq would be even further apart. To my knowledge this isn't (absolutely) publicly known but users on /r/LocalLLaMA and elsewhere have prov
77.
by kkielhofner 2y ago
TensorRT-LLM with Triton Inference Server is the fastest in Nvidia land. https://github.com/triton-inference-server/tensorrtllm_backe...
78.
by kkielhofner 2y ago
There is actually a specific approach of this concept for generating synthetic data for training datasets called UDAPDR[0]. It or something like it could likely be applied to any form of generation including what you are describing. [0] -
79.
by kkielhofner 2y ago
Genuinely curious about this - in my naive and uneducated understanding it seems regular use of anything that activates reward circuity as effectively as marijuana seems like an overall "bad thing" longterm? Anecdotally, I've
80.
by kkielhofner 2y ago
*RTP
81.
by kkielhofner 2y ago
Yeah I've seen that but was annoyed by not being able to just use backticks like everywhere else. Oh the irony of using Frontier but not "understanding" HF formatting ;).
82.
by kkielhofner 2y ago
I work with a couple of the national labs and the talent there is generally incredible. "I went to school for > 25 years so my life's work could be selling more ads" isn't a motivator for most of these people.
83.
by kkielhofner 2y ago
It's much more than that. For example, I have an "AI" project on Frontier. The process was remarkably simple and easy - a couple of Google Meets, a two page screed on what we're doing, a couple of forms, key fob showed u
84.
by kkielhofner 2y ago
> which are typically INT8 These systems are used for training which is VERY rarely INT8. On Frontier, for example, it's recommended to use bfloat16 or float32 if that doesn't work for you/your application. Nvidia has FP8
85.
by kkielhofner 2y ago
I'm the founder of Willow. Generally speaking the approach of "run this on your Pi with distro X" has a surprising number of issues that make it, umm, "rough" for this application. As anyone who has tried to get rel
86.
by kkielhofner 2y ago
I'm the founder of Willow. Early versions sent requests directly from devices and we found that to be problematic/inflexible for a variety of reasons. Our new architecture uses the Willow Application Server (WAS) with a standard g
87.
by kkielhofner 2y ago
I watched the switch to proof of stake on the nodes I had at the time. I’m well aware. I wasn’t talking about the applicability of GPUs for crypto, I was talking about adoption and real world utility. GPUs in AI provide far more value and u
88.
by kkielhofner 2y ago
I have a project on Frontier. Generally these systems (including Frontier) use slurm[0] for scheduling and workload management. The OLCF Frontier user guide[1] has some information on scheduling and Frontier specific quirks (very minor). Cu
89.
by kkielhofner 2y ago
Comparing crypto and AI is really tired and you make the best point - real people are using these GPUs to actually do things of value and improve their daily lives. At the peak of the crypto boom/hype cycle I took on a little project t
90.
by kkielhofner 2y ago
Yes but using someone else's models doesn't make them an "AI company".

More ›