gaogao

7 ms·

61.
by gaogao 2y ago
From what I've heard, a lot of doctors and cops make up shit in reports today anyways. If the summarization is citing back the source in the audio transcript and generally doing RAG stuff, I actually think its more aligned with the int
62.
by gaogao 2y ago
My dad's a doctor and the amount of paperwork you need to write these days has gone up a whole bunch, even higher for him then the 40% of time mentioned in the article. There's a big temptation to fudge on the reports too, since i
63.
by gaogao 3y ago
Yeah, you can totally use both gdscript / C#, as well as C/C++/Rust for targeting performance sensitive objects, like doing heavy simulations, since gdscript / C# will still be often simpler for glue code and light-weigh
64.
by gaogao 3y ago
Yeah, I think it was that an AES function/instructions and some array clearing were getting reordered unsafely, but only under some very specific distributed modes. We were mostly able to get repo after a couple of days, but it was com
65.
by gaogao 3y ago
Ooo, I also had a graalvm migration bug, where it was corrupting a deep aes256 call which was costing us ~1M dollars a day or so until we figured it out.
66.
by gaogao 3y ago
Infiniband I've heard as incredibly annoying to deal with procuring as well as some other aspects of it, so lots of folks very happy to get RoCE (ethernet) working instead, even if it is a bit cumbersome.
67.
by gaogao 3y ago
Could you be specific about which ideas you think were influenced by ClickHouse specifically and not Presto or DuckDB or Spark?
68.
by gaogao 3y ago
Those queries are probably mostly memcache hits, though of course with distributed cache invalidation and consistency fun
69.
by gaogao 3y ago
It's a reasonably easy bet that Together is doing or will do a serious pretraining run with Mamba, where if that's a success other players might start considering it more.
70.
by gaogao 3y ago
In illustration of the prevalence of the phish, I got a dodgy SMS from a sketchy email address that "The USPS package has arrived at the warehouse and cannot be delivered due to incomplete address information." while I was reading
71.
by gaogao 3y ago
There's also less of a special sauce for text models itself these days with the propietary being more on the pre-training data and training stack (e.g. how to get 10k GPUs/TPUs running together smoothly). Multi-modal models (or ad
72.
by gaogao 3y ago
Mostly to boost research and commercial usage around JAX/Gemini is my read. Any internal research using Gemma is now more easily externally reproducible, external research and frameworks are easier to translate over, goodwill especiall
73.
by gaogao 3y ago
> I make AAA video games, my industry does not add anything to society. The culture of society is what we live for! Many games are art and bring joy and purpose to many people. It's tough having a job abstracted away from the people
74.
by gaogao 3y ago
At least an 1/8 or so, but yeah, getting it running on Apple at at least 24fps would be huge. Some degree of interpolation might do it. You maybe could get away with 12fps esp. with an anime aesthetic since that's basically animat
75.
by gaogao 3y ago
> I don't see a way to make anything longer than 20-30 seconds though.. or is that limited by the lyrics? General current limitation of generative audio where longer than 20-30 seconds gets really wonky
76.
by gaogao 3y ago
I remembering learning about Polaroids from Lego Magazine's "no Polaroid pictures" for submissions back in the day, so really neat to see it as a set now.
77.
by gaogao 3y ago
Sketch it out and then ControlNet img2img
78.
by gaogao 3y ago
The limitations of the paper is more so maximum number of workers than minimum. It'd be pretty neat to get something that could work across 100+ distributed workers well.
79.
by gaogao 3y ago
Better to use something with robust end-to-end encryption like Signal
80.
by gaogao 3y ago
So sadly can't find a buggy whip magnate on the Ford board, but a fun little gem from Ford's initial bankroller Alexander Y. Malcomson > In 1905, to hedge his bets, Malcomson formed Aerocar to produce luxury automobiles.[1] How
81.
by gaogao 3y ago
Yeah, adding directly with an LLM is a bad idea. Instead, this would be basically making suggestions linked back to the Wikipedia snippet that a person could approve, edit, or reject. This is a flow for scaling up annotation of data that wo
82.
by gaogao 3y ago
Training on bot data can be bad when it's ungrounded and basically hallucinations on hallucinations. Having LLMs help curate something grounded is generally reasonable. Functionally, it's somewhat similar to how some training is u
83.
by gaogao 3y ago
Right, such a result would need to be marked with a new predicate (verb) like: ``` Subject - Transformer's Paper Predicate - Score Object - BLEU (28.4) ``` One of the trickiest things use a semantic triple store like this is that there
84.
by gaogao 3y ago
Yeah, it works so well, I wonder if it's just a natural fit due to the attention mechanism and graph databases sharing some common semantic triple foundations
85.
by gaogao 3y ago
You totally can! - https://www.wikidata.org/wiki/Q30249683 It's just pretty sparse, so you would need a focused effort to fill out predicates of interest.
86.
by gaogao 3y ago
And in the reverse, Wikidata has a lot of gaps in its annotations, where human labelling could be augmented by LLMs. I wrote some stuff on both ground response and adding more stuff to WikiData a while ago https://friend.computer
87.
by gaogao 3y ago
It's pretty common outside of rails too, like https://facebook.com/4 Some main weaknesses, if I recall correctly, is that's incremental ids make scraping pretty easy, or guessing content outside of a URL given exp
88.
by gaogao 3y ago
Also make sure your backup channel can scale. Getting a flood of 10,000+ folks over to a dinky IRC server can knock it over easy. Throttling new joinees isn't a panacea either, since there might be someone critical to get on a channel
89.
by gaogao 3y ago
Sam Altman is being called on the phone; he's not the guy in the hat.
90.
by gaogao 3y ago
Seconding that Godot C# support is pretty alright and in motion, but also GDScript actually is rather nice for game jamming and quick prototyping.

More ›