andy_xor_andrew

9 ms·

91.
by andy_xor_andrew 3y ago
dumb question... is it purely the demand that makes it this expensive? The "you need this or you die" aspect? Or is the cost of research and manufacturing for this stuff so astronomical that it warrants such a high price? I almo
92.
by andy_xor_andrew 3y ago
ah, ok. so this is for scenarios where you, the library author, define the trait, and users will implement it. But since different users have different requirements, you provide two+ trait definitions, so they can pick if they need Send or
93.
by andy_xor_andrew 3y ago
this is so cool :) one other question for async Rust experts... is it trivial to replace every use of the #[async_trait] with this, once it releases? async_trait was just a macro for adding a bunch of `Box<Pin<dyn Future<Output = B
94.
by andy_xor_andrew 3y ago
I'm confused about the example for trait_variant: ``` #[trait_variant::make(HttpService: Send)] ... ``` In the given example, they create a trait with an async fn that returns HtmlBody, then the trait_variant macro makes a duplicate ve
95.
by andy_xor_andrew 3y ago
really interesting! thanks for the info!
96.
by andy_xor_andrew 3y ago
I'm really curious about this part: > and requires training the network to use it. I thought one of the benefits of MCTS was, if you already have your value network, then a general MCTS implementation can walk the tree of values cre
97.
by andy_xor_andrew 3y ago
interesting how MCTS decoding is called out. that seems entirely like a software aspect, which doesn't depend on a particular chip design? and on the topic of MCTS decoding, I've heard lots of smart people suggest it, but I'v
98.
by andy_xor_andrew 3y ago
It's far, far more likely that Grok was just trained on data that includes text generated by GPT. This is super common in the open-source/local AI area. Many models are trained on output from GPT. The better models will filter out
99.
by andy_xor_andrew 3y ago
I am with you on this. Mistral 7B is amazingly good. There are finetunes of it (the Intel one, and Berkeley Starling) that feel like they are within throwing distance of gpt3.5T... at only 7B! I was really hoping for a 13B Mistral. I'm
100.
by andy_xor_andrew 3y ago
If it is a great car, but flops because it looks weird, that's a shame. If it's a terribly-built car, with reliability issues, and a super difficult production cycle, that's a shame, but for a different reason: you'd thi
101.
Ask HN: What smarthome ecosystem is most open, private, and hackable?
4 points by andy_xor_andrew 3y ago|4 comments
102.
Simple tree searching might yield better LLM responses(andys.page)
2 points by andy_xor_andrew 3y ago|0 comments
103.
by andy_xor_andrew 3y ago
I took an AI course in college back around 2015. Just a bit before AlphaGo. One project was to implement a simple Q-learning action/value system to play simple games, like Pacman. The crypto-bros-turned-AGI-experts on twitter are spout
104.
by andy_xor_andrew 3y ago
which makes sense. you can pretty easily imagine the problem of "selecting the next token" as a tree of states, with actions transitioning from one to another, just like a game. And you already have naive scores for each of the st
105.
by andy_xor_andrew 3y ago
Damn, Microsoft is playing all sides of this, huh. Within a ten minute window: - Satya announced GPT-4 runs (at least partly) on a new AMD offering - Satya announced an in-house chip for ML acceleration - Satya brings NVidia CEO Jensen Huan
106.
by andy_xor_andrew 3y ago
I think the general (completely speculative and unconfirmed) consensus is that "Turbo" models are somehow quantized, or otherwise modified for much faster and cheaper inference, at the expense of some quality (the definition of &q
107.
by andy_xor_andrew 3y ago
Hold on, Google has its own weather model? Are they they only one that use it, or do agencies use them as well?
108.
by andy_xor_andrew 3y ago
great, now do the same for Candy Crush, Tiktok, Instagram, and Amazon Prime Video
109.
by andy_xor_andrew 3y ago
I'll be the weirdo and admit... I enjoy true crime podcasts. But!!! But... I don't like the mindless exploitative stuff (which is unfortunately 95% of it). I like the hard-cutting journalism stuff. My favorite 3 are Swindled, Cour
110.
by andy_xor_andrew 3y ago
> Are you aware there are some malicious deviations already possible with AI ? Alright, you hooked me in. What are they?
111.
by andy_xor_andrew 3y ago
Don't forget the MagSafe(TM) port, Force Touch(TM) trackpad, and Magic Keyboard(TM) with Touch ID(TM). (though tbh this is not a new thing from Apple, they did this even back when Jobs was around...)
112.
by andy_xor_andrew 3y ago
Question for the experts! Has NTFS changed much in... 20 years? Linux filesystems seem to be evolving all the time (try to install any new distro today and check out how many filesystems you can pick from the dropdown...) Apple replaced one
113.
by andy_xor_andrew 3y ago
> Imagine we gave you unrestricted access to OpenAI’s Whisper (transcription), Voice (text-to-speech), GPT-4V, and DALLE·3 models, and you were a malicious actor. Consider the most unique, while still being probable, potentially catastro
114.
by andy_xor_andrew 3y ago
Instead of adding in secret whitespace unicode characters, wouldn't an approach similar to a Bloom filter work pretty well? Just spitballing here. 1. Identify the ~N most common tokens (let's say N is 5), and call this set S. 2. R
115.
by andy_xor_andrew 3y ago
> I’ve written quite a few Rust projects where I expect it to only involve blocking primitives, only to find out that, actually, I’m starting to do a lot of things at once, guess I’d better use async. In my experience (which, admittedly,
116.
by andy_xor_andrew 3y ago
Also, using the word "codecs" kind of puts a bad taste in my mouth. It's like they're trying to sound like they invented an entirely new paradigm, with their own fancy name that reminds people of video compression.
117.
The War on Pineapple [pdf](cisa.gov)
1 points by andy_xor_andrew 3y ago|0 comments
118.
by andy_xor_andrew 3y ago
Here's one thing I don't get. Why all the rigamarole of hoping you get a valid response, adding last-mile validators to detect invalid responses, trying to beg the model to pretty please give me the syntax I'm asking for...
119.
by andy_xor_andrew 3y ago
Are the models specifically trained to be experts in certain domains? Or the models are all trained on the same corpus, but just queried with different parameters? Is this functionally the same as beam search? Do they select the best output
120.
by andy_xor_andrew 3y ago
My favorite part about this is how it basically forces services to accept this as a functional scenario. If it were UBlock Origin doing this, sites could just say "Sorry, we don't support this, your addin is breaking everything, p

More ›