Aerroon

44 ms·

901.
by Aerroon 3y ago
You could just try it out if you have the hardware at home. Grab KoboldCPP and a GGML model from TheBloke that would fit your RAM/VRAM and try it. Make sure you follow the prompt structure for the model that you will see on TheBloke&#x
902.
by Aerroon 3y ago
A 200b 4-bit quantized model could potentially fit into 128 GB of RAM. The inference would just be really slow. Ie you could technically run something like that today. I think more VRAM on GPUs isn't necessarily a technical limitation
903.
by Aerroon 3y ago
Won't you run out of context size though? The older models only went up to 2000 tokens, newer ones up to 16k. Ie how do you feed the LLM the text along with your question without it forgetting most of the text? I assume the text you wa
904.
by Aerroon 3y ago
You probably need an AC unit too if you're going to be dumping 2000W of heat into your living space.
905.
by Aerroon 3y ago
I don't know if he actually said this, but power limits on gpus do work. I've been limiting my gpu to about 60% max power during long AI workloads and I lost about 10% of performance. A 40% reduction in power usage seems worthwhil
906.
by Aerroon 3y ago
They'll just make using it this way illegal and scrutinize purchases/suppliers as usual. NAC has been an over the counter supplement since the 70s and only an uproar from people a few years ago kept it unbanned by the FDA.
907.
by Aerroon 3y ago
I'm not so sure how much they will be ironed out. If the product only has a button you can press then maybe, but if it lets you enter text then I think knowing how to prompt will be useful. The reason I believe this is because one of t
908.
by Aerroon 3y ago
I don't know the real answer to your question, but on local models you have a parameter you set that controls how many tokens to generate. It doesn't always follow it, it can end early, but sometimes it just keeps going. Usually t
909.
by Aerroon 3y ago
Maybe it remains underexplored because if you find a significant effect and popularize it, then the substance gets banned. The people interested in using stuff like this have an incentive to avoid scientific research on the subject. Hell, e
910.
by Aerroon 3y ago
> If you can have such laws and judgements, why couldn't other places? Of course you can, but the playing field isn't level to begin with. Over the past century we've seen an increasing amount of urbanization happen. This
911.
by Aerroon 3y ago
Because I live in a country like Lithuania. I know what basic things being too expensive to afford is like. I also know that whatever Americans adopt they push it onto the rest of the world. > Change doesn't have to be scary and I o
912.
by Aerroon 3y ago
> // now arr is [empty, empty, 2, '-4': -4] This isn't pseudo-code. It's what your browser will output as the value for arr What will seem weird and unexpected in this is that you're essentially dealin
913.
by Aerroon 3y ago
This is true, but will those companies actually stay in a place like Montana or would they just go... elsewhere? Rural areas aren't the most attractive places for business.
914.
by Aerroon 3y ago
Sure, and it will come at the expense of your economy. Eg would the ranch mentioned in the article be able to survive if it had to account for this? What will people's reactions be when you double the price of their food or gasoline? I
915.
by Aerroon 3y ago
Why would future price increases for all your goods be inspiring for young people? That's what you're going to end up with when you increase costs. People don't choose fossil fuels just because, they're chosen largely fo
916.
by Aerroon 3y ago
My favorite thing about js that I recently learned is this: var arr = []; arr[2] = 2; // now arr is [empty, empty, 2] arr[-4] = -4; // now arr is [empty, empty, 2, '-4': -4] arr.length; // is 3 arr[&q
917.
by Aerroon 3y ago
Was child labor ever actually 'killed off'? As I understand it, its use declined before legislation hit, but even legislation never completely got rid of it. It just rebranded as "helping my family on a farm" or "he
918.
by Aerroon 3y ago
Part of the reason why they got the political say in the first place - so that they could have a say in politics to prevent this kind of decay from happening. It doesn't always work out though.
919.
by Aerroon 3y ago
Well, you wouldn't be shining it towards race cars. You'd be shining it at the track/back towards the light that's shining on you.
920.
by Aerroon 3y ago
And the blame will all be on AI instead.
921.
by Aerroon 3y ago
But these are two very different scenarios though. When I use a website I'm actively interacting with that website. I want something from their web servers. When I'm using an Nvidia graphics card I'm not actively looking to u
922.
by Aerroon 3y ago
On Google/Meta it's built into the product though. You're connecting to their servers to use the service on their servers. You also don't pay them anything by default. For Nvidia you're expected to pay $1000 for a g
923.
by Aerroon 3y ago
I don't think you're going to be running into much performance difference between the two. People say GameCapture already grabs the frame buffer, but I can't say whether that's true or not.
924.
by Aerroon 3y ago
While you can't use ShadowPlay you can use Nvidia's hardware encoding with software like OBS to do the same thing as ShadowPlay. Actually, it's even better because you can configure OBS to only do it in RAM.
925.
by Aerroon 3y ago
I think TV manufacturers don't help either.
926.
by Aerroon 3y ago
I hope Intel keeps throwing more VRAM at their top cards than the competition. With the way current AI works that VRAM alone could make them attractive to try to develop for in the consumer/hobbyist space.
927.
by Aerroon 3y ago
It's a limitation on the non-bad actors though. It only hurts the bad actor insofar that it's a little harder to willingly get access to them for innocent people.
928.
by Aerroon 3y ago
Microphones are surprisingly sensitive. I can listen to music in my closed-back headset at a regular volume. My desk mic can pick this up. Without boosting the audio it's barely audible that there's music, but after adding some ga
929.
by Aerroon 3y ago
Or just use a password manager.
930.
by Aerroon 3y ago
Unfortunately, I think a lot of government control happens because that's what the people demand . Whenever there's a tragedy or major event politicians (the government) are asked to do something regardless whether it's ef

More ›