simne

15 ms·

121.
by simne 2y ago
> total number of humans who ever lived 110B But why do you think that all 110B individuals have made significant contribution to overall intelligence? I think, at best case, in every generation exists few significant contributors, but a
122.
by simne 2y ago
> humans needed 10 million times more text for cultural evolution Could you provide source, where exists this 10 million times more text? - Text which is not stored on some material carrier is just forgotten. Largest old text system I kn
123.
by simne 2y ago
LLMs are interest case, but they are nearly flat. Neural system of mammals is structured, as I understand, neocortex consists of about 100 millions structures each ~ 100x400 neurons, something like this. Anyway, just from calculation of hum
124.
by simne 2y ago
There are many cases, when animals (or birds) literally speak and even showing very human like behavior on talking. But, as I could see, only humans have so significant language culture that lead to great number of manuscripts. I will even
125.
by simne 2y ago
I wonder, if it is possible to detect what exactly changed in brain, as this could be a clue to create GAI. Even strict list of changed genes could be extremely helpful for AI progress.
126.
by simne 2y ago
I have seen video. There stated exactly: CPU don't have access to GPU cache, because "they have ran tests, and with this configuration some applications seen two digits speed increase, but nearly none applications they tested show
127.
by simne 2y ago
Plus, main idea of GPU, their "Computing Unit" is not alone. Mean, in CPU could cut any core and it will work completely separated without other cores. In GPU, typical, have blocks for example 6x CUs, which have one pipeline for a
128.
by simne 2y ago
> does the data move from the CPU cache to RAM to the GPU cache Probably, not. Because it need dedicate channel on hardware level. - GPU are mostly for streaming applications with large data blocks, so usually, CPU cache architecture is
129.
by simne 2y ago
Example, as I understand: (I'm not sure how should look prompt, my guess): Prompt: answer, what word is missing in text query. Query: What is it denoising there?
130.
by simne 2y ago
> words spoken by 110 billion people who ever lived, assuming 1B estimated words per human during their lifetime..comes out to 10 million times the size of GPT-4's training set This assumption is slightly wrong direction, because no
131.
by simne 2y ago
I'm not deep researcher, more like amateur, but could explain some things. Most problem with current approach, to grow abilities, need to add more neurons, but this is not just energy consuming, but also knowledge consuming, mean, at G
132.
by simne 2y ago
For LLM, standard method to provide to foundation model sentence without one word (random, but already known to model) and ask to fill this word.
133.
by simne 2y ago
> individuals that hold I don't consider they serious, because they could buy penny stocks, which are unregulated and are very frequent target for fraud. > pensions, mutual funds Funds are better than individuals, because usually
134.
by simne 2y ago
Berkshire Hathaway is very special type of investor, as from Buffet cite, they only invest as major owner, avoid to be minor. Because as major they have much more access to internal kitchen of company, not just standard for IPO open balance
135.
by simne 2y ago
I think, most realistic evaluation is classic VC "divide year sells by bank deposit percents", nothing less and nothing more. So, as example, NASDAQ have about 7.4B sales and divide by 5% will be somewhere about 140B (link below).
136.
by simne 2y ago
I'll describe situation from investors view. Exists just two approaches to hire director. Each have drawbacks. 1. Grow organically from lowest position (Henry Ford claimed, he use this approach in FMC). Drawbacks - it is slow and such
137.
by simne 2y ago
Unfortunately, I could not remember, when median performance of mobile CPU become comparable to business Notebooks. I think, Apple entered race for speed with iPhone X and iPad 3. For Androids things even worse, looks like median achieved N
138.
by simne 2y ago
Unfortunately, this is known business model, most known example was Eclipse IDE, which killed all small IDE businesses. Other example, MySQL from Oracle. Yes, idea, to make basically free something, on which small-medium businesses could su
139.
by simne 2y ago
> Is there a way to get something going on hardware a couple years old? Tensor accelerators are very recent thing, and GPU/WebGPU also recent. RAM was also limited, 4Gb was long time barrier. So, model should run on CPU and within 4
140.
by simne 2y ago
I remember. There was relative of MK-61, nearly fully compatible and in theory have extension port: https://en.wikipedia.org/wiki/Elektronika_MK-52 And sorry for Russian language link, for some reason I have not found
141.
by simne 2y ago
I have used Soviet RPN calculator at my school years. It was not compatible with TI or something Western, but as I know ideologically it was very close. What also interest, in early 2000s, Russia made modern remake, with much improved perfo
142.
by simne 2y ago
> But an LLM can't be held accountable.. neither can most employees Yes and no. Yes, this is really problem, because at current level of technologies, some thing are inexpensive only if done in large numbers (factor of scale), so fo
143.
by simne 2y ago
In eastern Europe in 80-90s produced small trucks with analog diesel engines, but as I know most enterprises already scraped and most lucky now producing WW or Renault by license.
144.
by simne 2y ago
It is possible, but fortunately still exist countries like Ukraine, and produce old diesel engines for trucks (KRAZ) and for tanks (T-64 line, including T-90, and also used on military trailers like MAZ-537, so when you cannot visually see,
145.
by simne 2y ago
I must admit, I agree with nearly all you said. Problem is that Ukraine was weak, and nearly without navy, and civilian ships was unable to resist to Russian navy. And Ukrainian export was blocked, as civilian ships fear to run within range
146.
by simne 2y ago
> slower on the surface than most naval vessels of the time That is point. I'm not agree about most, but will be agree if you say about many. > they couldn’t outrun pursuing destroyers or corvettes But problem was, navy have so h
147.
by simne 2y ago
> if the enemy knew its rough location In these words you hit bull eye. During WWII, submarines was just very special type of boat. You could check wikipedia about German u-boats - exist about TEN subtypes, from which only latest types h
148.
by simne 2y ago
Many small planes don't have INS in typical meaning, but their pilot is INS computer, calculated approximate nav from air data (air speed + weather data + compass or radio compass).
149.
by simne 2y ago
> ballistic missile submarines can’t really use active sonar or surface with any frequency Detect semi-surfaced submarine at night is really hard, if don't have intelligence data that it will surface on some non-random position. Fro
150.
by simne 2y ago
Unfortunately, these numbers considered state of art for modern classic gyroscopes. Better are quantum navigation systems, using quantum matter as sensor, but they was too bulky to be used on planes, only last years appear more compact syst

More ›