heyjamesknight

7 ms·

31.
by heyjamesknight 1y ago
The multimodal architectures I’ve seen are still text at the layer between modalities. And the image embedding and text embedding are kept completely separate. Not like where your brain where single neurons are used in all sorts of things.
32.
by heyjamesknight 1y ago
You misunderstand how the multimodal piece works. The fundamental unit of encoding here is still semantic. Not the same in your mind: you don’t need to know the word for sunset to experience the sunset.
33.
by heyjamesknight 1y ago
Multimodal is a farce. It still can’t see anything, it just generates a as list of descriptors that the LLM part can LLM about. Humans got by for hundreds of thousands of years without language. When you see a duck you don’t need to know th
34.
by heyjamesknight 1y ago
You don’t have a deeper “meaning of the word,” you have an actual experience of beauty. Three word is just a label for the thing you, me, and other humans have experienced. The machine has no experience.
35.
by heyjamesknight 1y ago
Layoffs have a significant morale impact for the rest of the company that lasts months or even years afterwards. You should not hire FTEs you intend to fire.
36.
by heyjamesknight 1y ago
> Most Pro-labor people would, I imagine, consider the global labor pool in their analysis. This is an insanely modern take on "pro-labor" movements, especially in the US. Traditionally, pro-labor has been 100% focused on local
37.
by heyjamesknight 1y ago
> and it's not even left from a European perspective. This is a meme that needs to die. Its just not true. The Democratic party in the US is right in line with Labor/Socialist/Whatever Mainstream Leftist Party you want to
38.
by heyjamesknight 1y ago
No. The fundamental encoding unit of an LLM is semantic. Mapping reality into semantic space is a form of lossy compression. There are entire categories of experience that can't be properly modeled in semantic space. Even in "mult
39.
by heyjamesknight 1y ago
Not a great analogy, since there’s zero chance the kinds of model involved in GPT-2 will give us AGI.
40.
by heyjamesknight 1y ago
How would you encode those ideas?
41.
by heyjamesknight 1y ago
No disagreement. Its just something I point out when people are concerned about "HIPAA compliance." My experience is that people tend to think its some objective level of security. But its really just the willingness to sign a BAA
42.
by heyjamesknight 1y ago
Yes, but HIPAA is notoriously vague with regards to what actual security measures have to be in place. Its more of an agreement between parties as to who is liable in case of a breach than it is a specific set of guidelines like SOC 2. If y
43.
by heyjamesknight 1y ago
[flagged]
44.
by heyjamesknight 1y ago
PMs in service firms are usually client facing, or at least client oriented. Having them native puts a native face on the team and keeps the language/culture barrier inside the firm.
45.
by heyjamesknight 1y ago
The topic of conversation is not "human speech/writing" but "human creativity." There's no dispute that LLMs can create novel pieces of textual output. But there is no evidence that they can produce novel idea
46.
by heyjamesknight 1y ago
Amazed that Hacker News has become such a bastion of socialism. The above comment is objective fact.
47.
by heyjamesknight 1y ago
That is a fundamentally different argument than the one GP was making.
48.
by heyjamesknight 1y ago
Capitalism has pulled more people out of poverty worldwide by an order of magnitude than any other competing system or ideology. What capitalism does is apparent in its worldwide success.
49.
by heyjamesknight 1y ago
You must not know many rich people if you think addiction is not an issue for the wealthy. The drugs of choice are less immediately destructive, but cocaine, pills, MDMA and ketamine are all wildly abused by the 1%.
50.
by heyjamesknight 1y ago
I come to HN because the caliber of poster here is above and beyond what you can find basically anywhere on the web. If we wanted to debate ChatGPT, we can go do that on our own.
51.
by heyjamesknight 1y ago
Words have meanings. You can look them up and learn them. If you're not willing to do that, then you should probably not try to participate in a technical discussion where the meaning of words is arguably paramount.
52.
by heyjamesknight 1y ago
Entropy isn't a force. It doesn't "favor" anything. Its a property of statistics, information, and distributions. Also why does this have that particular ChatGPT social media post rhythm to it? Please, Lord, tell me we h
53.
by heyjamesknight 1y ago
You read too many comic books. You think your average, low-level gang member, willing to murder a random person for personal status, thinks what they're doing is "for the greater good"? They do what they do because they value
54.
by heyjamesknight 1y ago
The defining characteristic of evil is privation of good. Plenty of evil actors are self-aware, they just don’t care because it benefits them not to.
55.
by heyjamesknight 1y ago
15 of the 19 9/11 hijackers came from Saudi Arabia. When exactly did we bomb them?
56.
by heyjamesknight 1y ago
Yes, but the Gospels are "complete." You obviously gain much by reading the OT before it—not to mention the apocrypha like Enoch and Jubilees which are quoted directly and indirectly in the NT—but the Gospels have the entire &quot
57.
by heyjamesknight 2y ago
GP's comment still stands: how many properties of the duck does a simulation need to exhibit before it can be considered an accurate simulation? If it looks like a duck and quacks like a duck but isn't made of duck meat, you proba
58.
by heyjamesknight 2y ago
I think the paradigm you're looking for is Plato's Theory of the Forms. Half-joking.
59.
by heyjamesknight 2y ago
I disagree—LLMs don't use them properly. They always put a space between the words before – and after – the dashed part.
60.
by heyjamesknight 2y ago
I'll give you that. I was including those in "semantic space," but the distinction is fair. My original point still stands: the space you've described cannot capture a full image of human cognition.

More ›