3 ms·

I don't want to dismiss this outright but I'm skimming this paper and pretty skeptical of something that's from a single guy that doesn't appear peer reviewed,

I don't want to dismiss this outright but I'm skimming this paper and pretty skeptical of something that's from a single guy that doesn't appear peer reviewed, spends most of its time talking about actual biology, comes up with a "RELU6" (RELU but minimum value 6), and then pushes detailed review to a future paper.

amelius 1y ago
He wrote this paper, "Cooperation is All You Need", with a group of people: https://arxiv.org/pdf/2305.10449 https://arxiv.org/pdf/2305.10449 And this paper in an IEEE journal: https://arxiv.org/pdf/2211.01950 https://arxiv.org/pdf/2211.01950
- pinoy420 1y ago
  [dead]
- yorwba 1y ago
  Figure 3 B in "Cooperation is All You Need" shows the same score curves as the top left of Figure 6 in "Beyond Attention," so it must be basically the same implementation. Yet that earlier paper is only cited once, in the Acknowledgements section. As far as I can tell, the only mathematical change in this paper is capping the ReLU at 6. But it also adds a bunch of grandiose verbiage ("triadic modulation loops", "awake thought.") The author is clearly a crackpot. Maybe he wasn't a crackpot when he still managed to publish in peer-reviewed journals, but cognitive decline over time is not exactly unheard of.
  - deleted 1y ago
    [deleted]
  - frozenseven 1y ago
    Cool insults. But perhaps you can explain why he's wrong?
  - anothermathbozo 1y ago
    Warrantless and totally spiteful for you to make unqualified claims like “cognitive decline” from skimming two papers. This is shameful.
habinero 1y ago
I swear, most of the AI "papers" that get posted here are someone screwing around with ChatGPT on ketamine and deciding they're advancing humanity.
- ivape 1y ago
  You’ve just discovered the future of a jobless economy. Please write a blog post and I will surely upvote you. Ketamine is all you need
  - geeunits 1y ago
    Sat here vibe coding a pure assembly kernel for arm64, APL layer with conceptual memory layout. On my bed, eating a bag of chips, jobless since Jan. Everything but the Ket are mine
    - ivape 1y ago
      You serious?
      - geeunits 1y ago
        yasqueen ← {'yes'≡⎕C ⍵}
      - TeMPOraL 1y ago
        Who knows, but drop the word "vibe" and this is basically the startup culture 15 years ago, so ¯\_(ツ)_/¯. Well, okay, for better historical accuracy, replace APL with API, and the kernel for arm64 thing with Ruby on Rails on a new Macbook, but the point still stands.

amelius 1y ago

He wrote this paper, "Cooperation is All You Need", with a group of people: https://arxiv.org/pdf/2305.10449 https://arxiv.org/pdf/2305.10449 And this paper in an IEEE journal: https://arxiv.org/pdf/2211.01950 https://arxiv.org/pdf/2211.01950

pinoy420 1y ago
[dead]
yorwba 1y ago
Figure 3 B in "Cooperation is All You Need" shows the same score curves as the top left of Figure 6 in "Beyond Attention," so it must be basically the same implementation. Yet that earlier paper is only cited once, in the Acknowledgements section. As far as I can tell, the only mathematical change in this paper is capping the ReLU at 6. But it also adds a bunch of grandiose verbiage ("triadic modulation loops", "awake thought.") The author is clearly a crackpot. Maybe he wasn't a crackpot when he still managed to publish in peer-reviewed journals, but cognitive decline over time is not exactly unheard of.
- deleted 1y ago
  [deleted]
- frozenseven 1y ago
  Cool insults. But perhaps you can explain why he's wrong?
- anothermathbozo 1y ago
  Warrantless and totally spiteful for you to make unqualified claims like “cognitive decline” from skimming two papers. This is shameful.

habinero 1y ago

I swear, most of the AI "papers" that get posted here are someone screwing around with ChatGPT on ketamine and deciding they're advancing humanity.

ivape 1y ago
You’ve just discovered the future of a jobless economy. Please write a blog post and I will surely upvote you. Ketamine is all you need
- geeunits 1y ago
  Sat here vibe coding a pure assembly kernel for arm64, APL layer with conceptual memory layout. On my bed, eating a bag of chips, jobless since Jan. Everything but the Ket are mine
  - ivape 1y ago
    You serious?
    - geeunits 1y ago
      yasqueen ← {'yes'≡⎕C ⍵}
    - TeMPOraL 1y ago
      Who knows, but drop the word "vibe" and this is basically the startup culture 15 years ago, so ¯\_(ツ)_/¯. Well, okay, for better historical accuracy, replace APL with API, and the kernel for arm64 thing with Ruby on Rails on a new Macbook, but the point still stands.