5 ms·

Well, don’t be cynical about it. One thing that I think a lot of us could benefit from is learning how to present a point in a way that people will listen. The

Well, don’t be cynical about it. One thing that I think a lot of us could benefit from is learning how to present a point in a way that people will listen. The key is to harness that hype — use your point to unlock some pent up energy for a new direction, rather than merely try to say it can’t work. A lot of endeavors can work, even if only a little. Find some aspect of it that can, and flip the problem around. Even if the whole thing is mostly bogus, is there a small part that isn’t? Latch onto that. Or go elsewhere. The wonderful part about AI is that the whole world’s problems are up for grabs. Part of why there’s so much unfounded hype is because of how many real advances have recently become possible. This period in history will never come again. It’s also a rare time in history that an individual can make lots of progress. Most of us need to be a part of big groups to do anything worthwhile, in most fields. But in this case lone wolves often have the upper hand over established organizations.

x86x87 3y ago
Yes. Don't tell the emperor that he has no clothes. Instead innovate and introduce a hybrid between his current clothes and old fashion textiles. Who know? In time they may end up covering their junk.
softwaredoug 3y ago
To be clear, I'm mostly excited. But I also think its reasonable to be skeptical and try to educate stakeholders on the realities of the situation. My controversial take on AI is its actually a better time to take things slow, experiment, study, see what works. Not dump TONS of money and cash and get too distracted. Because nobody (besides big tech) has fully figured out how to make a product that makes a profit. Its not clear users want a chatbot (aside from ChatGPT)... But things could change.
- chung8123 3y ago
  I think the issue is, right now AI is a race. We have the Microsoft, Google, Meta, Apple, and Amazon's of the world with their massive compute and bankrolls racing to see who can build the biggest moat around an AI service. The massive upfront spending is hoping to hit the winning lottery ticket and spending slowly may leave you out of the drawing. As compute costs and requirements come down LLMs will be ubiquitous everywhere.
  - akomtu 3y ago
    It's the Manhattan Project 2.0. The AI, once created, won't be that hard to replicate, but those who fail to create it early, will be sidetracked later. The race among big tech is the american way of doing such projects: fund a few companies, let them compete and pick the winner.
    - __loam 3y ago
      This industry is so arrogant lmao. The Manhattan project? Get fucking real.
tayo42 3y ago
> It’s also a rare time in history that an individual can make lots of progress. Most of us need to be a part of big groups to do anything worthwhile, in most fields. But in this case lone wolves often have the upper hand over established organizations. I'm curious why you think this is true? My feeling as a broke individual trying to catch up on ml is that there are some simple demos to do. But scaling up requires a lot of compute and storage for an individual. Acquiring datasets and training are cost prohibitive. I'm only able to play around with some really small stuff because by dumb luck a few years ago I bought a gaming laptop with a nvidia gpu in it. The impressive models that are generating the hype are just a different league. Love to hear to how I am wrong though?
- sillysaurusx 3y ago
  It’s true that you need compute to do large experiments, but the large experiments grow out of small ones. If you can show promising work in a small way, it’s easier to get compute. You can also apply to TRC to get a bunch of TPUs. They had capacity issues for a long time but I’ve heard it’s improved. Don’t focus on the hype models. Find a niche that you personally like, and do that. If you’re chasing hype you’ll always be skating towards the puck. My original AI interest was to use voice generation to make Dr Kleiner sing about being a modern major general. It went from there, to image gen, to text gen, and kaboom, the whole world blew up. I was the first to show that GPTs can be used for more than just language modeling — in my case, playing chess. Wacky ideas like that are important to play around with, because they won’t seem so wacky in a year.
  - tayo42 3y ago
    Thats interesting, at a glance the TRC thing looks more altruistic and impactful than what I had in mind for learning or making money. I'll have to keep it in mind if I do, do something share worthy ever. Thanks!
- jebarker 3y ago
  Another area where there's potential for an individual to make lots of progress is in theory and mechanistic interpretation. Although it's not where the money is, it's probably not rapid progress and it's really hard.
diogenes4 3y ago
> The wonderful part about AI is that the whole world’s problems are up for grabs. Most of the world's problems aren't technological, unfortunately for us in tech. There's little it can do against the momentum of capital tearing this globe apart.

x86x87 3y ago

Yes. Don't tell the emperor that he has no clothes. Instead innovate and introduce a hybrid between his current clothes and old fashion textiles. Who know? In time they may end up covering their junk.

softwaredoug 3y ago

To be clear, I'm mostly excited. But I also think its reasonable to be skeptical and try to educate stakeholders on the realities of the situation. My controversial take on AI is its actually a better time to take things slow, experiment, study, see what works. Not dump TONS of money and cash and get too distracted. Because nobody (besides big tech) has fully figured out how to make a product that makes a profit. Its not clear users want a chatbot (aside from ChatGPT)... But things could change.

chung8123 3y ago
I think the issue is, right now AI is a race. We have the Microsoft, Google, Meta, Apple, and Amazon's of the world with their massive compute and bankrolls racing to see who can build the biggest moat around an AI service. The massive upfront spending is hoping to hit the winning lottery ticket and spending slowly may leave you out of the drawing. As compute costs and requirements come down LLMs will be ubiquitous everywhere.
- akomtu 3y ago
  It's the Manhattan Project 2.0. The AI, once created, won't be that hard to replicate, but those who fail to create it early, will be sidetracked later. The race among big tech is the american way of doing such projects: fund a few companies, let them compete and pick the winner.
  - __loam 3y ago
    This industry is so arrogant lmao. The Manhattan project? Get fucking real.

tayo42 3y ago

> It’s also a rare time in history that an individual can make lots of progress. Most of us need to be a part of big groups to do anything worthwhile, in most fields. But in this case lone wolves often have the upper hand over established organizations. I'm curious why you think this is true? My feeling as a broke individual trying to catch up on ml is that there are some simple demos to do. But scaling up requires a lot of compute and storage for an individual. Acquiring datasets and training are cost prohibitive. I'm only able to play around with some really small stuff because by dumb luck a few years ago I bought a gaming laptop with a nvidia gpu in it. The impressive models that are generating the hype are just a different league. Love to hear to how I am wrong though?

sillysaurusx 3y ago
It’s true that you need compute to do large experiments, but the large experiments grow out of small ones. If you can show promising work in a small way, it’s easier to get compute. You can also apply to TRC to get a bunch of TPUs. They had capacity issues for a long time but I’ve heard it’s improved. Don’t focus on the hype models. Find a niche that you personally like, and do that. If you’re chasing hype you’ll always be skating towards the puck. My original AI interest was to use voice generation to make Dr Kleiner sing about being a modern major general. It went from there, to image gen, to text gen, and kaboom, the whole world blew up. I was the first to show that GPTs can be used for more than just language modeling — in my case, playing chess. Wacky ideas like that are important to play around with, because they won’t seem so wacky in a year.
- tayo42 3y ago
  Thats interesting, at a glance the TRC thing looks more altruistic and impactful than what I had in mind for learning or making money. I'll have to keep it in mind if I do, do something share worthy ever. Thanks!
jebarker 3y ago
Another area where there's potential for an individual to make lots of progress is in theory and mechanistic interpretation. Although it's not where the money is, it's probably not rapid progress and it's really hard.

diogenes4 3y ago

> The wonderful part about AI is that the whole world’s problems are up for grabs. Most of the world's problems aren't technological, unfortunately for us in tech. There's little it can do against the momentum of capital tearing this globe apart.