7 ms·
Generative AI: A Creative New World
- dkislyuk 4y ago> New techniques, like diffusion models, shrink down the costs required to train and run inference. Since the postscript mentions that the article was co-written by GPT-3, perhaps this is one of the generated lines? :) (compared to the prior SOTA for generative ML in images i.e. GANs, diffusion models use far more compute-heavy and are much slower!)
- algo_trader 4y agoMore importantly, SD was built by a team with just 1 phd, and fully open sourced. What is the moat for all these great startups? Sure, Sequoia wants to hear all about your great startup proposals. And it will (rightly) reject 99%, and finally fund a "known team that can execute" kidding not kidding
- zone411 4y agoThis is only because Stable Diffusion was able to use techniques openly published by the likes of DeepMind, Google Research, and OpenAI. It even directly used some open source code from OpenAI. It wouldn't exist otherwise. DALL-E 2 was published in January 2021. I'm doing generative music AI (melody only) and there is quite a bit of real research required to make progress (I've decided not to publish for now).
- echelon 4y ago> I'm doing generative music AI (melody only) I'm doing vocals! Can't wait for the seams to come together.
- 0xbadc0de5 4y ago"BY SONYA HUANG, PAT GRADY AND GPT-3" Authored in part by GPT-3? Although, I'll remain skeptical of anything brought to us by the same Sequoia who also wrote a breathless SBF puff-piece that aged like fine milk: https://web.archive.org/web/20220922164619/https://www.sequoiacap.com/article/sam-bankman-fried-spotlight/ https://web.archive.org/web/20220922164619/https://www.sequo...
- pdntspa 4y agoWithin the first few sentences of the opening on this one, I was thinking the same thing. Cue me hitting the back button immediately...
- derwiki 4y agoYea, it’s hard for me to not think of SBF every time I hear Sequoia’s name
- ignoramous 4y agoIf it helps, Sequoia also bet on WhatsApp, Google, and a whole host of other iconic tech companies (as well as duds). I guess, with FTX, they made the mistake of drumming up the founder too soon (btw, doing so isn't specific to Sequoia; almost all other VC firms do this. It is priming up the market, as it were). As VCs gain more traction and became more accessible (on social media, esp), it only serves to their detriment when they make a mistake, even if it is a honest one. I don't think VCs care that much, tbh, given the power imbalance that having that much money brings.
- xenospn 4y agoEasy to have a few home runs when you have unlimited innings for 20 years.
- FreakLegion 4y agoI don't think any Sequoia fund has returned less than 8x in the last 20 years. That's better than the total US market or the S&P 500 from the low of the Great Recession to the inflation-fueled peak of the pandemic (7.1x and 6.3x respectively), which is a cherry-picked, unprecedented 13-year stretch compared to the worst-performing fund's 10 years. FTX-sized failures are expected and part of their operating model.
- ushakov 4y ago> This piece was co-written with GPT-3 > We also generated illustrations for this post with Midjourney
- UncleEntity 4y agoAbout halfway through the article I started wondering how many of these pro-AI articles are written by AI. Something about the writing style is just off.
- l33tman 4y agoWell it's not just the pro-AI articles, its most new articles on the web today. It has been for some time now, google top results for IT questions (for example) are always GPT SEO spam sites and you don't figure it out until after reading a bit and seeing it's pretty generic advice and answers..
- visarga 4y ago> how many of these pro AI articles are written by AI GPT-3 can generate pretty convincing anti-AI copypasta.
- moffkalast 4y ago"This generative tech sounds pretty promising, I think it'll go far. Also GPT-3 is the best model, screw the other models." - GPT-3
- aliqot 4y agoParty's over, the suits are here to feed us our own flesh for a price Please Sequoia, for we are only knaves, let us play
- compiskey 4y ago
- ksec 4y agoI guess someone has to export it to PDF incase it get taken down as well.
- ignoramous 4y agoarchive.org honors takedown requests but... https://archive.is/Ne4Ru https://archive.is/Ne4Ru ;)
- ilikerashers 4y agoI really have fun with all this image generation stuff but can anyone explain what the real $$$ benefit of all these funky dreamlike pictures is? As massive VCs are starting to take note, it's starting to feel a bit like the crypto scene. Interesting tech without much real-world application.
- thundergolfer 4y agoI think it could be incorporated into 'for the masses' design software suites like Canva.com. If done right, image generation and augmentation could be a powerful and valuable feature.
- ilikerashers 4y agoYeah, I agree. Like an ideation assist.
- themanmaran 4y agoI could see a valid use for generative assets in game dev. Some open world type game with different landscapes / backgrounds that are all autogenerated.
- ilikerashers 4y agoI can see that for 2d backgrounds and pixel art.
- themanmaran 4y agoOh that's an easy and practical application. Want to start on the MVP and I'll email Sequoia the business pitch?
- ramoz 4y agoPhotoshop has a beta feature for generating backgrounds using their "neural filters" a few in the community are diving deep on game assets: https://twitter.com/emmanuel_2m https://twitter.com/emmanuel_2m
- 88stacks 4y ago
- ilrwbwrkhv 4y agoSequoia should stop writing blogpost for a while.
- 2devnull 4y agoAll of the immediate applications I envision outside of entertainment are nefarious, sinister. I don’t want to share these ideas, but I know if this stuff has occurred to me, it will be implemented eventually.
- jabthedang 4y ago
- smaudet 4y ago"Generative AI can make these workers at least 10% more efficient and/or creative: they become not only faster and more efficient, but more capable than before. Therefore, Generative AI has the potential to generate trillions of dollars of economic value." What utter bull - at a time when inflation is on the rise (7-14%), you aren't going to unlock ANY market potential, in fact you are going to shrink the market, significantly. Prepare for impending market collapse and massive market failure... https://www.statista.com/statistics/225698/monthly-inflation-rate-in-eu-countries/ https://www.statista.com/statistics/225698/monthly-inflation... https://ycharts.com/indicators/us_inflation_rate https://ycharts.com/indicators/us_inflation_rate
- mudil 4y ago'Prepare for impending market collapse and massive market failure...' If you are so good at seeing the future, you should be the richest person on earth. Surely there's a way to short the market.
- smaudet 4y agoI would short Adobe in the near term, personally.
- echelon 4y agoThis is a short term shock to a long term trend. Absent a nuclear cataclysm, tech and productivity are always going to grow. Investors go long and capture the outsized returns. The narrative and potential of AI/ML is incredible. It stands to be as disruptive as smartphones and the internet were. As for your thesis on the current economic picture, much of the market still thinks there's an easy out just around the corner. You can make a bet on that and find out.
- karaterobot 4y agoGenerative AI: A Creative New World — And Maybe You Should Too.
- thesausageking 4y agoSequoia was very late in getting into crypto and then piled money into FTX without any diligence, and then wrote glowing articles on SBF promoting him as a savior of humanity: https://web.archive.org/web/20221027181005/https://www.sequoiacap.com/article/sam-bankman-fried-spotlight/ https://web.archive.org/web/20221027181005/https://www.sequo... Sequoia coming into AI now, with the same kind of grandiose proclamations doesn't sit well.
- deleted 4y ago[deleted]
- deleted 4y ago[deleted]
- throw827474737 4y agoOh wow, code generation will have its prime time next year already, and in 2030 we will already be all replaced? Wow! Better hurry now :/ "Copilot is generatin 40% of code in projects where it is installed" - is that any true, to start with something? What are these kind of projects?
- deleted 4y ago[deleted]
- deleted 4y ago[deleted]
- stephc_int13 4y agoThe expectations they have for 2030 are frankly delusional. “In 3-8 years we'll have a machine with the general intelligence of an average human being. The machine will begin to educate itself with fantastic speed. In a few months it will be at genius level and a few months after that its powers will be incalculable.” —Marvin Minsky, 1970
- hef19898 4y agoWe can thank John Connor that this didn't happen yet! Because if it did, Neo would be our last hope!
- trention 4y ago>The expectations they have for 2030 are frankly delusional. Well, they do start with the delusional "copilot writes 40% of your code" microsoft marketing bullshit which everyone who has ever used it knows is not true, so it really is "garbage in, garbage out".
- Mandelmus 4y agoCan you show me a source for that full quote? I can’t seem to find it.
- stephc_int13 4y agoWhat would be the best way to short Sequoia? Not a rhetorical question.