4 ms·

I'm excited and scared at the same time. Breathless, actually. My first long hard look at gen AI was just last Saturday evening. Since then, LLaMA was leaked an

I'm excited and scared at the same time. Breathless, actually. My first long hard look at gen AI was just last Saturday evening. Since then, LLaMA was leaked and made easy to run on consumer hardware, folks from Stanford hosted a fine-tuned version of the least sophisticated LLaMA model, and GPT-4 has been announced. One specific thing I can imagine is that a lot more will be expected of the individual knowledge worker. I'm a software engineer. I guess with amazing code gen and testing tools, I will be expected to deliver much more than I can at the moment, because of all the high tech help LLMs can offer. Just thinking about how much I depend on tooling to make life easier... yeah, I can point to that. As a writer, prompting is going to be even more fascinating. Shameless plug, but I tried out Alpaca and wrote about the results [0]. I wish the "gigglepotamus" was a thing! My little experiment was meant to see how much creativity I could get out of the fine-tuned 7B LLaMA model. It was hit or miss, but impressive when it worked. Prompt engineering is already becoming a thing, because people will need people who can get the best out of an LLM. Kind of like how today people are hired to lead teams and get the best out of their individuals. This kind of commoditizing of cognitive function might open up a few new spaces for "authentic natural intelligence". Not unlike the niche world of bespoke, hand-made good crafted by humans and not pushed out on the factory line. TLDR - I'm trembling. With excitement and a bit of fear. There so much that can change so quickly. [0] https://medium.com/sort-of-like-a-tech-diary/speculative-fiction-with-stanford-alpaca-fe99d3c39de7 https://medium.com/sort-of-like-a-tech-diary/speculative-fic...

pixl97 4y ago
We are set up for massive social disruption with what has already come out. This has, at least historically, happened so fast that we've had almost no time to incorporate this into our lives. If we stopped working on new AI today, this would still be massive. Now, with all you've said so far, just remember, we're not stopping. OpenAI, Microsoft, Google are taking billions of dollars and pushing them into new research for models that could achieve general intelligence.
- wsgeorge 4y ago
  This exactly. Unless some hard limit is reached by researchers, at least within the short term we should see almost exponential growth in the capabilities of these models. There's also the fact that people are working on keeping this technology open and accessible [0][1]. That's what's sparked my recent fascination with LLMs. This is only going to get wilder as the competition heats up. [0] https://github.com/ggerganov/llama.cpp https://github.com/ggerganov/llama.cpp [1] https://simonwillison.net/2023/Mar/11/llama/ https://simonwillison.net/2023/Mar/11/llama/

pixl97 4y ago

We are set up for massive social disruption with what has already come out. This has, at least historically, happened so fast that we've had almost no time to incorporate this into our lives. If we stopped working on new AI today, this would still be massive. Now, with all you've said so far, just remember, we're not stopping. OpenAI, Microsoft, Google are taking billions of dollars and pushing them into new research for models that could achieve general intelligence.

wsgeorge 4y ago
This exactly. Unless some hard limit is reached by researchers, at least within the short term we should see almost exponential growth in the capabilities of these models. There's also the fact that people are working on keeping this technology open and accessible [0][1]. That's what's sparked my recent fascination with LLMs. This is only going to get wilder as the competition heats up. [0] https://github.com/ggerganov/llama.cpp https://github.com/ggerganov/llama.cpp [1] https://simonwillison.net/2023/Mar/11/llama/ https://simonwillison.net/2023/Mar/11/llama/