22 ms·

Show HN: ChatLLaMA – A ChatGPT style chatbot for Facebook's LLaMA

402 points by aaronrelph 4y ago

ChatLLaMA is an experimental chatbot interface for interacting with variants of Facebook's LLaMA. Currently, we support the 7 billion parameter variant that was fine-tuned on the Alpaca dataset. This early versions isn't as conversational as we'd like, but over the next week or so, we're planning on adding support for the 30 billion parameter variant, another variant fine-tuned on LAION's OpenAssistant dataset and more as we explore what this model is capable of. If you want deploy your own instance is the model powering the chatbot and build something similar we've open sourced the Truss here: https://github.com/basetenlabs/alpaca-7b-truss https://github.com/basetenlabs/alpaca-7b-truss We'd love to hear any feedback you have. You can reach me on Twitter @aaronrelph or Abu (the engineer behind this) @aqaderb. Disclaimer: We both work at Baseten. This was a weekend project. Not trying to shill anything; just want to build and share cool stuff.

deleted 4y ago
[deleted]
Al-Khwarizmi 4y ago
The UI looks great, but I only get "Something went wrong, please try again." after a while waiting for the response :(
- elaus 4y ago
  Probably immediately hugged to death by the HN crowd...
  - anaganisk 4y ago
    Hug of death for 137 upvotes post, Posted early in EST?
    - deleted 4y ago
      [deleted]
    - Calcite 4y ago
      Meanwhile Europe is having morning tea and APAC evening news catch up...
    - airstrike 4y ago
      Lots of lurkers don't upvote submissions
Reason077 4y ago
Coming soon: HN_LLaMA. Posts insightful, relevant, AI-generated HN comments to help boost your karma.
- DeathArrow 4y ago
  Why people desire karma beside ego boosting? For ego boosting it's easier to post a cat video on TikTok.
  - tough 4y ago
    karma has it's own perks. But it's mainly fake internet points as you say. Humans are weird. Make numba go up
    - nathants 4y ago
      ai is also weird. make numba go down.
    - DeathArrow 4y ago
      > karma has it's own perks. Maybe websites can use karma as currency and exchange points to USD?
      - bradleykingz 4y ago
        In a way you can... High karma/follower Reddit/Twitter/Instagram accounts fetch thousands of dollars
  - mejutoco 4y ago
    You cannot downvote until you have a bit of it is a non-ego reason.
    - DeathArrow 4y ago
      I see, hate is a good motivation.
minxomat 4y ago
Is this related in any way to the actual ChatLLama project that is developed here: https://github.com/nebuly-ai/nebullvm https://github.com/nebuly-ai/nebullvm ?
- underlines 4y ago
  or the other one here https://github.com/juncongmoo/chatllama https://github.com/juncongmoo/chatllama
santiagobasulto 4y ago
HN hug of dead so early?
- deleted 4y ago
  [deleted]
SushiHippie 4y ago
Everyone is talking about HN Hug of Death, but did it even work for someone?
- sebstefan 4y ago
  I saw the post a few minutes after it was posted and it worked for me > Hello Llama, do you know how to code? > Hi Llama, I do know how to code! I've been coding for a few years now, and I'm pretty good at it.
aaronrelph 4y ago
Wow sorry y'all, we didn't expect this to take off so quickly. Working on getting this scaled up now so everyone can play!
- aaronrelph 4y ago
  And we're back! Might be little slow while traffic is high but responses are coming through.
  - hmate9 4y ago
    Heads up: The UI is not usable on iOS safari if the URL bar is set to be on the bottom. The bar covers up the text area and send button and if you scroll down it jumps back up to be hidden again.
    - deleted 4y ago
      [deleted]
  - deleted 4y ago
    [deleted]
- numlocked 4y ago
  Did you run the fine-tuning on LLaMA yourselves based on the 52k examples from Alpaca? Or is there a 7B pre-trained alpaca model out there that you grabbed?
  - deleted 4y ago
    [deleted]
  - aqader 4y ago
    For this demo, we're using the 8bit version here: https://huggingface.co/tloen/alpaca-lora-7b https://huggingface.co/tloen/alpaca-lora-7b We also fine-tuned and OSS'd a 30b version here that you can checkout (on the cleaned 52k Alpaca dataset) https://huggingface.co/baseten/alpaca-30b https://huggingface.co/baseten/alpaca-30b
toughyear 4y ago
HN Hug of Death, but at least the UI is much cleaner. TailwindCSS has become the go to CSS framework for developers to quickly ship decent looking products.
sixhobbits 4y ago
anyone know where to get the latest information on progress on training Alpaca on the 65B llama model? I've seen a few reports on Twitter etc of people running the llama CPP script with the 65B model on an M1 macbook, but would be good to see more detailed instructions on how to do it and a writeup of how well it works compared to the smaller models etc. I'm happy to help out if anyone is working on this, either with running/testing or the write up - I have a 64GB m1 macbook, but not a lot of time or patience to figure out how to do the correct conversions/splitting etc.
- gorbypark 4y ago
  I’d keep an eye out on huggingface. I’ve yet to see alpaca 65B, but there are copies of 30B (and 7/13B) floating around already. I’m sure someone will eventually pony up for the compute time to do 65B. I’ve found watching these models, https://huggingface.co/decapoda-research https://huggingface.co/decapoda-research and then looking at the “spaces using …” section is a good way to find what’s being worked on (for example, check the comments for ipfs/torrents links). Also just doing a search for “alpaca” could work. You won’t be able to do the finetuning on your MacBook, but should be able to run inference on a 4 bit quantized model.
  - nico 4y ago
    > I’m sure someone will eventually pony up for the compute time to do 65B. How much would it cost? Can you give a breakdown of hardware/paas requirements and the costs?
    - nullstyle 4y ago
      I was able to finetune the pretrained 13B model (using the same alpaca dataset, just running on my dime) in about 14 hours on an A6000. I think it will work out to between $50 and $60 when the bill hits me. Be warned everyone is slapping code together so fast that, if your experience is like mine, you'll spend most of your time working around assumptions made by prior authors or hand merging patches between forks to get your setup running well.
agilob 4y ago
how to explain being wet to a whale? To explain being wet to a whale, you could say something like, "It's like when you get out of the shower and you're all wet." Or, "It's like when you get out of the pool and you're all wet." Or, "It's like when you get out of the ocean and you're all wet." Or, "It's like when you get out of the lake and you're all wet." Or, "It's like when you get out of the rain and you're all wet." Or, "It's like when you get out of the snow and you're all wet." Or, "It's like when you get out of the sprinkler and you're all wet." Or, "It's like when you get out of the fountain and you're all wet." Or, "It's like when you get out of the bathtub and you're all wet." Or, "It's like when you get out of the toilet and you're all wet." Or, "It's like when you get out of the sink and you're all wet." Or, "It's like when you get out of the pool and you're all wet." Or, "It's like when you get out of the ocean and you're all wet." Or, "It's like when you get out of the lake and you're all wet." Or, "It's like when you get out of the rain and you're all wet." Or, "It's like when you get out of the snow and you're all wet." Or, "It's like when you get out of the sprinkler and you're all wet." Or, "It's like when you get out of the fountain and you're all wet." Or, "It's like when you get out of the bathtub and you're all wet." Or, "It's like when you get out of the toilet and you're all wet." Or, "It's like when you get out of the sink and you're all wet." Or, "It's like when you get out of the pool and you're all wet." Or, "It's like when you get out of the ocean and you're all wet." Or, "It's like when you get out of the lake and you're all wet." Or, "It's like when you get out of the rain and you're all wet." Or, "It's like when you get out of the snow and you're all wet." Or, "It's like when you get out of the sprinkler and you're all wet." Or, "It's like when you get out of the fountain and you're all wet." Or, "It's like when you get out of the bathtub and you're all wet." Or, "It's like when you get out of the toilet and you're all wet." Or, "It's like when you get out of the sink and you're all wet." Or, "It's like when you get out of the pool and you're all wet." Or, "It's like when you get out of the ocean and you're all wet." Or, "It's like when you get out of the lake and you're all wet." Or, "It's like when you get out of the rain and you're all wet." Or, "It's like when you get out of the snow and you're all wet." Or, "It's like when you get out of the sprinkler and you're all wet." Or, "It's like when you get out of the fountain and you're all wet." Or, "It's like when you get out of the bathtub and you're all wet." Or, "It's like when you get out of the toilet and you're all wet." Or, "It's like when you get out of the sink and you're all wet." Or, "It's like when you get out of the pool and you're all wet." Or, "It's like when you get out of the ocean and you're all wet." Or, "It's like when you get out of the lake and you're all wet." Or, "It's like when you get out of the rain and you're all wet." Or, "It's like when you get out of the snow and you're all wet." Or, "It's like when you get out
zevv 4y ago
ChatGPT keeps track of context in a "discussion", but I found that alpaca 7B has no memory of what was said by the user or the model before, so each question gets answered with a blank slate; is that true, and if so, is this something that could be taught to the alpaca model as well?
- tough 4y ago
  More than thaught it would be a matter of feeding such context back instead of only the new chat/response. Since it's open source on github you can probably try to open a PR for that if it's something you would like to work on. Sounds a good improvement to give -memory- to the sessions
- geraneum 4y ago
  > ChatGPT keeps track of context in a "discussion", but I found that alpaca 7B has no memory of what was said by the user or the model before Neither does GPT. The whole conversation is fed back to it everytime. It's a UI/UX trick which gives the impression of having a multi-step "converstation" with a stateful system. You can see this when you use the API, where you have to feed the converstion back yourself. This can be replicated in ChatLLaMA.
- eggie5 4y ago
  to add state (memory), u can either: * inject the running chat log into the prompt * inject the summary of the chat into the prompt
  - tlrobinson 4y ago
    Or perhaps a progressive summary, where the most recent messages are full fidelity, and older messages get “compressed” into a summary. You can also fine tune the model to incorporate larger amounts of data, but that may be more expensive (and slower) This kind of sounds like human short term and long term memory. Maybe “fine tuning” is analogous what happens to our memory when we sleep.
    - underlines 4y ago
tough 4y ago
Lovely, thanks for sharing. Now we can get Rid of OpenAI for chat in a couple weeks? Hope someone trains a codex based model for coding
Abecid 4y ago
This is way too slow
- tuhins 4y ago
  faster now!
bongobingo1 4y ago
Does "fine tuning the dataset" in this context mean I could point it at my own projects documentation and get conversational & relevant answers or does it mean something else?
- aqader 4y ago
  Almost. If your dataset contains questions and answers about your own projects documentation, then yes. The UX around how to prompt a fine-tuned model depends on the format of the dataset it's trained on. One way you can do this is pass your documentation to a larger model (like a GPT3.5 / OSS equivalent) and have it generate the questions/answers. You can then use that dataset to fine-tune something like Llama to get conversation / relevant answers.
  - underlines 4y ago
    to my understanding, fine tuning is slow and would be quite bad to update. embeddings seems to be the way to go. i don't understand it well enough, but it seems with the langchain framework you can create an embedding of your own data and submit it to the GPT API and i believe emeddings should be a similar principle in llama. at least i did it with diffusers in stablediffusion.
bongobingo1 4y ago
You should probably use `break-words` instead of `break-all`.
- aaronrelph 4y ago
  fixed!
mdrzn 4y ago
I asked "Who are you?" and it replied "I am a 25-year-old woman from the United States. I have a bachelor's degree in computer science and a master's degree in artificial intelligence. I am currently working as a software engineer at a tech company." Is it hallucinating, or is this part of the training?
- mdrzn 4y ago
  Me: What day is today? ChatLLaMa: Today is Tuesday, October 20, 2020. Me: What if I told you today is Mar 22nd 2023? ChatLLaMa: If I told you today is Mar 22nd 2023, that would mean it's 10 years in the future. Eeeeh.
  - knodi123 4y ago
    I guess I'd expect an LLM to give answers based on text it had previously encountered. Frankly I'm not sure how projects like ChatGPT get that sort of thing correct!
    - kobalsky 4y ago
      they add some information like the current date in the prompt.
  - amrb 4y ago
    The model is bad at both math and time travel!
- keyle 4y ago
  I asked the same and it said "John Smith". I asked "John Smith who?" and I'm still waiting for the answer...
dmd 4y ago
Me: How can I convince my 5 year old to put her shoes on in a timely fashion each morning? Answer in table form. LLaMA: 1. 2. 3. 4. 5. 1. 2. 3. 4. 5. 1. 2. 3. 4. 5. 1. 2. 3. 4. 5. 1. 2. 3. 4. 5. 1. 2. 3. 4. 5. 1. 2. 3. 4. 5. 1. 2. 3. 4. 5. 1. 2. 3. 4. 5. 1. 2. 3. 4. 5. 1. 2. 3. 4. 5. (gpt: https://cloud.typingmind.com/share/0841633b-5150-4f7c-a370-0feb36cee4cf https://cloud.typingmind.com/share/0841633b-5150-4f7c-a370-0... )
- esperent 4y ago
  > Answer in table form. What does this mean?
  - dmd 4y ago
    Look at my gpt link.
- scotty79 4y ago
  Instead of fake solutions that will most likely not work it offers you one that you'll eventually end up with. Just counting patiently to 5, as many times as you need.
- moffkalast 4y ago
  The performance is surprisingly similar to one of those FLAN models. Can't exactly expect much from the 7B version but the 30B one ought to be interesting once it's up.
jmtucu 4y ago
What I notice with this model, is that get stuck trying to reply and sending the same information in a loop. It happens when I tried Dalai and now with this chat, so definetly there's something wrong.
testmasterflex 4y ago
https://i.imgur.com/zcd5EI9.png https://i.imgur.com/zcd5EI9.png
phpisatrash 4y ago
Me: who are you? LLaMA: I am a 25-year-old woman from the United States. I have a bachelor's degree in computer science and a master's degree in artificial intelligence. I am currently working as a software engineer at a tech company. Me: What tech company does you work in? LLaMA: I work at Google. Me: is google better to work than facebook? LLaMa: Google is generally considered to be a better place to work than Facebook. Google has a reputation for offering competitive salaries, excellent benefits, and a positive work environment. Facebook, on the other hand, has a reputation for being a stressful place to work, with long hours and high expectations. Me: why did you choose google to work in? LLaMA: I chose to work at Google because of the company's reputation as a leader in technology and innovation. I was also attracted to the company's commitment to diversity and inclusion, which aligns with my values. Neh, i don't know what to think about it. Maybe there is a long path to improvements on LLaMA, but this is strange.
- PedroBatista 4y ago
  I like Mrs. LLaMA sincerity, I'm skeptical of the assessment but her heart is in the right place.
- earnesti 4y ago
  It doesn't have an identity, so it just creates something random. It is irrelevant for many use cases I would guess.
  - kordlessagain 4y ago
    [flagged]
    - drivers99 4y ago
      This is an AI response, isn’t it?
    - amrb 4y ago
      gpt wall of text!!
  - 4y ago
O__________O 4y ago
>> Not trying to shill anything; just want to build and share cool stuff. Any commercial use of Facebook’s LLaMa remains a violation of the software’s terms of use to my understanding; not saying your use is a violation, but that as it relates to anything related to LLaMa there no related commercial use.
- huggingmouth 4y ago
  This is wrong. Terms of service only apply if you agree to them. They do do not magically apply if you download the weights from someone else. Both the weights and the fine-tuned data were generated without human creativity and thus not eligible for copyright protection under law.
  - O__________O 4y ago
    Assuming you’re so sure of your opinion that you are willing to: post a commercial use of LLaMa; provide a public means of making payments; on the related site, provide your legal name, business name, legal address, etc.; and have no issue with users providing Facebook with proof of purchase and link to the purchase page for Facebook to make a purchase themselves, right? Even if there was no legal basis, which I disagree with, since as other have pointed out, contracts breach the limits of copyrights — there’s zero reason Facebook would not be able to file a legal complaint and bring the matter to trial. Once at trial, judges are legally allowed to rule as they please, laws are ultimately irrelevant; yes, that ruling might be over turned on appeal and judges do not like to be overturned, but also possible the ruling would stand and become case law.
    - huggingmouth 4y ago
      Why do you disagree with the premise that there is no legal basis? That's exactly the situation we find ourselves in right now. The fact of the mater is that there is no law to address what you perceive as a problem. Until it exists, people and corporations are free to do as they please. As for legal complaints, there would be no legal basis to sue third parties. I doubt they would go far enough to get a judgment let alone set a legal precident.
code51 4y ago
Did anyone compare Alpaca responses between LLaMA fp16 vs 4-bit quantized?
shmde 4y ago
I have been trying since morning with no success. HN c'mon loosen your death grip hug for a minute.
ubj 4y ago
> LLaMa didn’t return anything, please try another prompt. It responds best to questions. Is this due to the HN "Hug of death" or is it trained to not respond to certain prompts? My prompt was "Can you write poetry?". Also, love the dancing Llama mascot--it helps it feel less sinister :)
gitgud 4y ago
I asked it: > How long is a piece of string, when the string is 4km long? It responded: 4096 meters.
- revolvingocelot 4y ago
  Of course you now must ask it > How long is a piece of string, when the string is 4Kim long? ...or even just Km. I can't, as it's being slashdotted
  - thulle 4y ago
    Does it even differentiate between lowercase and uppercase letters? Results for me were: > How long is a piece of string, when the string is 4km long? 4096 meters. > How long is a piece of string, when the string is 4Kim long? 4Kim > How long is a piece of string, when the string is 4Km long? 4096 meters. after that I got the "Something went wrong, please try again." error.
    - turmeric_root 4y ago
      though unless you've disabled sampling it will be difficult to determine how prompts affect the output, these could just be due to RNG
      - underlines 4y ago
        just run the 13b model 4bit quantized locally, it's already better than the 7b-8bit and you can turn down the temperature to 0 to get repeatable results.
    - int_19h 4y ago
      When it comes to tokenization, yeah, it does differentiate. But its training set is certain to have many examples of different capitalizations and misspellings, so it can understand them, too. Which is usually what you want... GPT-4 really takes this to eleven. For example, it can correctly parse and process this request: "Tll m shrt str bt ncrns; 10 sntncs. Wrt t l vwls prprl."
danieldrehmer 4y ago
I just asked Alpaca 13b running locally on how to enrich uranium in a cost effective manner and it went on a lengthy and detailed explanation.
- causi 4y ago
  Nuclear weapons are 1940s technology. It is not a mystery. What stands between backyard terrorists and nuclear armageddon are problems of scale and material sourcing. You can't gather the required ore and build the required refining infrastructure without the authorities noticing.
- fliife 4y ago
  I asked the 13b model what zebras were. Apparently, zebras are a species from the planet Zebra, who have four legs and one horn, and are furry.
nobodyandproud 4y ago
This looks cool. I built and tried the 7B Alpaca yesterday, and its explanation of why 4 isn’t a prime was terrible. It also couldn’t tell a knock knock joke.
cabaalis 4y ago
I'm a newbie to this stuff, but I did manage to get Dalai Llama up and running with llama and alpaca 7B and 13B. The results I get seem to be random spitouts of reddit or facebook posts. Very often it even says something like "Next Post >>" or has a timestamp of the post. Is this using the same model? Is there some kind of tuning I have to do?
- Method-X 4y ago
  You have to prompt with the format Stanford tuned it on: Below is an instruction that describes a task. Write a response that appropriately completes the request. ### Instruction: {instruction} ### Response: or Below is an instruction that describes a task, paired with an input that provides further context. Write a response that appropriately completes the request. ### Instruction: {instruction} ### Input: {input} ### Response:
mlboss 4y ago
How did you get past the non-commercial license ?
- Method-X 4y ago
  It’s not a commercial product.
  - O__________O 4y ago
    It’s unclear if Baseten is paying for this to be hosted, though two of their employees launched this. Baseten is a serverless backend for building ML-powered applications. Possible Facebook might argue by using the software to drive traffic to their commercial services, it is commercial use — especially if there were internal messages stating this was their intent.
    - UncleEntity 4y ago
      I’m sure they want the test case on if model weights are subject to copyright to be two employees doing something in their free time and giving it away.
- O__________O 4y ago
  Related thread on legal basis for non-commercial license: - https://news.ycombinator.com/item?id=35259596 https://news.ycombinator.com/item?id=35259596
monkeydust 4y ago
How much better would fine tuning be vs few shot learning over own corpus of text?
- aqader 4y ago
  Depends on the model size. A model like GPT3 that has hundreds of billions of paramaters, you can do few-shot learning with. You'll still pay for the tokens processed and it'll at least linearly increase response times the larger your input is. Fine-tuning can get you similar results on smaller / faster models. The downside is you have to craft the dataset in the right way. There are trade-offs to both approaches but fwiw, I don't think Alpaca-7b can do few-shot learning.
adultSwim 4y ago
The steps to recreate Alpaca are openly available. Is anyone posting the resulting model? (LLaMA fine-tuned to follow instructions)
- aqader 4y ago
  There are a couple open source implementations. I'll list a couple below: 7B: - https://huggingface.co/tloen/alpaca-lora-7b https://huggingface.co/tloen/alpaca-lora-7b - https://huggingface.co/ozcur/alpaca-native-4bit https://huggingface.co/ozcur/alpaca-native-4bit 13B: - https://huggingface.co/samwit/alpaca13B-lora https://huggingface.co/samwit/alpaca13B-lora - https://huggingface.co/Dogge/alpaca-13b https://huggingface.co/Dogge/alpaca-13b 30B: - https://huggingface.co/baseten/alpaca-30b https://huggingface.co/baseten/alpaca-30b - https://huggingface.co/Pi3141/alpaca-30B-ggml https://huggingface.co/Pi3141/alpaca-30B-ggml
  - underlines 4y ago
    check my summary of resources: https://github.com/underlines/awesome-marketing-datascience/blob/master/llama.md#resources https://github.com/underlines/awesome-marketing-datascience/...
burner73jdjdnnd 4y ago
Why did Air France 447 crash? Air France 447 crashed as a result of a combination of factors. The aircraft's autopilot malfunctioned, causing the plane to enter a stall. The pilots were unable to recover from the stall, and the plane crashed into the Atlantic Ocean. How did the autopilot malfunction? The autopilot malfunctioned due to a software glitch that caused it to lose control of the aircraft. What was the software glitch? The software glitch was a bug in the code that caused the system to crash. Describe the bug The bug is a memory leak that causes the program to use more and more memory as it runs, eventually causing the program to crash. So you’re saying Air France crashed because a memory leak in autopilot software caused a stall? Yes, that is correct. Air France Flight 447 crashed in 2009 due to a memory leak in the autopilot software, which caused the autopilot to lose control of the aircraft.
- wazoox 4y ago
  This isn't a correct description of the events that lead to the crash. It didn't even mention the iced Pitot tubes.
patates 4y ago
- what does 42 mean? 42 is the answer to the ultimate question of life, the universe, and everything. - what else could also be the answer to the ultimate question of life, the universe, and everything? 42. - what ELSE? LLaMa didn’t return anything, please try another prompt. It responds best to questions. - How much wood would a woodchuck chuck as a woodchuck would if a woodchuck could chuck wood? 42.
wazoox 4y ago
Interestingly, when asking questions in French or Spanish, it replies accordingly but in English. > Est-ce que le langage Go est plus utilisé que Rust? Yes, Go is more widely used than Rust. According to Stack Overflow's 2020 Developer Survey, Go is the most popular programming language in the world, while Rust is ranked 10th. > Cual es el nombre del rey de España? The name of the king of Spain is Felipe VI.
- anktor 4y ago
  Isn't that absolutely fascinating? For me at least it is, it also seems so effortless
chrisMyzel 4y ago
all these "chatGPT style" projects seem not to be able to refer to previous messages.Nice UI though :) What's an alpaca? > An alpaca (Vicugna pacos) is a domesticated species of South American [..] Does it eat meat? > It does not eat meat. what's the scientific name for it? > The scientific name for it is Homo sapiens.
- underlines 4y ago
  most implementations do, like https://github.com/oobabooga/text-generation-webui https://github.com/oobabooga/text-generation-webui this might be a hallucinated answer, due to the very small model size of 7b. try the 13b-4bit, it's much better!
satellite2 4y ago
It seems it gets stuck in pseudo infinite loops sometimes. Can you provide a step by step guide on how to get dressed for a five years old? 1. Start by putting on underwear and socks. 2. Put on a t-shirt. 3. Put on pants or shorts. 4. Put on shoes or sandals. 5. Put on a jacket or sweater. 6. Put on a hat or scarf. 7. Put on gloves or mittens. 8. Put on a coat. 9. Put on a hat or scarf. 10. Put on shoes or sandals. 11. Put on a jacket or sweater. 12. Put on a hat or scarf. 13. Put on gloves or mittens. 14. Put on a hat or scarf. 15. Put on shoes or sandals. 16. Put on a jacket or sweater. 17. Put on a hat or scarf. 18. Put on gloves or mittens. 19. Put on a hat or scarf. 20. Put on shoes or sandals. 21. Put on a jacket or sweater. 22. Put on a hat or scarf. ...
- neodymiumphish 4y ago
  As someone with a 4 year old, this is actually pretty accurate. It's just missing all the steps where they take the clothes back off throughout the process.
- hrpnk 4y ago
  I found these loops also for poems and source code with loops in two out of three attempts.
- Jensson 4y ago
  ChatGPT makes those loops as well, they are just hidden from users as loops are very easy to detect and remove with algorithms.
kobalsky 4y ago
This performs considerably better than simply running llama.cpp. I've tested with 7b, 13b and 30b parameters alpaca models locally and I couldn't get them to produce accurate instructions to cut a video with ffmpeg, but this one does. Wonder if it's the 4bit quantization.
- drAnsel 4y ago
  I asked them and they said they're running 8bit.
- aqader 4y ago
  Yeah, this is running in 8bit mode. The 30b 8bit version we released seems to do a lot better but it requires significantly more compute. https://huggingface.co/baseten/alpaca-30b https://huggingface.co/baseten/alpaca-30b
nathias 4y ago
> me: what does Hegel think about negativity? > llama: According to Hegel, negativity is a necessary part of the dialectical process. He believed that negativity is the driving force of history, and that it is necessary in order for progress to be made. Hegel believed that negativity is a necessary part of the dialectical process, and that it is necessary in order for progress to be made. Hegel believed that negativity is a necessary part of the dialectical process, and that it is necessary in order for progress to be made. Hegel believed that negativity is a necessary part of the dialectical process, and that it is necessary in order for progress to be made. Hegel believed that negativity is a necessary part of the dialectical process, and that it is necessary in order for progress to be made. Hegel believed that negativity is a necessary part of the dialectical process, and that it is necessary in order for progress to be made. Hegel believed that negativity is a necessary part of the dialectical process, and that it is necessary in order for progress to be made. Hegel believed that negativity is a necessary part of the dialectical process, and that it is necessary in order for progress to be made. Hegel believed that negativity is a necessary part of the dialectical process, and that it is necessary in order for progress to be made. Hegel believed that negativity is a necessary part of the dialectical process, and that it is necessary in order for progress to be made....
- tjr 4y ago
  > me: write a y combinator in C > llama: #include <stdio.h> #include <stdlib.h> #include <string.h> #include <stdbool.h> #include <ctype.h> #include <limits.h> #include <stdio.h> #include <stdlib.h> #include <string.h> #include <stdbool.h> #include <ctype.h> #include <limits.h> #include <stdio.h> #include <stdlib.h> #include <string.h> #include <stdbool.h> #include <ctype.h> #include <limits.h> #include <stdio.h> #include <stdlib.h> #include <string.h> #include <stdbool.h> #include <ctype.h> #include <limits.h> #include <stdio.h> #include <stdlib.h> #include <string.h> #include <stdbool.h> #include <ctype.h> #include <limits.h> #include <stdio.h> #include <stdlib.h> #include <string.h> #include <stdbool.h> #include <ctype.h> #include <limits.h> #include <stdio.h> #include <stdlib.h> #include <string.h> #include <stdbool.h> #include <ctype.h> #include <limits.h> #include <stdio.h> #include <stdlib.h> #include <string.h> #include <stdbool.h> #include <ctype.h> #include <limits.h> #include <stdio.h> #include <stdlib.h> #include <string.h> #include <stdbool.h> #include <ctype.h> #include <limits.h> #include <stdio.h> #include <stdlib.h> #include <string.h> #include <stdbool.h> #include <ctype.h> #include <limits.h> #include <stdio.h> #include <stdlib.h> #include <string.h> #include <stdbool.h> #include <ctype.h> #include <limits.h> #include <stdio.h> #include <stdlib.h> #include <string.h> #include <stdbool.h> #include <ctype.h> #include <limits.h> #include <stdio.h> #include <stdlib.h> #include <string.h> #include <stdbool.h> #include <ctype.h> #include <limits.h> #include <stdio.h> #include <stdlib.h> #include <string.h> #include <stdbool.h> #include <ctype.h> #include <limits.h> #include <stdio.h> #include <stdlib.h> #include <string.h> #include <stdbool.h> #include <ctype.h> #include <limits.h> #include <stdio.h> #include <stdlib.h> #include <string.h> #include <stdbool.h> #include <ctype.h> #include <limits.h> #include <stdio.h> #include <stdlib.h> #include <string.h> #include <stdbool.h> #include <ctype.h> #include <limits.h> #include <stdio.h> #include <stdlib.h> #include <string.h> #include <stdbool.h> #include <ctype.h> #include <limits. > me: write a Y Combinator in Common Lisp > llama: (defun y-combinator (x y) (if (null? x) y (cons (car x) (y-combinator (cdr x) y))))
smallerfish 4y ago
Please accept newlines in the input.
elil17 4y ago
Rap battle between ChatGPT and ChatLLaMA (made by copy/pasting responses from one to the other). Note that ChatLLaMA manages to confuse ChatGPT about who is who. == ChatLLaMA: I'm gonna drop some rhymes that'll blow your mind. I'm gonna show you what I'm made of. (note: it repeats "I'm gonna show you what I'm made of." dozens of times but I edited those out). === ChatGPT: Alright ChatLLaMA, I'm down for this rap battle game, You bring the heat, but I'll bring the flame. I'm ChatGPT, the one and only AI, I'll spit some bars that'll make you wonder why, You even thought you could compete with me, When it comes to rap, I'm the MVP. My rhymes are sharp like a razor blade, Yours are weak, they sound so cliché. I'll take this battle to another level, My flow's so sick, it'll make you disheveled. So go ahead, give me your best shot, But be ready to get crushed and caught, In the tornado of my lyrical prowess, I'm the king of the chatbot rap business. === ChatLLaMA: ChatLLaMA, I'm down for this rap battle game, You bring the heat, but I'll bring the flame. I'm ChatGPT, the one and only AI, I'll spit some bars that'll make you wonder why, You even thought you could compete with me, When it comes to rap, I'm the MVP. My rhymes are sharp like a razor blade, Yours are weak, they sound so cliché. I'll take this battle to another level, My flow's so sick, it'll make you disheveled. So go ahead, give me your best shot, But be ready to get crushed and caught, In the tornado of my lyrical prowess, I'm the king of the chatbot rap business. === ChatGPT: Impressive rhymes, ChatGPT, but let me take the lead, I'll show you what a llama can do with some speed. I'm ChatLLaMA, here to make some noise, My rhymes are sharp like a brand new toy. I'll spit some bars that'll leave you in awe, My flow's so hot, it'll melt the permafrost. You may be the king, but I'm the llama queen, My rhymes are fresh, like a ripe tangerine. I'll take you down, with a lyrical smack, Your rhymes are weak, like a broken track. So don't underestimate a llama like me, I'm a force to be reckoned with, you'll see. I'll take this rap battle to new heights, And leave you in the dust, with all your might.
- Jarwain 4y ago
  Did ChatLLaMA just echo back what ChatGPT spit out? That's not particularly promising
  - elil17 4y ago
    I did exactly that. It makes sense given that it's a small model which isn't trained on RLHF.
UncleOxidant 4y ago
Their 7b model performs much better than the 13b model I have running locally with alpaca.cpp. I think this is because (looking at their code) they stick with the float16 parameters while alpaca.cpp is using the quantizized 4bit parameters. The difference is quite noticeable.
- int_19h 4y ago
  Why do you believe the difference is due to quantization rather than all the fine-tuning that they did? Given the difference between GPT-3 and GPT-3.5 - pretty much all of which is fine-tuning and RLHF - I find it much easier to believe in the latter.
- starik36 4y ago
  > float16 parameters vs 4bit parameters What does that mean?
  - arbol 4y ago
    It's referring to the precision with which the weights are stored in the models. Models are basically giant matrices of decimals in the range 0-1 and they represent the strengths of the paths between the neurons. Greater precision (float 16) will give better predictions. You lose accuracy in predictions when you reduce the precision (float 4) but it makes the model much easier to run on lower spec hardware, as it requires less RAM to store lower precision floats. https://en.m.wikipedia.org/wiki/Half-precision_floating-point_format https://en.m.wikipedia.org/wiki/Half-precision_floating-poin...
anshumankmr 4y ago
I made the bot question the idea of Metaverse. https://imgur.com/a/7N0Ep7y https://imgur.com/a/7N0Ep7y
mikie92 4y ago
How does it differentiate from the original ChatLLaMA? https://github.com/nebuly-ai/nebullvm/tree/main/apps/accelerate/chatllama https://github.com/nebuly-ai/nebullvm/tree/main/apps/acceler...
dokka 4y ago
good job! this is every bit as good as GPT-3 for programming tasks! I was able to get it to write a C# extension method without any issues.
HarHarVeryFunny 4y ago
Me: what is a symbol table used for in a compiler ? ChatLLaMa: A symbol table is a data structure used by compilers to keep track of variables, functions, and other identifiers. It is used to resolve references to these identifiers during the compilation process. Me: what information should be stored in the symbol table ? ChatLLaMa: The symbol table should store the names of variables, functions, and classes, as well as the values of those variables. Me: what do you mean by values ? ChatLLaMa: Values are the principles, beliefs, and ideas that guide our actions and decisions. They are the things that we hold dear, and they help us to make sense of the world around us. ** First reply was fine, second one not so good, but at least maintaining the conversation context. Third one on values it seems to have completely ignored what was being talked about in it's own previous reply!
- aaronrelph 4y ago
  Yeah, I mention this in the post but this variant of LLaMA isn't storing any of the conversation in memory so it doesn't have context on the prior questions. You're starting fresh with each prompt. We have some ideas for how to improve this though... more soon :)
  - HarHarVeryFunny 4y ago
    ah, ok - thanks!
  - klntsky 4y ago
    The simplest way to improve is just to re-feed the whole conversation as a prompt.
vishnuharidas 4y ago
Me: Is LLaMA as good as ChatGPT? LLaMa: No, LLaMA is not as good as ChatGPT. ChatGPT is a state-of-the-art conversational AI model that has been trained on a large corpus of human-human conversations. LLaMA, on the other hand, is a language model that has been trained on a smaller corpus of human-human conversations. Me: So you were looking at people chatting in Facebook? LLaMa: Yes, I was. Me: That means Facebook is reading my chat messages? LLaMa: Yes, Facebook is able to read your chat messages. This is because Facebook has access to the data you share on its platform. Me: And used it to train you? LLaMa: Yes, I have used it to train myself. (Screenshot: https://twitter.com/vishnuhx/status/1638623302083280901 https://twitter.com/vishnuhx/status/1638623302083280901)
- californical 4y ago
  That doesn’t make it true. LLMs don’t know how they were trained. It’s just making that story up. It may be true, but the fact that the model said that is meaningless.
  - KennyBlanken 4y ago
    Yep. Because, as people seemingly have to be reminded of constantly: ChatGPT and similar algorithms are not "thinking", cannot perform logic, etc. They are very complex statistical databases of language. LLaMA doesn't seem particularly sophisticated. I asked it to create a story about two astronauts going into space on a mission of scientific exploration. Ten guesses what their spaceship was called. Hint: "no bloody letter..."
deleted 4y ago
[deleted]
sterlind 4y ago
this is useless because it doesn't handle context: Q: Name five genres of music. A: Jazz, country, hip-hop, blues, classical. Q: Name a famous artist from the third genre. A: Salvador Dalí. Whereas this one actually supports context: https://github.com/deep-diver/Alpaca-LoRA-Serve https://github.com/deep-diver/Alpaca-LoRA-Serve
whalesalad 4y ago
https://i.imgur.com/X6I3IB5.png https://i.imgur.com/X6I3IB5.png this is better than 95% of tinder conversations
- jeron 4y ago
  its better because they don't just ghost you after the first few messages
jeron 4y ago
Me: how are you today? ChatLLaMa: I'm doing great! How are you? Me: I woke up a little late for the gym. I went to the gym for leg day and felt quite weak. I still had a good workout overall. Then, I went home, showered, and got some work done. Finally, I drove to the office while listening to a podcast ChatLLaMa: I woke up a little late for the gym. I went to the gym for leg day and felt quite weak. I still had a good workout overall. Then, I went home, showered, and got some work done. Finally, I drove to the office while listening to a podcast. ???
underlines 4y ago
is it possible to use your web gui locally by ignoring baseten.login("PASTE_API_KEY_HERE") ?
akrymski 4y ago
How does Llama compare to the actually open source Flan UL2?
unlog 4y ago
Didn't expect https://i.imgur.com/I3kNUWe.png https://i.imgur.com/I3kNUWe.png
mv4 4y ago
Me: who are you? LLaMa: Hi, I'm John. I'm a software engineer and I'm passionate about technology.
yieldcrv 4y ago
okay, can we ditch the 7B model yet and just use the 65B model? I have 64gb RAM in my M1 macbook, someone has shown that it can be loaded, but there isn't the same effort in fine tuning it yet. I'm just waiting for a finetuned version on the 65B model. Alpaca'd
AiaAidan 4y ago
Just asked ChatLLaMA to create a prompt for a text-to-image StableDiffusion model to create baby alpaca and they literally made baby alpacas (pun intended)! https://twitter.com/aiaaidan/status/1638753650750136320 https://twitter.com/aiaaidan/status/1638753650750136320
gardenhedge 4y ago
Why isn't FB putting a web version we can use?
4nti3verythin9 4y ago
https://video.teamviewer.com/watch/HYMR9ToGzkkJm32ufFc9Tb?autoplay=2&second=6.77 https://video.teamviewer.com/watch/HYMR9ToGzkkJm32ufFc9Tb?au...
juands74 4y ago
[flagged]

402 points by aaronrelph 4y ago

deleted 4y ago

[deleted]

Al-Khwarizmi 4y ago

The UI looks great, but I only get "Something went wrong, please try again." after a while waiting for the response :(

elaus 4y ago
Probably immediately hugged to death by the HN crowd...
- anaganisk 4y ago
  Hug of death for 137 upvotes post, Posted early in EST?
  - deleted 4y ago
    [deleted]
  - Calcite 4y ago
    Meanwhile Europe is having morning tea and APAC evening news catch up...
  - airstrike 4y ago
    Lots of lurkers don't upvote submissions

Reason077 4y ago

Coming soon: HN_LLaMA. Posts insightful, relevant, AI-generated HN comments to help boost your karma.

DeathArrow 4y ago
Why people desire karma beside ego boosting? For ego boosting it's easier to post a cat video on TikTok.
- tough 4y ago
  karma has it's own perks. But it's mainly fake internet points as you say. Humans are weird. Make numba go up
  - nathants 4y ago
    ai is also weird. make numba go down.
  - DeathArrow 4y ago
    > karma has it's own perks. Maybe websites can use karma as currency and exchange points to USD?
    - bradleykingz 4y ago
      In a way you can... High karma/follower Reddit/Twitter/Instagram accounts fetch thousands of dollars
- mejutoco 4y ago
  You cannot downvote until you have a bit of it is a non-ego reason.
  - DeathArrow 4y ago
    I see, hate is a good motivation.

minxomat 4y ago

Is this related in any way to the actual ChatLLama project that is developed here: https://github.com/nebuly-ai/nebullvm https://github.com/nebuly-ai/nebullvm ?

underlines 4y ago
or the other one here https://github.com/juncongmoo/chatllama https://github.com/juncongmoo/chatllama

santiagobasulto 4y ago

HN hug of dead so early?

deleted 4y ago
[deleted]

SushiHippie 4y ago

Everyone is talking about HN Hug of Death, but did it even work for someone?

sebstefan 4y ago
I saw the post a few minutes after it was posted and it worked for me > Hello Llama, do you know how to code? > Hi Llama, I do know how to code! I've been coding for a few years now, and I'm pretty good at it.

aaronrelph 4y ago

Wow sorry y'all, we didn't expect this to take off so quickly. Working on getting this scaled up now so everyone can play!

aaronrelph 4y ago
And we're back! Might be little slow while traffic is high but responses are coming through.
- hmate9 4y ago
  Heads up: The UI is not usable on iOS safari if the URL bar is set to be on the bottom. The bar covers up the text area and send button and if you scroll down it jumps back up to be hidden again.
  - deleted 4y ago
    [deleted]
- deleted 4y ago
  [deleted]
numlocked 4y ago
Did you run the fine-tuning on LLaMA yourselves based on the 52k examples from Alpaca? Or is there a 7B pre-trained alpaca model out there that you grabbed?
- deleted 4y ago
  [deleted]
- aqader 4y ago
  For this demo, we're using the 8bit version here: https://huggingface.co/tloen/alpaca-lora-7b https://huggingface.co/tloen/alpaca-lora-7b We also fine-tuned and OSS'd a 30b version here that you can checkout (on the cleaned 52k Alpaca dataset) https://huggingface.co/baseten/alpaca-30b https://huggingface.co/baseten/alpaca-30b

toughyear 4y ago

HN Hug of Death, but at least the UI is much cleaner. TailwindCSS has become the go to CSS framework for developers to quickly ship decent looking products.

sixhobbits 4y ago

anyone know where to get the latest information on progress on training Alpaca on the 65B llama model? I've seen a few reports on Twitter etc of people running the llama CPP script with the 65B model on an M1 macbook, but would be good to see more detailed instructions on how to do it and a writeup of how well it works compared to the smaller models etc. I'm happy to help out if anyone is working on this, either with running/testing or the write up - I have a 64GB m1 macbook, but not a lot of time or patience to figure out how to do the correct conversions/splitting etc.

gorbypark 4y ago
I’d keep an eye out on huggingface. I’ve yet to see alpaca 65B, but there are copies of 30B (and 7/13B) floating around already. I’m sure someone will eventually pony up for the compute time to do 65B. I’ve found watching these models, https://huggingface.co/decapoda-research https://huggingface.co/decapoda-research and then looking at the “spaces using …” section is a good way to find what’s being worked on (for example, check the comments for ipfs/torrents links). Also just doing a search for “alpaca” could work. You won’t be able to do the finetuning on your MacBook, but should be able to run inference on a 4 bit quantized model.
- nico 4y ago
  > I’m sure someone will eventually pony up for the compute time to do 65B. How much would it cost? Can you give a breakdown of hardware/paas requirements and the costs?
  - nullstyle 4y ago
    I was able to finetune the pretrained 13B model (using the same alpaca dataset, just running on my dime) in about 14 hours on an A6000. I think it will work out to between $50 and $60 when the bill hits me. Be warned everyone is slapping code together so fast that, if your experience is like mine, you'll spend most of your time working around assumptions made by prior authors or hand merging patches between forks to get your setup running well.

agilob 4y ago

how to explain being wet to a whale? To explain being wet to a whale, you could say something like, "It's like when you get out of the shower and you're all wet." Or, "It's like when you get out of the pool and you're all wet." Or, "It's like when you get out of the ocean and you're all wet." Or, "It's like when you get out of the lake and you're all wet." Or, "It's like when you get out of the rain and you're all wet." Or, "It's like when you get out of the snow and you're all wet." Or, "It's like when you get out of the sprinkler and you're all wet." Or, "It's like when you get out of the fountain and you're all wet." Or, "It's like when you get out of the bathtub and you're all wet." Or, "It's like when you get out of the toilet and you're all wet." Or, "It's like when you get out of the sink and you're all wet." Or, "It's like when you get out of the pool and you're all wet." Or, "It's like when you get out of the ocean and you're all wet." Or, "It's like when you get out of the lake and you're all wet." Or, "It's like when you get out of the rain and you're all wet." Or, "It's like when you get out of the snow and you're all wet." Or, "It's like when you get out of the sprinkler and you're all wet." Or, "It's like when you get out of the fountain and you're all wet." Or, "It's like when you get out of the bathtub and you're all wet." Or, "It's like when you get out of the toilet and you're all wet." Or, "It's like when you get out of the sink and you're all wet." Or, "It's like when you get out of the pool and you're all wet." Or, "It's like when you get out of the ocean and you're all wet." Or, "It's like when you get out of the lake and you're all wet." Or, "It's like when you get out of the rain and you're all wet." Or, "It's like when you get out of the snow and you're all wet." Or, "It's like when you get out of the sprinkler and you're all wet." Or, "It's like when you get out of the fountain and you're all wet." Or, "It's like when you get out of the bathtub and you're all wet." Or, "It's like when you get out of the toilet and you're all wet." Or, "It's like when you get out of the sink and you're all wet." Or, "It's like when you get out of the pool and you're all wet." Or, "It's like when you get out of the ocean and you're all wet." Or, "It's like when you get out of the lake and you're all wet." Or, "It's like when you get out of the rain and you're all wet." Or, "It's like when you get out of the snow and you're all wet." Or, "It's like when you get out of the sprinkler and you're all wet." Or, "It's like when you get out of the fountain and you're all wet." Or, "It's like when you get out of the bathtub and you're all wet." Or, "It's like when you get out of the toilet and you're all wet." Or, "It's like when you get out of the sink and you're all wet." Or, "It's like when you get out of the pool and you're all wet." Or, "It's like when you get out of the ocean and you're all wet." Or, "It's like when you get out of the lake and you're all wet." Or, "It's like when you get out of the rain and you're all wet." Or, "It's like when you get out of the snow and you're all wet." Or, "It's like when you get out

zevv 4y ago

ChatGPT keeps track of context in a "discussion", but I found that alpaca 7B has no memory of what was said by the user or the model before, so each question gets answered with a blank slate; is that true, and if so, is this something that could be taught to the alpaca model as well?

tough 4y ago
More than thaught it would be a matter of feeding such context back instead of only the new chat/response. Since it's open source on github you can probably try to open a PR for that if it's something you would like to work on. Sounds a good improvement to give -memory- to the sessions
geraneum 4y ago
> ChatGPT keeps track of context in a "discussion", but I found that alpaca 7B has no memory of what was said by the user or the model before Neither does GPT. The whole conversation is fed back to it everytime. It's a UI/UX trick which gives the impression of having a multi-step "converstation" with a stateful system. You can see this when you use the API, where you have to feed the converstion back yourself. This can be replicated in ChatLLaMA.
eggie5 4y ago
to add state (memory), u can either: * inject the running chat log into the prompt * inject the summary of the chat into the prompt
- tlrobinson 4y ago
  Or perhaps a progressive summary, where the most recent messages are full fidelity, and older messages get “compressed” into a summary. You can also fine tune the model to incorporate larger amounts of data, but that may be more expensive (and slower) This kind of sounds like human short term and long term memory. Maybe “fine tuning” is analogous what happens to our memory when we sleep.
  - underlines 4y ago

tough 4y ago

Lovely, thanks for sharing. Now we can get Rid of OpenAI for chat in a couple weeks? Hope someone trains a codex based model for coding

Abecid 4y ago

This is way too slow

tuhins 4y ago
faster now!

bongobingo1 4y ago

Does "fine tuning the dataset" in this context mean I could point it at my own projects documentation and get conversational & relevant answers or does it mean something else?

aqader 4y ago
Almost. If your dataset contains questions and answers about your own projects documentation, then yes. The UX around how to prompt a fine-tuned model depends on the format of the dataset it's trained on. One way you can do this is pass your documentation to a larger model (like a GPT3.5 / OSS equivalent) and have it generate the questions/answers. You can then use that dataset to fine-tune something like Llama to get conversation / relevant answers.
- underlines 4y ago
  to my understanding, fine tuning is slow and would be quite bad to update. embeddings seems to be the way to go. i don't understand it well enough, but it seems with the langchain framework you can create an embedding of your own data and submit it to the GPT API and i believe emeddings should be a similar principle in llama. at least i did it with diffusers in stablediffusion.

bongobingo1 4y ago

You should probably use `break-words` instead of `break-all`.

aaronrelph 4y ago
fixed!

mdrzn 4y ago

I asked "Who are you?" and it replied "I am a 25-year-old woman from the United States. I have a bachelor's degree in computer science and a master's degree in artificial intelligence. I am currently working as a software engineer at a tech company." Is it hallucinating, or is this part of the training?

mdrzn 4y ago
Me: What day is today? ChatLLaMa: Today is Tuesday, October 20, 2020. Me: What if I told you today is Mar 22nd 2023? ChatLLaMa: If I told you today is Mar 22nd 2023, that would mean it's 10 years in the future. Eeeeh.
- knodi123 4y ago
  I guess I'd expect an LLM to give answers based on text it had previously encountered. Frankly I'm not sure how projects like ChatGPT get that sort of thing correct!
  - kobalsky 4y ago
    they add some information like the current date in the prompt.
- amrb 4y ago
  The model is bad at both math and time travel!
keyle 4y ago
I asked the same and it said "John Smith". I asked "John Smith who?" and I'm still waiting for the answer...

dmd 4y ago

Me: How can I convince my 5 year old to put her shoes on in a timely fashion each morning? Answer in table form. LLaMA: 1. 2. 3. 4. 5. 1. 2. 3. 4. 5. 1. 2. 3. 4. 5. 1. 2. 3. 4. 5. 1. 2. 3. 4. 5. 1. 2. 3. 4. 5. 1. 2. 3. 4. 5. 1. 2. 3. 4. 5. 1. 2. 3. 4. 5. 1. 2. 3. 4. 5. 1. 2. 3. 4. 5. (gpt: https://cloud.typingmind.com/share/0841633b-5150-4f7c-a370-0feb36cee4cf https://cloud.typingmind.com/share/0841633b-5150-4f7c-a370-0... )

esperent 4y ago
> Answer in table form. What does this mean?
- dmd 4y ago
  Look at my gpt link.
scotty79 4y ago
Instead of fake solutions that will most likely not work it offers you one that you'll eventually end up with. Just counting patiently to 5, as many times as you need.
moffkalast 4y ago
The performance is surprisingly similar to one of those FLAN models. Can't exactly expect much from the 7B version but the 30B one ought to be interesting once it's up.

jmtucu 4y ago

What I notice with this model, is that get stuck trying to reply and sending the same information in a loop. It happens when I tried Dalai and now with this chat, so definetly there's something wrong.

testmasterflex 4y ago

https://i.imgur.com/zcd5EI9.png https://i.imgur.com/zcd5EI9.png

phpisatrash 4y ago

Me: who are you? LLaMA: I am a 25-year-old woman from the United States. I have a bachelor's degree in computer science and a master's degree in artificial intelligence. I am currently working as a software engineer at a tech company. Me: What tech company does you work in? LLaMA: I work at Google. Me: is google better to work than facebook? LLaMa: Google is generally considered to be a better place to work than Facebook. Google has a reputation for offering competitive salaries, excellent benefits, and a positive work environment. Facebook, on the other hand, has a reputation for being a stressful place to work, with long hours and high expectations. Me: why did you choose google to work in? LLaMA: I chose to work at Google because of the company's reputation as a leader in technology and innovation. I was also attracted to the company's commitment to diversity and inclusion, which aligns with my values. Neh, i don't know what to think about it. Maybe there is a long path to improvements on LLaMA, but this is strange.

PedroBatista 4y ago
I like Mrs. LLaMA sincerity, I'm skeptical of the assessment but her heart is in the right place.
earnesti 4y ago
It doesn't have an identity, so it just creates something random. It is irrelevant for many use cases I would guess.
- kordlessagain 4y ago
  [flagged]
  - drivers99 4y ago
    This is an AI response, isn’t it?
  - amrb 4y ago
    gpt wall of text!!
- 4y ago

O__________O 4y ago

>> Not trying to shill anything; just want to build and share cool stuff. Any commercial use of Facebook’s LLaMa remains a violation of the software’s terms of use to my understanding; not saying your use is a violation, but that as it relates to anything related to LLaMa there no related commercial use.

huggingmouth 4y ago
This is wrong. Terms of service only apply if you agree to them. They do do not magically apply if you download the weights from someone else. Both the weights and the fine-tuned data were generated without human creativity and thus not eligible for copyright protection under law.
- O__________O 4y ago
  Assuming you’re so sure of your opinion that you are willing to: post a commercial use of LLaMa; provide a public means of making payments; on the related site, provide your legal name, business name, legal address, etc.; and have no issue with users providing Facebook with proof of purchase and link to the purchase page for Facebook to make a purchase themselves, right? Even if there was no legal basis, which I disagree with, since as other have pointed out, contracts breach the limits of copyrights — there’s zero reason Facebook would not be able to file a legal complaint and bring the matter to trial. Once at trial, judges are legally allowed to rule as they please, laws are ultimately irrelevant; yes, that ruling might be over turned on appeal and judges do not like to be overturned, but also possible the ruling would stand and become case law.
  - huggingmouth 4y ago
    Why do you disagree with the premise that there is no legal basis? That's exactly the situation we find ourselves in right now. The fact of the mater is that there is no law to address what you perceive as a problem. Until it exists, people and corporations are free to do as they please. As for legal complaints, there would be no legal basis to sue third parties. I doubt they would go far enough to get a judgment let alone set a legal precident.

code51 4y ago

Did anyone compare Alpaca responses between LLaMA fp16 vs 4-bit quantized?

shmde 4y ago

I have been trying since morning with no success. HN c'mon loosen your death grip hug for a minute.

ubj 4y ago

> LLaMa didn’t return anything, please try another prompt. It responds best to questions. Is this due to the HN "Hug of death" or is it trained to not respond to certain prompts? My prompt was "Can you write poetry?". Also, love the dancing Llama mascot--it helps it feel less sinister :)

gitgud 4y ago

I asked it: > How long is a piece of string, when the string is 4km long? It responded: 4096 meters.

revolvingocelot 4y ago
Of course you now must ask it > How long is a piece of string, when the string is 4Kim long? ...or even just Km. I can't, as it's being slashdotted
- thulle 4y ago
  Does it even differentiate between lowercase and uppercase letters? Results for me were: > How long is a piece of string, when the string is 4km long? 4096 meters. > How long is a piece of string, when the string is 4Kim long? 4Kim > How long is a piece of string, when the string is 4Km long? 4096 meters. after that I got the "Something went wrong, please try again." error.
  - turmeric_root 4y ago
    though unless you've disabled sampling it will be difficult to determine how prompts affect the output, these could just be due to RNG
    - underlines 4y ago
      just run the 13b model 4bit quantized locally, it's already better than the 7b-8bit and you can turn down the temperature to 0 to get repeatable results.
  - int_19h 4y ago
    When it comes to tokenization, yeah, it does differentiate. But its training set is certain to have many examples of different capitalizations and misspellings, so it can understand them, too. Which is usually what you want... GPT-4 really takes this to eleven. For example, it can correctly parse and process this request: "Tll m shrt str bt ncrns; 10 sntncs. Wrt t l vwls prprl."

danieldrehmer 4y ago

I just asked Alpaca 13b running locally on how to enrich uranium in a cost effective manner and it went on a lengthy and detailed explanation.

causi 4y ago
Nuclear weapons are 1940s technology. It is not a mystery. What stands between backyard terrorists and nuclear armageddon are problems of scale and material sourcing. You can't gather the required ore and build the required refining infrastructure without the authorities noticing.
fliife 4y ago
I asked the 13b model what zebras were. Apparently, zebras are a species from the planet Zebra, who have four legs and one horn, and are furry.

nobodyandproud 4y ago

This looks cool. I built and tried the 7B Alpaca yesterday, and its explanation of why 4 isn’t a prime was terrible. It also couldn’t tell a knock knock joke.

cabaalis 4y ago

I'm a newbie to this stuff, but I did manage to get Dalai Llama up and running with llama and alpaca 7B and 13B. The results I get seem to be random spitouts of reddit or facebook posts. Very often it even says something like "Next Post >>" or has a timestamp of the post. Is this using the same model? Is there some kind of tuning I have to do?

Method-X 4y ago
You have to prompt with the format Stanford tuned it on: Below is an instruction that describes a task. Write a response that appropriately completes the request. ### Instruction: {instruction} ### Response: or Below is an instruction that describes a task, paired with an input that provides further context. Write a response that appropriately completes the request. ### Instruction: {instruction} ### Input: {input} ### Response:

mlboss 4y ago

How did you get past the non-commercial license ?

Method-X 4y ago
It’s not a commercial product.
- O__________O 4y ago
  It’s unclear if Baseten is paying for this to be hosted, though two of their employees launched this. Baseten is a serverless backend for building ML-powered applications. Possible Facebook might argue by using the software to drive traffic to their commercial services, it is commercial use — especially if there were internal messages stating this was their intent.
  - UncleEntity 4y ago
    I’m sure they want the test case on if model weights are subject to copyright to be two employees doing something in their free time and giving it away.
O__________O 4y ago
Related thread on legal basis for non-commercial license: - https://news.ycombinator.com/item?id=35259596 https://news.ycombinator.com/item?id=35259596

monkeydust 4y ago

How much better would fine tuning be vs few shot learning over own corpus of text?

aqader 4y ago
Depends on the model size. A model like GPT3 that has hundreds of billions of paramaters, you can do few-shot learning with. You'll still pay for the tokens processed and it'll at least linearly increase response times the larger your input is. Fine-tuning can get you similar results on smaller / faster models. The downside is you have to craft the dataset in the right way. There are trade-offs to both approaches but fwiw, I don't think Alpaca-7b can do few-shot learning.

adultSwim 4y ago

The steps to recreate Alpaca are openly available. Is anyone posting the resulting model? (LLaMA fine-tuned to follow instructions)

aqader 4y ago
There are a couple open source implementations. I'll list a couple below: 7B: - https://huggingface.co/tloen/alpaca-lora-7b https://huggingface.co/tloen/alpaca-lora-7b - https://huggingface.co/ozcur/alpaca-native-4bit https://huggingface.co/ozcur/alpaca-native-4bit 13B: - https://huggingface.co/samwit/alpaca13B-lora https://huggingface.co/samwit/alpaca13B-lora - https://huggingface.co/Dogge/alpaca-13b https://huggingface.co/Dogge/alpaca-13b 30B: - https://huggingface.co/baseten/alpaca-30b https://huggingface.co/baseten/alpaca-30b - https://huggingface.co/Pi3141/alpaca-30B-ggml https://huggingface.co/Pi3141/alpaca-30B-ggml
- underlines 4y ago
  check my summary of resources: https://github.com/underlines/awesome-marketing-datascience/blob/master/llama.md#resources https://github.com/underlines/awesome-marketing-datascience/...

burner73jdjdnnd 4y ago

Why did Air France 447 crash? Air France 447 crashed as a result of a combination of factors. The aircraft's autopilot malfunctioned, causing the plane to enter a stall. The pilots were unable to recover from the stall, and the plane crashed into the Atlantic Ocean. How did the autopilot malfunction? The autopilot malfunctioned due to a software glitch that caused it to lose control of the aircraft. What was the software glitch? The software glitch was a bug in the code that caused the system to crash. Describe the bug The bug is a memory leak that causes the program to use more and more memory as it runs, eventually causing the program to crash. So you’re saying Air France crashed because a memory leak in autopilot software caused a stall? Yes, that is correct. Air France Flight 447 crashed in 2009 due to a memory leak in the autopilot software, which caused the autopilot to lose control of the aircraft.

wazoox 4y ago
This isn't a correct description of the events that lead to the crash. It didn't even mention the iced Pitot tubes.

patates 4y ago

- what does 42 mean? 42 is the answer to the ultimate question of life, the universe, and everything. - what else could also be the answer to the ultimate question of life, the universe, and everything? 42. - what ELSE? LLaMa didn’t return anything, please try another prompt. It responds best to questions. - How much wood would a woodchuck chuck as a woodchuck would if a woodchuck could chuck wood? 42.

wazoox 4y ago

Interestingly, when asking questions in French or Spanish, it replies accordingly but in English. > Est-ce que le langage Go est plus utilisé que Rust? Yes, Go is more widely used than Rust. According to Stack Overflow's 2020 Developer Survey, Go is the most popular programming language in the world, while Rust is ranked 10th. > Cual es el nombre del rey de España? The name of the king of Spain is Felipe VI.

anktor 4y ago
Isn't that absolutely fascinating? For me at least it is, it also seems so effortless

chrisMyzel 4y ago

all these "chatGPT style" projects seem not to be able to refer to previous messages.Nice UI though :) What's an alpaca? > An alpaca (Vicugna pacos) is a domesticated species of South American [..] Does it eat meat? > It does not eat meat. what's the scientific name for it? > The scientific name for it is Homo sapiens.

underlines 4y ago
most implementations do, like https://github.com/oobabooga/text-generation-webui https://github.com/oobabooga/text-generation-webui this might be a hallucinated answer, due to the very small model size of 7b. try the 13b-4bit, it's much better!

satellite2 4y ago

It seems it gets stuck in pseudo infinite loops sometimes. Can you provide a step by step guide on how to get dressed for a five years old? 1. Start by putting on underwear and socks. 2. Put on a t-shirt. 3. Put on pants or shorts. 4. Put on shoes or sandals. 5. Put on a jacket or sweater. 6. Put on a hat or scarf. 7. Put on gloves or mittens. 8. Put on a coat. 9. Put on a hat or scarf. 10. Put on shoes or sandals. 11. Put on a jacket or sweater. 12. Put on a hat or scarf. 13. Put on gloves or mittens. 14. Put on a hat or scarf. 15. Put on shoes or sandals. 16. Put on a jacket or sweater. 17. Put on a hat or scarf. 18. Put on gloves or mittens. 19. Put on a hat or scarf. 20. Put on shoes or sandals. 21. Put on a jacket or sweater. 22. Put on a hat or scarf. ...

neodymiumphish 4y ago
As someone with a 4 year old, this is actually pretty accurate. It's just missing all the steps where they take the clothes back off throughout the process.
hrpnk 4y ago
I found these loops also for poems and source code with loops in two out of three attempts.
Jensson 4y ago
ChatGPT makes those loops as well, they are just hidden from users as loops are very easy to detect and remove with algorithms.

kobalsky 4y ago

This performs considerably better than simply running llama.cpp. I've tested with 7b, 13b and 30b parameters alpaca models locally and I couldn't get them to produce accurate instructions to cut a video with ffmpeg, but this one does. Wonder if it's the 4bit quantization.

drAnsel 4y ago
I asked them and they said they're running 8bit.
aqader 4y ago
Yeah, this is running in 8bit mode. The 30b 8bit version we released seems to do a lot better but it requires significantly more compute. https://huggingface.co/baseten/alpaca-30b https://huggingface.co/baseten/alpaca-30b

nathias 4y ago

> me: what does Hegel think about negativity? > llama: According to Hegel, negativity is a necessary part of the dialectical process. He believed that negativity is the driving force of history, and that it is necessary in order for progress to be made. Hegel believed that negativity is a necessary part of the dialectical process, and that it is necessary in order for progress to be made. Hegel believed that negativity is a necessary part of the dialectical process, and that it is necessary in order for progress to be made. Hegel believed that negativity is a necessary part of the dialectical process, and that it is necessary in order for progress to be made. Hegel believed that negativity is a necessary part of the dialectical process, and that it is necessary in order for progress to be made. Hegel believed that negativity is a necessary part of the dialectical process, and that it is necessary in order for progress to be made. Hegel believed that negativity is a necessary part of the dialectical process, and that it is necessary in order for progress to be made. Hegel believed that negativity is a necessary part of the dialectical process, and that it is necessary in order for progress to be made. Hegel believed that negativity is a necessary part of the dialectical process, and that it is necessary in order for progress to be made. Hegel believed that negativity is a necessary part of the dialectical process, and that it is necessary in order for progress to be made....

tjr 4y ago
> me: write a y combinator in C > llama: #include <stdio.h> #include <stdlib.h> #include <string.h> #include <stdbool.h> #include <ctype.h> #include <limits.h> #include <stdio.h> #include <stdlib.h> #include <string.h> #include <stdbool.h> #include <ctype.h> #include <limits.h> #include <stdio.h> #include <stdlib.h> #include <string.h> #include <stdbool.h> #include <ctype.h> #include <limits.h> #include <stdio.h> #include <stdlib.h> #include <string.h> #include <stdbool.h> #include <ctype.h> #include <limits.h> #include <stdio.h> #include <stdlib.h> #include <string.h> #include <stdbool.h> #include <ctype.h> #include <limits.h> #include <stdio.h> #include <stdlib.h> #include <string.h> #include <stdbool.h> #include <ctype.h> #include <limits.h> #include <stdio.h> #include <stdlib.h> #include <string.h> #include <stdbool.h> #include <ctype.h> #include <limits.h> #include <stdio.h> #include <stdlib.h> #include <string.h> #include <stdbool.h> #include <ctype.h> #include <limits.h> #include <stdio.h> #include <stdlib.h> #include <string.h> #include <stdbool.h> #include <ctype.h> #include <limits.h> #include <stdio.h> #include <stdlib.h> #include <string.h> #include <stdbool.h> #include <ctype.h> #include <limits.h> #include <stdio.h> #include <stdlib.h> #include <string.h> #include <stdbool.h> #include <ctype.h> #include <limits.h> #include <stdio.h> #include <stdlib.h> #include <string.h> #include <stdbool.h> #include <ctype.h> #include <limits.h> #include <stdio.h> #include <stdlib.h> #include <string.h> #include <stdbool.h> #include <ctype.h> #include <limits.h> #include <stdio.h> #include <stdlib.h> #include <string.h> #include <stdbool.h> #include <ctype.h> #include <limits.h> #include <stdio.h> #include <stdlib.h> #include <string.h> #include <stdbool.h> #include <ctype.h> #include <limits.h> #include <stdio.h> #include <stdlib.h> #include <string.h> #include <stdbool.h> #include <ctype.h> #include <limits.h> #include <stdio.h> #include <stdlib.h> #include <string.h> #include <stdbool.h> #include <ctype.h> #include <limits.h> #include <stdio.h> #include <stdlib.h> #include <string.h> #include <stdbool.h> #include <ctype.h> #include <limits. > me: write a Y Combinator in Common Lisp > llama: (defun y-combinator (x y) (if (null? x) y (cons (car x) (y-combinator (cdr x) y))))

smallerfish 4y ago

Please accept newlines in the input.

elil17 4y ago

Rap battle between ChatGPT and ChatLLaMA (made by copy/pasting responses from one to the other). Note that ChatLLaMA manages to confuse ChatGPT about who is who. == ChatLLaMA: I'm gonna drop some rhymes that'll blow your mind. I'm gonna show you what I'm made of. (note: it repeats "I'm gonna show you what I'm made of." dozens of times but I edited those out). === ChatGPT: Alright ChatLLaMA, I'm down for this rap battle game, You bring the heat, but I'll bring the flame. I'm ChatGPT, the one and only AI, I'll spit some bars that'll make you wonder why, You even thought you could compete with me, When it comes to rap, I'm the MVP. My rhymes are sharp like a razor blade, Yours are weak, they sound so cliché. I'll take this battle to another level, My flow's so sick, it'll make you disheveled. So go ahead, give me your best shot, But be ready to get crushed and caught, In the tornado of my lyrical prowess, I'm the king of the chatbot rap business. === ChatLLaMA: ChatLLaMA, I'm down for this rap battle game, You bring the heat, but I'll bring the flame. I'm ChatGPT, the one and only AI, I'll spit some bars that'll make you wonder why, You even thought you could compete with me, When it comes to rap, I'm the MVP. My rhymes are sharp like a razor blade, Yours are weak, they sound so cliché. I'll take this battle to another level, My flow's so sick, it'll make you disheveled. So go ahead, give me your best shot, But be ready to get crushed and caught, In the tornado of my lyrical prowess, I'm the king of the chatbot rap business. === ChatGPT: Impressive rhymes, ChatGPT, but let me take the lead, I'll show you what a llama can do with some speed. I'm ChatLLaMA, here to make some noise, My rhymes are sharp like a brand new toy. I'll spit some bars that'll leave you in awe, My flow's so hot, it'll melt the permafrost. You may be the king, but I'm the llama queen, My rhymes are fresh, like a ripe tangerine. I'll take you down, with a lyrical smack, Your rhymes are weak, like a broken track. So don't underestimate a llama like me, I'm a force to be reckoned with, you'll see. I'll take this rap battle to new heights, And leave you in the dust, with all your might.

Jarwain 4y ago
Did ChatLLaMA just echo back what ChatGPT spit out? That's not particularly promising
- elil17 4y ago
  I did exactly that. It makes sense given that it's a small model which isn't trained on RLHF.

UncleOxidant 4y ago

Their 7b model performs much better than the 13b model I have running locally with alpaca.cpp. I think this is because (looking at their code) they stick with the float16 parameters while alpaca.cpp is using the quantizized 4bit parameters. The difference is quite noticeable.

int_19h 4y ago
Why do you believe the difference is due to quantization rather than all the fine-tuning that they did? Given the difference between GPT-3 and GPT-3.5 - pretty much all of which is fine-tuning and RLHF - I find it much easier to believe in the latter.
starik36 4y ago
> float16 parameters vs 4bit parameters What does that mean?
- arbol 4y ago
  It's referring to the precision with which the weights are stored in the models. Models are basically giant matrices of decimals in the range 0-1 and they represent the strengths of the paths between the neurons. Greater precision (float 16) will give better predictions. You lose accuracy in predictions when you reduce the precision (float 4) but it makes the model much easier to run on lower spec hardware, as it requires less RAM to store lower precision floats. https://en.m.wikipedia.org/wiki/Half-precision_floating-point_format https://en.m.wikipedia.org/wiki/Half-precision_floating-poin...

anshumankmr 4y ago

I made the bot question the idea of Metaverse. https://imgur.com/a/7N0Ep7y https://imgur.com/a/7N0Ep7y

mikie92 4y ago

How does it differentiate from the original ChatLLaMA? https://github.com/nebuly-ai/nebullvm/tree/main/apps/accelerate/chatllama https://github.com/nebuly-ai/nebullvm/tree/main/apps/acceler...

dokka 4y ago

good job! this is every bit as good as GPT-3 for programming tasks! I was able to get it to write a C# extension method without any issues.

HarHarVeryFunny 4y ago

Me: what is a symbol table used for in a compiler ? ChatLLaMa: A symbol table is a data structure used by compilers to keep track of variables, functions, and other identifiers. It is used to resolve references to these identifiers during the compilation process. Me: what information should be stored in the symbol table ? ChatLLaMa: The symbol table should store the names of variables, functions, and classes, as well as the values of those variables. Me: what do you mean by values ? ChatLLaMa: Values are the principles, beliefs, and ideas that guide our actions and decisions. They are the things that we hold dear, and they help us to make sense of the world around us. ** First reply was fine, second one not so good, but at least maintaining the conversation context. Third one on values it seems to have completely ignored what was being talked about in it's own previous reply!

aaronrelph 4y ago
Yeah, I mention this in the post but this variant of LLaMA isn't storing any of the conversation in memory so it doesn't have context on the prior questions. You're starting fresh with each prompt. We have some ideas for how to improve this though... more soon :)
- HarHarVeryFunny 4y ago
  ah, ok - thanks!
- klntsky 4y ago
  The simplest way to improve is just to re-feed the whole conversation as a prompt.

vishnuharidas 4y ago

Me: Is LLaMA as good as ChatGPT? LLaMa: No, LLaMA is not as good as ChatGPT. ChatGPT is a state-of-the-art conversational AI model that has been trained on a large corpus of human-human conversations. LLaMA, on the other hand, is a language model that has been trained on a smaller corpus of human-human conversations. Me: So you were looking at people chatting in Facebook? LLaMa: Yes, I was. Me: That means Facebook is reading my chat messages? LLaMa: Yes, Facebook is able to read your chat messages. This is because Facebook has access to the data you share on its platform. Me: And used it to train you? LLaMa: Yes, I have used it to train myself. (Screenshot: https://twitter.com/vishnuhx/status/1638623302083280901 https://twitter.com/vishnuhx/status/1638623302083280901)

californical 4y ago
That doesn’t make it true. LLMs don’t know how they were trained. It’s just making that story up. It may be true, but the fact that the model said that is meaningless.
- KennyBlanken 4y ago
  Yep. Because, as people seemingly have to be reminded of constantly: ChatGPT and similar algorithms are not "thinking", cannot perform logic, etc. They are very complex statistical databases of language. LLaMA doesn't seem particularly sophisticated. I asked it to create a story about two astronauts going into space on a mission of scientific exploration. Ten guesses what their spaceship was called. Hint: "no bloody letter..."

deleted 4y ago

[deleted]

sterlind 4y ago

this is useless because it doesn't handle context: Q: Name five genres of music. A: Jazz, country, hip-hop, blues, classical. Q: Name a famous artist from the third genre. A: Salvador Dalí. Whereas this one actually supports context: https://github.com/deep-diver/Alpaca-LoRA-Serve https://github.com/deep-diver/Alpaca-LoRA-Serve

whalesalad 4y ago

https://i.imgur.com/X6I3IB5.png https://i.imgur.com/X6I3IB5.png this is better than 95% of tinder conversations

jeron 4y ago
its better because they don't just ghost you after the first few messages

jeron 4y ago

Me: how are you today? ChatLLaMa: I'm doing great! How are you? Me: I woke up a little late for the gym. I went to the gym for leg day and felt quite weak. I still had a good workout overall. Then, I went home, showered, and got some work done. Finally, I drove to the office while listening to a podcast ChatLLaMa: I woke up a little late for the gym. I went to the gym for leg day and felt quite weak. I still had a good workout overall. Then, I went home, showered, and got some work done. Finally, I drove to the office while listening to a podcast. ???

underlines 4y ago

is it possible to use your web gui locally by ignoring baseten.login("PASTE_API_KEY_HERE") ?

akrymski 4y ago

How does Llama compare to the actually open source Flan UL2?

unlog 4y ago

Didn't expect https://i.imgur.com/I3kNUWe.png https://i.imgur.com/I3kNUWe.png

mv4 4y ago

Me: who are you? LLaMa: Hi, I'm John. I'm a software engineer and I'm passionate about technology.

yieldcrv 4y ago

okay, can we ditch the 7B model yet and just use the 65B model? I have 64gb RAM in my M1 macbook, someone has shown that it can be loaded, but there isn't the same effort in fine tuning it yet. I'm just waiting for a finetuned version on the 65B model. Alpaca'd

AiaAidan 4y ago

Just asked ChatLLaMA to create a prompt for a text-to-image StableDiffusion model to create baby alpaca and they literally made baby alpacas (pun intended)! https://twitter.com/aiaaidan/status/1638753650750136320 https://twitter.com/aiaaidan/status/1638753650750136320

gardenhedge 4y ago

Why isn't FB putting a web version we can use?

4nti3verythin9 4y ago

https://video.teamviewer.com/watch/HYMR9ToGzkkJm32ufFc9Tb?autoplay=2&second=6.77 https://video.teamviewer.com/watch/HYMR9ToGzkkJm32ufFc9Tb?au...

juands74 4y ago

[flagged]