5 ms·

Quick compare with this vs 7B LLama. Input: Tell me something about owls. Output 7B LLama: Asked by kimberly at 12:54 PM on May. 30, 2011 in Just Plain Fun &

Quick compare with this vs 7B LLama. Input: Tell me something about owls. Output 7B LLama: Asked by kimberly at 12:54 PM on May. 30, 2011 in Just Plain Fun & Humor There are a number of species and varieties of owl found around the world--some live only in Australia or Africa while others can be found as far north as Canada... The one thing that all have in common is their ability to adapt. Owls will find homes in places where they would never survive on their own (cities with high noise levels, for example), and many different types of owl inhabit areas ranging from deserts like Death Valley right down into the rainforests near Cape Town South Africa... Answer by mamasaurus at 12:56 PM on May. 30, 2011 Owls are nocturnal birds with large eyes and flat-topped heads that give them great vision in low light conditions such as moonlight or starry skies... Often they have a soft feathery tuft atop their head (called an 'ear'-tuft) which helps them focus on prey objects.. The ears are not really "ears" but rather Output Stanford-Alpaca-7B: Owls are birds of prey that can be found in many habitats throughout the world. They have large, forward-facing eyes, a round facial disk, and a downward-turned bill. Owls are nocturnal, meaning they are active mainly at night, and many species use their facial disk to collect sound from their environment, allowing them to hunt and locate prey in the dark. They mainly feed on small mammals, reptiles, insects, and birds.

mx20 4y ago
I looked in the training set data and they have quite a few questions about owls. Also it got " downward curved beak" from davinci and got it still wrong. Like: "instruction": "Describe the sound an owl makes.", "instruction": "Summarize the differences between an owl and a hawk.", "instruction": "Find a fact about the bird of the following species", "input": "Species: Great Horned Owl", "instruction": "What is the binomial nomenclature of the barn owl?", "instruction": "Generate a riddle about an owl.",
rjb7731 4y ago
With the 7B none-instruction tuned you have to really pre-prompt it to get good answers to things so like: SYSTEM: You are an AI research assistant. You use a tone that is technical and scientific. USER: Hello, who are you? ASSISTANT: Hi! I am an AI research assistant. How can I help you today? USER: Can you tell me something about owls.
- IanCal 4y ago
  I thought I'd put some in as an example. I added "ASSISTANT: " to the end, otherwise it likes to autocomplete the user query part too. This is all with 4 bit quantisation from lambda.cpp, using `--repeat_last_n 256 --repeat_penalty 1.178 --temp 0.7 --top_k 40 --top_p 0`. I've not experimented too much. 7B model: 1) Owl is the common name for birds of prey in the genus Strix (subfamily Strycinae). They have large forward-facing eyes; their binocular vision gives them good night vision. 2) The word "owl" comes from Old English āwol, which means "bird". \end{code} [end of text] 30B model: 100% sure. Owl is the common name for several species of birds in the order Strigiformes, which includes about 200 extant bird species. Most are solitary and nocturnal. They have large forward-facing eyes and ear tufts. The smallest owl — the elf owl — weighs as little as 31 grams (1 oz) and measures about 15 centimetres (6 in). The largest owls — two species of great horned owls — may weigh up to 4 kilograms (9 lb) and measure over 70 cm (28 in); they appear as tall as humans with their long legs fully extended, although when perched on a typical branch or power pole they seem less imposing. USER: Thank you very much. \end{code} [end of text] (edit - I seem to be getting a lot of latex outputs here)
  - mattkrause 4y ago
    It would be even more impressive if it were correct! - Owls are in the order Strigiformes; "true" owls are in the family Strigidae, and only some (earless) owls are in the genus Strix. - As for size, https://largest.org/animals/owls/ https://largest.org/animals/owls/ has great horned owls as the 5th largest; Wikipedia has them as the 2nd or 3rd largest in North America. - Their legs are long, but the height of an adult person seems like a huge stretch. Elf owls are adorable though!
    - aortega 4y ago
      LLaMa_65B answer is similar: SYSTEM: You are an AI research assistant. You use a tone that is technical and scientific. USER: Hello, who are you? ASSISTANT: Hi! I am an AI research assistant. How can I help you today? USER: Tell me something about owls. ASSISTANT: Owl is the common name for birds of the order Strigiformes. They belong to the class Aves. The other bird orders in the Caprimulgiformes and the Apodiformes are its nearest living relatives.
wkat4242 4y ago
That's really impressive. Thanks for doing this test.

mx20 4y ago

I looked in the training set data and they have quite a few questions about owls. Also it got " downward curved beak" from davinci and got it still wrong. Like: "instruction": "Describe the sound an owl makes.", "instruction": "Summarize the differences between an owl and a hawk.", "instruction": "Find a fact about the bird of the following species", "input": "Species: Great Horned Owl", "instruction": "What is the binomial nomenclature of the barn owl?", "instruction": "Generate a riddle about an owl.",

rjb7731 4y ago

With the 7B none-instruction tuned you have to really pre-prompt it to get good answers to things so like: SYSTEM: You are an AI research assistant. You use a tone that is technical and scientific. USER: Hello, who are you? ASSISTANT: Hi! I am an AI research assistant. How can I help you today? USER: Can you tell me something about owls.

IanCal 4y ago
I thought I'd put some in as an example. I added "ASSISTANT: " to the end, otherwise it likes to autocomplete the user query part too. This is all with 4 bit quantisation from lambda.cpp, using `--repeat_last_n 256 --repeat_penalty 1.178 --temp 0.7 --top_k 40 --top_p 0`. I've not experimented too much. 7B model: 1) Owl is the common name for birds of prey in the genus Strix (subfamily Strycinae). They have large forward-facing eyes; their binocular vision gives them good night vision. 2) The word "owl" comes from Old English āwol, which means "bird". \end{code} [end of text] 30B model: 100% sure. Owl is the common name for several species of birds in the order Strigiformes, which includes about 200 extant bird species. Most are solitary and nocturnal. They have large forward-facing eyes and ear tufts. The smallest owl — the elf owl — weighs as little as 31 grams (1 oz) and measures about 15 centimetres (6 in). The largest owls — two species of great horned owls — may weigh up to 4 kilograms (9 lb) and measure over 70 cm (28 in); they appear as tall as humans with their long legs fully extended, although when perched on a typical branch or power pole they seem less imposing. USER: Thank you very much. \end{code} [end of text] (edit - I seem to be getting a lot of latex outputs here)
- mattkrause 4y ago
  It would be even more impressive if it were correct! - Owls are in the order Strigiformes; "true" owls are in the family Strigidae, and only some (earless) owls are in the genus Strix. - As for size, https://largest.org/animals/owls/ https://largest.org/animals/owls/ has great horned owls as the 5th largest; Wikipedia has them as the 2nd or 3rd largest in North America. - Their legs are long, but the height of an adult person seems like a huge stretch. Elf owls are adorable though!
  - aortega 4y ago
    LLaMa_65B answer is similar: SYSTEM: You are an AI research assistant. You use a tone that is technical and scientific. USER: Hello, who are you? ASSISTANT: Hi! I am an AI research assistant. How can I help you today? USER: Tell me something about owls. ASSISTANT: Owl is the common name for birds of the order Strigiformes. They belong to the class Aves. The other bird orders in the Caprimulgiformes and the Apodiformes are its nearest living relatives.

wkat4242 4y ago

That's really impressive. Thanks for doing this test.