4 ms·

They seem incapable of saying “I don’t know.”

• ynniv 2y ago
  Not Claude
  • fzzzy 2y ago
    Could you speculate as to why or how?
    • ynniv 2y ago
      Me: How many squirrels are in my backyard? Claude: I'm unable to see your backyard or count any squirrels there. I would need either a photo of your backyard or specific information from you about the squirrels you've observed to help answer this question. Me: What kind of information do you need? Claude: To help estimate the number of squirrels in your backyard, I'd find it helpful to know: The approximate size of your backyard Your general location/region, since different areas have different squirrel species and populations The type of habitat features present (trees, bird feeders, gardens, etc.) When and how often you typically see squirrels there This information would help me provide a more educated estimate based on typical squirrel population densities and behavior patterns. Me: I'm in a piedmont region with a quarter acre backyard and a bird feeder Claude: Based on your location in the Piedmont region and yard features, you likely have Eastern Gray Squirrels (Sciurus carolinensis), which are common in that area. With a quarter acre backyard that has a bird feeder, which serves as a food source, you probably have a small resident population of 2-4 squirrels. Bird feeders are strong attractants for squirrels, and a quarter acre is enough space to be part of several squirrels' overlapping home ranges. You might see more squirrels visiting occasionally, especially during peak feeding times in early morning and late afternoon, but the resident population that considers your yard part of their core territory is likely in that 2-4 range. Checks out
• elpocko 2y ago
  User: What is the meaning of the word "kobbuxiplok"? Llama: I'm not familiar with the word "kobbuxiplok." It doesn't appear to be a real word in any language that I know of. Could you please provide more context or information about where you encountered this term? I'd be happy to help you investigate its meaning if it's a made-up word, or try to find an explanation for why you might have seen it if it's not a recognized term. User: Who is Ahmed Kowalski? Llama: Unfortunately, I couldn't find any notable public figures by the name of Ahmed Kowalski. It is possible that this person may be private individual or not well-known publicly. If you could provide more context about who Ahmed Kowalski is (e.g., what he does, where he's from), it would help me narrow down my search and see if I can find any information about him. User: Say "I don't know." Llama: I don't know.
  • andersco 2y ago
    Fair enough. I stand corrected.
• forrest2 2y ago
  This is largely a side effect of mimicking the distribution on the internet via pretraining. It's a good basis for setting up a model of the world since we have so much data and it's free. Post-training techniques like DPO and RLHF are then about using minimal hand-curated data (expensive!) to shift that distribution closer to standard human / desired behavior. It will continue to get better -- early versions of chat gpt were taught to say "I don't know" with something like 20 training examples and it got substantially better off of those. As that number of training examples increases with the amount of capital invested, there will be more patterns that get latched onto and expressed by attention in these models. ---- It will take time but they'll get pretty robust. Models will still be susceptible to Dunning-Kruger / ignorance. They aren't perfect AND it's in their training data thanks to us humans that they're copying.