4 ms·

I’ve spent a lot of time testing the new Siri. Overall I like it and believe this will become a very powerful tool but definitely think it needs work. - Exampl

I’ve spent a lot of time testing the new Siri. Overall I like it and believe this will become a very powerful tool but definitely think it needs work. - Example: “Siri for the lights that are already on in the family room, can you put those lights to 50% brightness?” -> All the lights turn on incorrectly. This is a two step process. Get information from Home and then execute command with that info. - Example: “Remind me to call back Joe at 5pm.” -> Siri oddly has trouble with this. Asking me what time after I give this command. Is it not hearing full command? - Example: It seems to ask me to clarify the name of something when that name is readily available in recent personal context. Like recent 5 messages. It should be able to know some of this stuff as I’m most likely operating on recent stuff. It seems to be hampered in some way. Gemini should be able to handle that tool call really easily. Other things are great. Like I have my checking account and routing number buried in Notes somewhere. When I’m in safari and ask it to autofill with the routing number from notes. It does it. Amazing. I’m so bullish on LLMs and my personal context but there are some kinks here that hamper performance so far.

LeapingLennie 20d ago
One of the few things I use Siri for is converting units and still in iOS 27 we have: - "What is three fifty degrees Fahrenheit in Celsius?" -> "53°F = 11.67°C" Also disappointing: - "Add mow the lawn to my chores note." -> "Sorry, I can't help with that."
- ryeguy_24 20d ago
  It’s really pathetic. I would think even the lowest quality LLMs could figure out tool use like this. It has to figure out the tool and most of the time, it’s stated in the command. Like remind me or put this in notes, so why can’t it do this more easily. I’m just having trouble figuring out why. I’m curious if they still have tons of rules in the background in a way that is muddying the pure LLM experience.
- bogeholm 19d ago
  “Then preheat the oven to three fifty, and give that spoon a lick …” No high hopes for how that recipe turns out with Siri in the kitchen then
- matwood 19d ago
  I don't use voice often (I'm also not quite sure what you're asking with 'three fifty', but if I just type '50F' into the new Siri it immediately shows '10C'. Hopefully the voice recognition continues to improve.
  - jurgenburgen 19d ago
    Three fifty = 350? It’s not an unusual way to save effort when speaking.
    - matwood 19d ago
      Ah, doh! I just tested it and it worked. Siri clearly can answer the question, now it seems more like a speech to text issue. I wonder if everything is using the new models or if stt is still using the old ones?
- nogridbag 19d ago
  I've had the latter with Gemini in Android Auto. In fact, my scenario was even worse. Me: "Send a message to <wife>". Gemini: "OK what's the message?" Me: "Can you bring Tylenol I'm having a headache?" Gemini: "I'm sorry, I cannot help with that. If you need medical advice..." <-- or something to that extent. Up to this point, I thought when Gemini would prompt for a message, it would simply accept whatever I said essentially as plain text - and maybe with the new Rambler feature on Pixel phones it may cleanup my message slightly. But now I can see scenarios where Gemini would possibly need to parse my input. And it should have been obvious since I would often say things like "cancel" and I never questioned it.

LeapingLennie 20d ago

One of the few things I use Siri for is converting units and still in iOS 27 we have: - "What is three fifty degrees Fahrenheit in Celsius?" -> "53°F = 11.67°C" Also disappointing: - "Add mow the lawn to my chores note." -> "Sorry, I can't help with that."

ryeguy_24 20d ago
It’s really pathetic. I would think even the lowest quality LLMs could figure out tool use like this. It has to figure out the tool and most of the time, it’s stated in the command. Like remind me or put this in notes, so why can’t it do this more easily. I’m just having trouble figuring out why. I’m curious if they still have tons of rules in the background in a way that is muddying the pure LLM experience.
bogeholm 19d ago
“Then preheat the oven to three fifty, and give that spoon a lick …” No high hopes for how that recipe turns out with Siri in the kitchen then
matwood 19d ago
I don't use voice often (I'm also not quite sure what you're asking with 'three fifty', but if I just type '50F' into the new Siri it immediately shows '10C'. Hopefully the voice recognition continues to improve.
- jurgenburgen 19d ago
  Three fifty = 350? It’s not an unusual way to save effort when speaking.
  - matwood 19d ago
    Ah, doh! I just tested it and it worked. Siri clearly can answer the question, now it seems more like a speech to text issue. I wonder if everything is using the new models or if stt is still using the old ones?
nogridbag 19d ago
I've had the latter with Gemini in Android Auto. In fact, my scenario was even worse. Me: "Send a message to <wife>". Gemini: "OK what's the message?" Me: "Can you bring Tylenol I'm having a headache?" Gemini: "I'm sorry, I cannot help with that. If you need medical advice..." <-- or something to that extent. Up to this point, I thought when Gemini would prompt for a message, it would simply accept whatever I said essentially as plain text - and maybe with the new Rambler feature on Pixel phones it may cleanup my message slightly. But now I can see scenarios where Gemini would possibly need to parse my input. And it should have been obvious since I would often say things like "cancel" and I never questioned it.