What if Siri could listen in on my phone calls?

Let's set aside all of what we think we know about Siri for a second and just focus on what it's base function is: voice recognition. Then imagine applying that to a telephone conversation with all of Siri's wonder! I believe this could be even more powerful than just a virtual assistant when you call upon it... Not just to have a transcript of the conversation, but to actually pull out useful information and create a history of the conversation, a summary from Siri's understanding. Perhaps it could tell that you agreed to a meeting (or a date!) and put the event in your diary. Perhaps it could understand the other caller giving you their details such as email address or their physical address and automatically add that to your address book. Sounds kind of creepy, bit if there was ever such potential, I think it would be absolutely killer!