Is giving back the device the right thing to do in this circumstance? Shouldn't FBI produce proof of ownership of the device? What if sometime after FBI leaves,

Is giving back the device the right thing to do in this circumstance? Shouldn't FBI produce proof of ownership of the device? What if sometime after FBI leaves, CIA shows up and says it was their device and they want it back?