This issue you're running into is why I think trying to think about free will in that context is a category error. The concept doesn't make sense when it's some

This issue you're running into is why I think trying to think about free will in that context is a category error. The concept doesn't make sense when it's something that depends on randomness or determinism. Instead, I think it's useful to think about how we use it in actual practice, which is generally something like, "is a person more or less self-directed" where self-directed means that their actions are consistent with their observed character and expressed desires. That's not particularly satisfying if you're raised in a culture that puts a lot of value on free will as a concept, but I think it may be the best we can do.