How do you know who is the best doctor?
But let's say that you could ascertain that - that doesn't mean that you can get treatment from that doctor. If that is the best doctor, and everyone knows that is the best doctor, you can be pretty sure that doctor is completely full and not accepting new patients. Or if they are, they will be charging high enough rates that they are not going to be in network on any carrier.
Now let's say that you could similarly ascertain who is the best pilot. How are you going to ensure that pilot will be flying the plane when you make the reservation? What do you do if that pilot flies for United, but United doesn't serve the airports where you need to go.
What you are saying sounds wonderful. In practice it is completely unrealistic.