Not necessarily. My policy allows me to drive any car not owned by me, with 3rd party only cover on that car ie, I could drive your car with your permission but cover would be 3rd party only. You could only drive my car if your policy allowed you to do so. Both drivers will need to have that condition on their policy for you to be able to do that.