So, I have found out that if the car has already stopped charging (this is a Mk2 btw) i.e. when it is full, pressing the unlock button will release the plug, but it will not stop the charge (at least on a 7kW slow charger, haven't tried a rapid charger yet).