Thank you everyone who has taken the time to comment - I really appreciate your help and it all played a large part in me being able to say the correct things to him. I've finally got an invoice without the vat added - I sent him a copy of my planning approval.
So amazing to have BuildHub with it's amazing forumites offering great advice to us not-knowers-but-we're-learning. ?