All things being equal, I would remove the internal finishes and insulate from the inside, possibly adding a layer of insulated plasterboard across the inside face. But given the outside is accessible (no sheathing) I thought it may cause less disruption and save us moving out. I note what you say Russell, Saveasteading and Redbeard thank you - mineral wool sounds easier to fit. Not looking to achieve current standards, just a marked improvement over what's there.
External insulation was my first thought - we have the roof overhang - but hanging weight off the outside rather than sitting insulation within the frame seemed counter-intuitive. External insulation would also mean a change from timber cladding to render - not necessarily an issue but something for me to consider.
Al.