I had a similar issue .
I think what determines “ works started “ is somewhat subjective.
As I am building an underground house I just excavated 1100 tons of rock . Unlikely anyone to suggest work hasn’t started .
You might need a gentle word with your building control to see what they expect .