Temporary buildings for construction site workers and storage are addressed under Schedule 2, Part 4, Class A of the Town and Country Planning (General Permitted Development) (England) Order 2015 (GPDO) but there are conditions...
You could try quoting that at them. Chances are the neighbiur will complain again when you finish building and don't remove them. If they do I would then try claiming they are Permitted Development.