I think it depends on how obvious the work is, that you plan to do. Are you detached, do you have nosey near neighbours? Most people don't know the difference between Planning and Building Regs. If you think there's a good chance someone might dob you in, then be careful. If not then I doubt anything would happen.