Missing Vermiculate Insulation

[RadoXX]

Hello everybody, just wanted to ask: Is it ok to use log burner stove if some of vermiculite insulation that was poured around liner in original chimney is missing? One side if fire resistant board that was above the stove where flue goes, fell off and some of vermiculate has dropped on the floor. I have collected it all, its about 2 bags of it. Is it still ok to use log burner or there will be issues?

Thank you for your help guys.