I know how it feels OP, I laboured over every bit of insulating detail for our place until our 2.4 x 7m sliding doors were installed (I was abroad with work). They removed insulation from cavity and back filled with solid concrete and sat the flush doors on them (from what I can tell).
The installers refused any other installation method or approach due to our big, heavy and expensive the doors were, but it has left me a massive cold bridge which can be felt 1 foot into the room. Not sure id have accepted the risk of forcing them to do it differently, but I'm pretty sure mitigations could have been found for some if it (between them and builder).
As the doors are nigh on fully flush inside and outside, nothing I can do about it.
You can't win them all.
(edit: also be wary of knock on implications, fix one problem may create others, and adding flex or tweaking installed doors may create other issues)