I considered the same idea but decided against it.
Air has such a low heat capacity, you need to move a lot of air (noisy) to get a decent cooling effect. Also any cooled ducts will need to be insulated to stop condensation forming in the void spaces (potential for mould of drips staining ceilings.
I'm still waiting for the phpp calcs to be done, but I'll most likely be going independant MHRV and a few hidden splits in ceilings where needed.