how to repair soft mortar on stone bay window

[tonygg]

Hi, I noticed the mortar holding my very heavy looking bay window is very soft. 

is it ok to scrape part out at a time so its still supported by some, and is there special mortar I should use ?

thanks