probably ok to just remove it depending on the condition of the joists and their length, being so close to the joist pocket i doubt it would make any difference. If you are worried you could just remove a course of bricks and whack in a concrete lintel from one of the sheds, they are only about £15 for a 900mm one, then pull out all the bricks below.
PS, im not a structural engineer.