As Prince Harry faces one of the most emotional chapters in his ongoing relationship with the Royal Family, insiders say Meghan Markle has continued to quietly step back and let him “lead” when it comes to deeply personal family matters.

“There’s a lot of sadness” over how the week unfolded and that she wasn’t able to be by his side throughout the visit, a source tells PEOPLE