The same uproar happened (the only diff it was not race based) when Wallis Simpson married Edward VIII and the vile comments directed at Camilla when her affair with the now King blew open - Diana also faced a lot of mire from both ends -

Yesterday, I was watching an episode of The Crown and it Diana tells Charles that she did not marry into a family but a man she hoped to have a family with.

I don't think it is that simple - not when you are marrying into the most famous monarchy into the world. And everyone has their own agenda - unless of course you chose to completely withdraw from the limelight and live out your lives quietly like some Royals have successfully managed -