When high contrast mode is turned on, the background of the canvas changes but none of the content does. This makes it so it’s impossible to see any black text/content.
At the current time, each diagram is rendered to a canvas element, which is not affected by any such CSS rules. So you need to modify all of the Parts and templates.
How are you specifying high-contrast mode in Firefox or Chrome?