Zooming is implemented by changing the value of DiagramPanel.Scale, so the scale applies to everything that is drawn.
But you can change the ScaleTransform on that individual node so that its size changes inversely with the DiagramPanel.Scale. Execute that code in a DiagramPanel.ViewportBoundsChanged handler that you establish in a Diagram.TemplateApplied handler.