Is it possible to remove drag items from Palette using mouse?
Sure, just implement a Diagram.ExternalObjectsDropped event handler that removes the item(s) from the Palette. I think if you made the Palette.Model modifiable, you could just call CommandHandler.Delete on the Palette.