If you take away a rock from a pile of rocks you haven't changed much. It's still a heap of rocks - just a rock or two smaller. Take away a component from the mousetrap and it isn't a mousetrap any more.
Compassion should be unbiased and based on the recognition that others have the right to happiness, just like you.