Change the word "Cancel" (below the list of available projects) to "Remove", "Delete", or "Destroy" when you select an already built improvement. This would help players find how they are supposed to remove existing items on the planet. Moving the button may also make sense since it has nothing to do with building improvements.
Also ask to confirm the removal of the existing improvement. Some of these improvements take a long time to build after all... =D