Yor can colonize extreme worlds. You can conquer Yor extreme worlds. Allowing you to gain extreme worlds, which you can't otherwise colonize.
The Yor also tend to colonize extreme worlds deep in your territory, allowing you to influence flip them easily.
My suggestion: give Yor some other advantage.