At least that's my impression - there's lots of things that add up - buildings, techs, starbases, ideology. I like that it has been toned down early on, but later IMO it's still just too easy to eat up planets bordering your empire. What do you think?
One thing - do you also get to flip planets from civs you're allied with? That should not happen IMO...
Also, dunno if it's very different in higher diffs (playing gifted mostly).