Server space is trivial, does use some CPU time that could be used for other things, does use some space in the left column that could be used for other things, etc.
It's also that if people don't really want it then it's better to remove it since then nobody needs to check if anyone is abusing it either.
