Country need a capital for Ease of Governance.
It just makes sense to have all the wings of government together in one place. Separating them out to different cities for whatever reason would only make things harder, both for the government and for the people.