‘Accentless’ spoken language is the language of the elite, of authority. It’s the version of the language that is used by the people who have traditionally held all the power.
Accents are not inherently easy or difficult to comprehend. Rather, the lack of exposure people have to a variety of accents causes communication difficulties.