I prefer to be agnostic about the kind of circuit one uses to arrive at a certain sonic outcome. People who try to prove that one technology is inherently better (bar power efficiency) than another usually do so because they have to for commercial reasons, or because of ideology (=insufficient understanding to look at the problem from different angles). I don't think this is the case with the books you're referring to.
What they do mean is that attaining a certain performance level is not at all equally easy or even practical with each thinkable technology. Building a good quality class A amp is rather simpler than building an equally good class D amp. I wouldn't recommend anyone planning to design a power amplifier from scratch to head into class D for musical reasons alone. Especially if you're in the "no sound, maximum transparency" game, class D is tough to crack. It's doable, but easy it ain't.
OTOH, many class D's seem to have an euphonic edge to them (one that is usually liked by the designer and by audiophile reviewers, but much less so by pro users). I've yet to meet a beginning designer of class D amps who doesn't claim his amp to be "the first truly audiophile" class D.
To keep a long story short - for a given amount of research effort (not actual design effort, that depends on one's level of experience and hence past research effort) you'll get the best results (least colouration) with class A, followed by B, and lastly D.
The reason why all my current designs are class D is simply because I've gotten the hang of it, and so far all my customers have been happy so they're good enough apparently.