To be honest I don't agree at all. Something being violent doesn't automatically rob it of aesthetic value. And sumo, while brutal and physical, ultimately is more than just two big guys smashing into each other, otherwise the biggest guys would always win. I'm not a Hakuho fan, but I think he demonstrated that quite ably this basho. His physical abilities are starting to fail him, but his mental and strategic skills aren't. There were multiple bouts where his opponent had him in a bad position, but his timing and split-second decision making was what made the difference, and led him to the zensho.
Ultimately it comes down to how much you want to get out of it. If you go in just wanting to see two huge guys smash each other, that's what you're going to see. But you shouldn't assume that everyone just sees exactly what you do.
It's funny you should bring up chess, because I used to follow the chess world a fair bit (not so much these days) and I'll tell you this; for all the reputation of chess players as intellectual types, there is far more lying, backstabbing, politics, scandal, bullying and omerta mentality in the chess world than the sumo world could dream of.