For me the stopping became an issue towing, my boat weighs 12,000lbs and the 22.5's seriously diminished the braking ability with the boat behind it. As far as ride quality, well I own a tire/suspension shop in the Orlando area and after getting frustrated because I couldn't get it right, I tried 2 other local shops with no better results, so at that point I had to look at different alternatives or go back to stock wheels, hence the 19.5's. And I'm more anal about my vehicles than most people are. Again, these are just opinions/personal observations.
One thing I have noticed with people running the 22.5s is that they love them or hate them with no inbetween ground, maybe the problem is in the different adaptors, mine were American Force, and a couple of the wheel companies(like Brentz Wheels) now list a predrilled 22.5 so no adaptors required.