I'd be a little more skeptical.
I have pulled a 4X8 sturdy utility, a double horse trailer with one horse, and a tandem low bed hauling a VW bug using 6cyl XJ and ZJ's. Both had factory tow pkg.
The 4X8 with 2' sides full of fire wood was about all the weight I would consider pulling with the 6cyl power. It was reasonably stable on gravel, but you were well aware it was behind you.
With a double horse trailer and one horse, from Hwy 8 to Bragg Creek, which in a car, you don't even know is uphill, my ZJ never got out of third to overdrive.
Pulling the tandem with the bug on gravel was scarry as the combined bug/trailer weight (with as much hitch weight as we dared) overwhelmed the weight of the ZJ and control was a huge issue. Unless I kept the speed way down, it started into an incrementaly increasing sway that would have jackknifed had I not slowed right down.
A V8 may get you the power, but from my experience, because a GC is one of the lightest SUV's, I have reservations about stability.