Gayle was one of the benefactors of the experimental rule when he trapped Daniel Flynn lbw on day one of the first test against New Zealand in Dunedin.
His original appeal was turned down but that decision was reversed once the third umpire had reviewed the footage.
Despite that call going in his favour, Gayle declared his opposition after the test ended in a draw when more poor weather prevented any play on the final day.
"To be honest, I'm not really a big fan of it," he said.
One of his reservations is it simply takes too long to reach a decision.
"Obviously, it helps the umpire and I'm sure they will agree to continue with it. But it is only my opinion and no-one might listen to my opinion."
Gayle said he was not the only tourist with reservations.
"Some of them [team-mates] are a bit 50-50 as well. Everyone has their own opinion.
"You have two standing umpires out there whose job is to actually get the job done. Sometimes the decision will be in your favour, sometimes it won't. That's what has been happening over the years."
New Zealand captain Daniel Vettori also expressed concerns and suggested the number of unsuccessful referrals should be limited to one.
Vettori said the rule was designed to prevent the worst decisions but he was worried it would be used increasingly in 50-50 calls when the batsman should be given the benefit of the doubt.
