The former England coach said the Scots had produced an "unacceptable" performance in Aberdeen where second-half tries by Tukulua Lokotui and Fetu'u Vainikolo earned Tonga victory.
"That was a totally unacceptable performance we've witnessed today," Robinson said. "I'm very angry - there will be consequences because of this performance. It reflects on me.
"We'll look at everything - I've got to look at myself, as has everybody involved. I've got a contract and my focus at the moment is talking to the players," he added.
Scotland suffered a third consecutive defeat in the November internationals, although the first two were against world champions New Zealand and South Africa.
The hosts recovered from a nervy start to lead 6-3 at halftime against Tonga with two Greig Laidlaw penalties.
However, despite three more Laidlaw penalties in the second half, Tonga powered to victory with first Lokotui burrowing over and then Vainikolo sprinting down the left to score.
Fangatapu Apikotoa kicked three penalties for the Tongans.
"They dominated us at the tackle contest and if you get dominated at the tackle contest you end up being in a fight for the game," Robinson said.
"It became a fight and Tonga scored a try and they were able to hold on."