Constable Sean Drader, of Queenstown, said Casey Bowler-Moncur was believed to be responsible for incidents overnight on July 16 when Destination Organic Limited had its door broken; $260 and jewellery was taken from the Bead Shop; and a cash register was stolen from Botswana Butchery.
At the time, the 44-year-old was already on bail for other burglaries, and allegedly committed another 14 in Dunedin before targeting Queenstown.
"We think it was him," Const Drader said.
"There was one in Cromwell, then Takaka, six or seven in Nelson and then Motueka [where he was arrested]."
Senior Sergeant Grant Andrews said it was "very likely" Bowler-Moncur had stolen an unsecured 1994 green Jeep Cherokee, which had a Beretta over and under shotgun and about 10 rounds of ammunition in it.
"We weren't aware of this initially so it's changed things a bit."
Police were looking for the vehicle, with the registration number ZI2488.
Anyone who sees Bowler-Moncur or the vehicle should call 111, Snr Sgt Andrews said.
"He should not be approached."
Bowler-Moncur is described as Caucasian, thin, scruffy-looking and about 1.72m tall.
He was last seen wearing dark jeans, a green v-neck jersey, and was in bare feet.
