Senior Sergeant Anthony Bond said police were called to Crawford St in Dunedin at midnight after reports of two males going through the skip bin around the back of the Briscoes building.
The 31-year-old and 32-year-old men were "trying to recover disposed of stock the store threw away".
The two men were warned for their behaviour, Bond said.