Christopher Daniel Hubbard, also known as Christopher Shaw, was wanted by police in Hamilton after the breach.
Police warned the public not to approach Hubbard because of his history of firearms use.
A police spokeswoman did not detail the specifics of the breach, but confirmed he had handed himself into Palmerston North police this morning.
The 32-year-old was jailed for nine years and 11 months in 2009 after he and then-partner Stacey Estelle Snelleksz embarked on a 600km crime spree which ended in an armed stand-off with police near Palmerston.
The pair fled the North Island after learning Snelleksz's two children might be removed by Child, Youth and Family and stole goods worth up to $45,000, resulting in the pair facing more than 100 charges.
He was granted parole in February, almost three years shy of his statutory release date of January 3, 2019.
The board's decision revealed Hubbard had two prior jail terms and more than 120 convictions.
He had a 70% chance of re-offending, the decision said.
Shaw had only been recently released from prison when he embarked on the crime spree with Snelleksz.
During their three-day run from police the pair stole a Land Rover, committed numerous other burglaries and thefts, evaded police during a high-speed pursuit and Shaw shot at police with a stolen .22 rifle.
Snelleksz, who was driving, crashed the vehicle into a tree.
During a depositions hearing, police told the Oamaru District Court they believed Shaw used one of children, who accompanied the pair on their flight, as a ``human shield'' while brandishing the rifle at police.
The pair surrendered after being surrounded by armed offenders squad members more than two hours after the crash and after fleeing police through the countryside.
The parole board conceded Hubbard was a "high-risk offender'' but he had "participated diligently in the rehabilitation and reintegration activities to date in prison, and there is evidence from a number of sources that he has undergone a process of significant change over the last seven years''.
"Having regard to that progress we have, by a majority, determined that the proposal before us is sufficient to manage his risk to the safety of the community for the balance of his sentence,'' the board's decision said.
His parole conditions included alcohol and illicit drug prohibition, a daily curfew of 10pm to 6am, a firearms prohibition and an order not to contact or associate with Snelleksz.
His release location was not disclosed in the board's decision, but the Otago Daily Times understands he is excluded from living in any areas where he offended and was to reside in the upper North Island.
Hubbard was one of the first participants in a new programme to reintegrate male offenders. However, the parole board did not provide details of the programme.
A hearing to assess Shaw's compliance with his parole conditions was expected to be held next month.
Snelleksz is understood to have been released in 2010.