A report into the treatment of staff under the Recognised Seasonal Employer scheme found major gaps in the system allowing a systemic pattern of human rights abuses.
The Equal Employment Opportunities Commissioner called for an urgent review by government before the 2023 season.
Advocates say there needs to be a fundamental culture shift for how the RSE workers are treated - but the industry says it is already putting in the work.
EEO Commissioner Saunoamaali'i Karanina Sumeo said some of the conditions shocked her, that there were inherent cases of racism, and extreme cases akin to modern day slavery.
Pacific Legal's Richard Small said employers were able to exploit workers with no consequences because of the way the system was set up.
"No New Zealand worker would have a condition in their contract that forbids criticism of their employer - Immigration NZ is well aware [because] we've sent them copies - these employment agreements, although with individual employers, forbid any criticism of their employer online ever and at all."
The commissioner is calling for an urgent review and to tighten employment standards.
But Small said without a major culture shift, any solutions risked window-dressing the issue, and that there was an underlying attitude of seeing RSE workers as units of production rather than people.
"That mindset is always going to lead to abuse. It seems ironic that Immigration NZ, who have done quite a bit of work in the area of worker exploitation, when it faces the Pacific, continues to accept illegal employment conditions," Small said.
Cause Collective lead and Pacific community leader Jerome Mika said the onus was on New Zealand to sort it out.
"We all know that a lot of our employers are getting a massive return and productivity increase, and we should just be fair for these workers and ensure they are given a fair pay when they are there and that they're able to bring money back for their family," Mika said.
The report has come as a surprise to some of the industry who say they have already got most of the commissioner's recommendations in play.
The country's largest kiwifruit grower, Seeka, relies on RSE workers to ensure all of its fruit is harvested.
Its chief executive Michael Franks said many of the recommendations were already in place at Seeka, for example how every employee had medical insurance and regular access to healthcare.
"For all employers in the horticulture space, the well-being of our workers is a priority for us all - not just the RSE workers, but the New Zealanders, the backpackers, the overseas workers," Franks said.
He said the commissioner did not visit Seeka but she was welcome to come.
Seeka is a member of New Zealand Ethical Employers (NZEE), which audits and accredits primary industry members for meeting human rights and workplace standards.
Its members account for 60 percent of RSE workers across 41 employers.
NZEE chair Tanya Pouwhare said there was a zero-tolerance for unethical employers and there were many doing right.
"Our members have been really concerned with the allegations, because if they are doing everything in their power to do what's right, and then we hear of allegations of people not doing the correct practices ... it's really disappointing," she said.
Three employers had not been able to meet its accreditation standards since launching in June - and instead of leaving them behind, Pouwhare said they were working to educate and help the employers improve.
Pouwhare also said the commissioner did not speak with NZEE for the report and would also be welcome to.
