However, Hocken Collections is taking some of the memorabilia, and Cadbury owner Mondelez says it is still working to find a home in Dunedin for what is left.
Mondelez spokesman Jake Hatton said the company had offered to give all the memorabilia it had to local museums and libraries, "however, they've chosen to accept very few items".
"We're working with the hospital to donate much of the artwork, and are speaking to a number of other charities and organisations to ensure we give local parties every opportunity to retain memorabilia in Dunedin."
Mr Hatton said a limited amount of archival material needed to be retained for corporate records and brand history, and that would be kept in the company's Australian or United Kingdom archives.
A few items of memorabilia would be sent to Cadbury World in Bournville, England, for display.
Dunedin City Council Ara Toi group manager Nick Dixon said the museum had turned down the cars because of space issues.
"Space is an issue, but it's not just physical space, it's when you take on an item into a collection you take it on into perpetuity."
There was "a whole raft" of implications in terms of resources and the degree to which an item would contribute to the museum's narratives.
"I explored possibilities within the library but unfortunately due to its size we were not able to accommodate."
Hocken archives head curator Anna Blackman said the institution would take a collection of photos of the factory and staff, corporate records, and a large collection of packaging samples, including the likes of wrappers and display boxes.
The items preserved the story of Cadbury, which had been a significant part of Dunedin's story "for a long time".
Cadbury site manager Judith Mair said the company would continue to find homes for the items, which included everything from automated puppets to vintage machinery.
It had not given up on finding somewhere in Dunedin for the vintage vehicles.