Malcolm McLeod (73) said he knew a car was there, under covers, but did not know who owned it.
The car is believed to be connected to convicted fraud Michael Swann and is expected to become part of a case being brought against Swann for recovery of almost $17 million.
The Otago Daily Times photographed a Rolls-Royce being transported from Hampden to Dunedin on Monday night but police, the Serious Fraud Office and the Crown Solicitor's Office all declined to provide information about direct action being taken over assets connected with Swann.
A Hampden resident said police had gone door-knocking in the town on Monday evening looking for "exotic European" cars.
The Rolls was removed from the garage and loaded on to a truck.
Mr McLeod said he had given a local fisherman permission to park his jet-boat in the garage of his holiday house but about a year or two ago the boat was taken away.
The fisherman then asked permission to put "an old vintage car" in the garage.
"And I said, 'That'll be all right.'"We got a hell of a shock when neighbours rang up to say police were there."
Mr McLeod, a retired irrigation supervisor, said no-one else had been able to use the garage because "this damned car's been in there".
He had never met Swann "and I don't think I'd want to".
Meanwhile, Marie Grills, from the Crown Solicitor's Office in Dunedin said yesterday the office had initiated proceedings under the Proceeds of Crime Act 1991.
While she provided no further comment, the Act allows for the disposal of assets from serious crimes. Assets owned or under the control of Swann are already the subject of a High Court restraining order.
Swann's employer, the Otago District Health Board, was granted an asset protection order in October 2006, the same month it lodged a civil claim to recover losses of about $16 million.
Mrs Grills said in a statement yesterday "a number" of assets remained outstanding and asked for anyone "who believes they may be able to assist in any way" to contact the Serious Fraud Office.
In November 2006, National MP and now Health Minister Tony Ryall said the assets included 30 vehicles, mostly luxury cars, several boats, properties in Wanaka, a house in Dunedin with a government valuation of $1.1 million, and a property in Central Otago.
The Wanaka house was sold in December 2006 for $749,000 and a boat has also been sold.
The proceeds were dealt with under a High Court order.
