Mr Swann was born and bred in the historic mining town, growing up on the family farm at Arrow Junction, one of a population of about 200 back then.
Things have changed since he was a child.
``It's full of Aucklanders now,'' he said, with a chuckle.
Population growth isn't the only difference.
When he took up his first farming job on Greenstone Station, near Glenorchy, he commuted to work on TSS Earnslaw.
After stints on farms across the district he moved back to Arrowtown in 1959 to take up a job with the then Queenstown Borough Council.
``I was foreman of the town - I covered roading, sewerage, water and stormwater.
``I pretty much knew everyone in Queenstown in those days.''
His job included maintaining the Crown Range and Coronet Peak roads, as well as the dodgy Skippers and Macetown roads.
Mr Swann (78), whose wife Elinor died 10 years ago, said it was a job he loved despite the long hours.
But he wasn't afraid of hard work and believed it made days go faster.
It wasn't all work - Mr Swann had been active in the local bowls club for years.
That's where he met his future partner and her late husband, George Marshall.
The Marshalls shifted to Arrowtown more than 20 years ago and immediately immersed themselves in the community.
She attended an Arrowtown Bowling Club annual meeting and when offers to fill the role of secretary were called for, she put her hand up.
The 77-year-old moved up the ranks, becoming president a few years later.
On top of that she catered for functions ranging from bowls dinners and birthday dinners to funerals.
``They used to call me `the sandwich lady','' she said.
She was also a member of the Queenstown Historical Society and was Queenstown Grey Power president for 17 years.
When Mr Marshall died 11 years ago, she found that ``keeping busy'' helped with her grief.
There were 30 Grey Power members when she signed up - by the time she left there were about 160.
``It was a lot of work, but I met a lot of friends along the way and it was good.''
Included in the achievements she was most proud of were securing free parking in Queenstown for those over 75, thereby resolving an issue at Lakes District Hospital regarding district nurses, and securing cheaper power for local pensioners.
``A lot of people would ring me personally and I would sort things out for them.''
Making the decision to leave the district was tough, Mrs Marshall said. She would miss her close friends and the community.
Mr Swann also has misgivings.
``Moving to Invercargill, I will miss the bloody hills for a start. I'll not be used to the flat land,'' he said.
But, they promised they'd be back regularly to catch up with friends.
``We are not running out and shutting the gate - we will be back to visit,'' he said.