The man was reported missing shortly after midnight on Monday after he did not return from a day hike to Devil’s Armchair, near the northern end of the Milford Track.
The police dive squad was called in and search teams had operated in difficult terrain in Fiordland.
Police said the man’s body was recovered about 6pm yesterday near Giant Gate Falls.
Sergeant Tod Hollebon, of Te Anau, said police would continue to make inquiries on behalf of the coroner.
Police Search and Rescue and LandSar personnel, specialist alpine cliff rescue teams and volunteers helped carry out a challenging operation, Sgt Hollebon said.
A rāhui is in place in the Giant Gate Falls and Lake Ada area until April 17.
A police spokeswoman said there would be a postmortem to formally identify the body.
The Otago Daily Times understands the man has family in Dunedin.