Now their challenge is to back up from their win over the Fijian Drua and prove anything is possible in Super Rugby Pacific by shocking the second-placed Chiefs in Hamilton this weekend.
The Highlanders were not always perfect on Saturday night, particularly in a disastrous period after halftime when the Drua scored three quick tries, but they finally showed some composure and plenty of nous to get out with a 43-20 win, breaking a four-game losing run and leaping to seventh in the standings.
"I thought we started well and we were able to put a bit of pressure on and get a lead and go into halftime feeling we were building a performance," Joseph said.
"After halftime, the Drua basically got their tails up, and we were in a real big match again.
"What I’m proud of is there were 10 or 15 minutes when it got really sticky, and we got through that period. In past weeks, we haven’t been able to win that arm-wrestle, but we were able to come out on top.
"We’ve been dealing with the stress of trying too hard sometimes, giving penalties away, conceding cards and losing tight games of footy, so it’s nice to be on the other side."
Any win is a pick-me-up for a team suffering a run of losses.
This might have been victory over the bottom-placed side with a shocking away record, but it meant a lot to Joseph, who said his men had been sticking to the task and keeping their heads up.
"All the players, every week, in terms of their intent and their commitment to the team ... that’s been really high.
"We’re pretty inexperienced around dealing with stressful situations, and we’ve learnt the lessons the hard way. I just hope we’ve turned a real corner.
"We’ve got a win under our belts. Now we play the best team in the competition, I think, the Chiefs.
"And then we play the Crusaders, so it doesn’t get any easier. But it gets exciting."
Joseph hailed the impact of some of his returning cavalry.
First five Cameron Millar returned from concussion for his first game of the season, blindside flanker Oliver Haig played for the first time since breaking his foot in January, No 8 Hugh Renton was back after a long spell, and fullback Jacob Ratumaitavuki-Kneepkens made a fairy-tale comeback after breaking his neck.
"My assessment of all those players is really high," Joseph said.
"I thought they had awesome games under the circumstances.
"They came into the team at a time when we needed to win. Pressure situation, hadn’t played a lot of footy, one’s had a broken neck — lots of circumstances that show the integrity of them as men and as rugby players."
Joseph thought Millar did particularly well in a game in which he was targeted by the Drua, and he hailed the toughness and leadership of co-captain Renton.
Ratumaitavuki-Kneepkens, who feared his rugby career was over, barely missed a beat as he set up two tries.
"He drove his recovery. He drove his return to the game.
"It’s so good to have him back because he creates so much confidence with a lot of presence."
Highlanders co-captain Timoci Tavatavanawai was relieved his side finished strongly against his fellow Fijians.
He liked the way the Highlanders responded to the rugged patch just after halftime with a display of controlled rugby to close out the game.
"I’m so happy with how the leaders stood tall today," Tavatavanawai said.
"We’ve been letting down the team in the last couple of weeks in pressure moments, but we’re learning the hard way."
The Highlanders will strike a Chiefs side in a grumpy mood after dropping out of first place in Super Rugby with a 21-14 loss to the Waratahs in Sydney.
The Blues posted back-to-back wins, beating Moana Pasifika 36-17, and the Brumbies beat the Reds 39-26.
