Joseph's Highlanders are sitting at the bottom of the Super 15, winless after six games, and face a Brumbies side that sits second on the ladder, coming off a draw with the lowly Kings last Friday.
The Highlanders' six straight losses equal the worst start racked up by the franchise, in 2008, under first-year coach Glenn Moore.
''Obviously, it is not what I am used to,'' Joseph said yesterday.
''I take full responsibility for the team and its actions. But myself and the coaching team are working really hard to turn it around.
''But, at the end of the day, you are measured by the performance of the team. We work hard during the week and seem to be making progress, only to fall at the end of the week with the game.''
Joseph said he could point to different reasons for most of the six losses.
There were some bad refereeing calls in the game against the Chiefs in Hamilton. Injuries and some key decisions in tight situations had contributed to other losses.
Only in the match against the Cheetahs in Invercargill had the side played poorly.
Asked if he believed he was still the right man for the job, Joseph said that was not for him to decide.
''My role is to try and develop this rugby organisation and bring the whole organisation forward. But you do have to be measured by your results and also be measured by other things.''
Asked if he had considered doing something different with the team in the build-up to the game, Joseph said it was imperative players stayed in the system they were trying to build.
''We are doing different things. I love fishing but I don't know whether going out and catching a whole lot of blue cod will get us to play better rugby.
''Players need to know the roles they have to play on the rugby field and what their place is in that ... at times, players are put under pressure and they slip outside the system and that is costing us.''
An example of that was the match against the Blues, where the Highlanders scored the first 10 points and were looking threatening.
Then Ma'a Nonu was yellow-carded for a shoulder charge on Piri Weepu, and while he was off the field, the side conceded 12 points.
Biggest challenge
''That is the biggest challenge to this team. Dealing with the pressure of not having won a game.
''You get yourself into a situation and you have to get out of it. You need to focus on the moment, focus on the job at the time.''
Joseph said he was not thinking a lot about the Brumbies, concentrating more on his ''own back yard''.
Highlanders prop Tony Woodcock was still struggling with a hamstring injury and was unlikely to play, while centre Jason Emery trained yesterday, shrugging off the rib injury he picked up last Friday night.
Buxton Popoali'i did not train yesterday, after being knocked out against the Blues. Fellow winger Kade Poki took a full part in training and is expected to be available, probably to replace Popoali'i.
Centre Tamati Ellison is pencilling the May 4 game against the Sharks as his comeback from shoulder surgery, up to six weeks earlier than planned.
Joseph said Ellison was a key player for his side and his calming influence was greatly missed in tight situations of late.
''Losing him has shown how valuable he is for us. We are being put under pressure and getting into a spin. At those sort of times, that is where you need some confidence and experience, and a key player like Tamati would be able to provide this.''
Highlanders coaches
Over the years
Gordon Hunter (1996): 5 wins, 6 losses
Glenn Ross (1997): 3-8
Tony Gilbert (1998-99): 16-9
Peter Sloane (2000-01): 12-11
Laurie Mains (2002-03): 14-9
Greg Cooper (2004-07): 21-25, 2 draws
Glenn Moore (2008-10): 10-29
Jamie Joseph (2011-): 17-21
