Fleming was in a surprisingly mellow mood after watching Three Kings United celebrate a thrilling 4-3 win after extra time in Saturday's quarterfinal.
Neither he nor the Caversham players can afford to dwell on the defeat for too long, with back-to-back games that could decide the league looming against Dunedin Technical.
"It'll be interesting to see how the boys back up from this.
We're out of the cup but there's nothing more we can do about that," Fleming said.
"I don't want to say it's going to be easy just concentrating on the league now, because I wanted to win the cup as well.
"All we can do is front up for the next few games."
Fleming said no team that conceded four goals in a game could complain about losing.
He agreed Caversham should have done better with opportunities it had in the first 30 minutes, but said Three Kings deserved credit for its style of play.
"They had good movement up front and played nice little one-touch stuff, which caused us some problems.
We hadn't encountered it very much.
"At 1-0, I thought we were looking quite comfortable. Then I thought their first goal was offside and that just took the stuffing out of us a little bit.
"We showed character to peg them back in extra time and I'm proud of the boys."
It was a tense, occasionally tempestuous cup tie, with a sprinkling of yellow cards and several off-the-ball clashes marring the quality of football.
Fleming was involved in an incident when he walked on to the field at half-time to confront a Three Kings player.
Fleming later claimed a Caversham player had been the victim of foul play.
"One of my players had been struck in the face. The linesman saw it and nothing was done about it.
"I thought the other guys were badgering the referee for every decision he made as well. I thought they slowed down the game a bit."