The Canaries were the best side in the first half and twice equalised after half-time before Svetoslav Todorov's second goal of the game and Pompey's third secured the three points and took the club five points clear at the top of the first division table.
"We had to work very hard for that because Norwich looked the better team until half-time," Redknapp said after the game at Fratton Park.
"But we had kept going and scored three goals again and while we didn't play as well as we know we can I'm delighted with the victory.
"It was a great three points and I think four more wins will probably get us promotion.
"Sheffield United are the only danger to us now because nobody else can catch us but I'm confident we will not mess it up now."
Norwich Match Report