The Gers left-back says the club have put their disappointing displays against Hibs, Hearts and Falkirk in their first three fixtures firmly behind them.
Ally McCoist's side thrashed Clyde 8-1 in the Petrofac Training Cup at home last Tuesday night and beat Dumbarton 4-1 in the SPFL Championship on Saturday.
But the vice-captain was disappointed the League One champions conceded soft goals in both those victories.
The 27-year-old is now keen for the Light Blues to stop opponents scoring in the 2014/15 campaign.
He said: "We got a lot of confidence from the 8-1 win over Clyde in midweek. I think we came out of that game thinking that we had turned a corner. Hopefully we have done that.
"But it is still disappointing that in the two games that we have played in last week, we haven't managed to keep a clean sheet.
"That is something we have to address. We work hard to take a pride in our defending. The manager is big on that and big on keeping clean sheets.
"Hopefully we can do that against Queen's Park. It's disappointing most of the goals we have conceded this season are as a result of us switching off and not taking pride in our defending."
Wallace has again pledged his future to Rangers after being linked to a move to English Championship club Brighton this week.
He said: "I am fully focused on helping the club get back to where it should be playing football, in the top flight of the Scottish game."