The 2-1 Ibrox defeat to Annan last weekend was arguably their worst result of the campaign and keeper Alexander knows they must sort out their defensive frailties sooner rather than later.
He said: "I have high standards and I take pride in keeping clean sheets but at the moment we are not even looking like doing that.
"We are giving the opposition chances right, left and centre and we are conceding goals that in years gone by we would not have conceded.
"It's not acceptable for Rangers players to perform like that but hopefully we can win this weekend, things will be forgotten and we can move one step closer to winning the league."
"The thing is we need to score at least twice in matches to win games because we are conceding and teams gone by didn't have to do that.
"It's a brand new team, they are still young and inexperienced.
"The manager has built this team to win the Third Division and we are on course to do that.
"It's a long process and you have to see that over the course of the season the boys have done very well, but we know last week was bad."
They head to Elgin this weekend aiming to take another step towards the league flag and Alexander is keen to make up from their horror show last time out.
"We are bitterly disappointed because it was a terrible result for us at the weekend, but we must move on," he told Rangers TV.
"We have a massive game on Saturday and we know it will be tough up at Elgin, but we need to bounce back and we are confident we can do that.
"Sometimes complacency creeps in – although I would like to think it didn't.
"We are so far ahead and it is virtually job done, but we are not over the line yet."