Alexander and his Gers team-mates were lucky to win the William Hill Scottish Cup second round clash with the Highland League minnows who had been reduced to 10 men.
Only a wonder save by the keeper at Mosset Park spared the Ibrox club's blushes and ensured their progress into the third round.
The embarrassing display came after far from convincing performances on the road this season against Brechin, Peterhead, Berwick Rangers and Annan, with Alexander sure things will improve.
"It is unacceptable and I can promise the fans we will be working extremely hard in training this week to cut out the errors," he said.
"What is happening away from home should not be happening. We should be winning these games by two, three, four goals every time, not struggling. We need to take a long hard look at ourselves in the mirror and try to sort it all out on the training ground in the days ahead."
Alexander added: "If we don't sort out our away form then sooner or later we are going to suffer more draws or even a really bad defeat.
"We can't keep playing like that week in, week out, and hope to pick up points. Some team is going to take advantage of it before long.
"Against Forres at the weekend we were hanging on for long spells. It shouldn't be happening. It is sloppy. We can't be allowing that. Especially when we aren't threatening teams up front."
Alexander revealed that Ally McCoist had given the Rangers players "a rollicking" for their below par showing after the final whistle in Forres at the weekend.
And he vowed to take the manager's comments on board and attempt to sort out the worrying problem at Murray Park.
He stated: "We need to do better away from home. The manager has pointed out to us in no uncertain terms what areas we are letting ourselves down in and where we need to improve."
Meanwhile, Alexander has refused to use the number of young players injury-hit Rangers are playing at the moment as an excuse for their ropey displays.
He said: "It is hard for the young boys to be thrown into the team this season and be asked to play at away grounds with more physical players.
"They have all done extremely well considering. Perhaps the senior players in the team need to take more responsibility for them and look after them a bit more."
