The Ibrox giants gifted part-time Stirling a second-half equaliser at a free-kick in their Irn-Bru Third Division encounter at Forthbank last night.
And Greig McDonald's side, who won 1-0 the last time they played Ally McCoist's team at home back in October, managed to hold on for a point.
Captain Wallace is determined to sort out the weakness in the team's play despite their commanding 20-point lead at the top of the table. He said: "It was bitterly disappointing to lose a goal at a set-piece. It is even more disappointing considering that we do a lot of work on it in training. The boss spends a lot of time on the training field with us doing that. In particular, we work on wide area free-kicks.
"He also told us before the game not to give away cheap free-kicks. "There is a lot of detail put into it.
"We do a lot of video on it and on our opponents. We knew what Stirling were capable of and failed to stop it.
"But we did that on more than one occasion and that led to their goal. I think we have all just to take more responsibility. All of us in that line have to stand up and be counted."
It was the first time in nine games on the road in the league – since, in fact, losing to Albion last year– that Rangers had dropped any points.
However, McCoist was furious with his team for failing to win – and for conceding the goal to Ross Forsyth at the set-piece.
He revealed afterwards that he would like to strengthen his team in central defence in the summer.
The Gers manager was disappointed his team failed to build on Little's early goal – a strike that made him top Rangers scorer this season with 22 to his name along with Lee McCulloch.
He said: "I was disappointed we lost a goal at a set play and then failed to take any more of the goalscoring chances that we created.
"Set plays are a problem for us. It isn't rocket science. The opposition's best chance of scoring against us is a set play. We have to do far better in that area.
"We aren't attacking the ball well enough in that area. We have to take responsibility in that area. We definitely need to be stronger in that area."
He added: "I've said all along that when you don't stretch teams and punish teams you always run the risk of losing a goal and putting yourselves under pressure when the opposition have got something to hold on to.
"That was the case again. We had chances to add to our tally albeit it was a very good goal from Andy. It was a really good one-touch goal and a good finish.
"But we should have added to it, particularly in the first half and also at the start of the second. We didn't do it and defended a free-kick appallingly."