The Northern Ireland star finally got the monkey off his back when he bagged the first strike in the Ibrox side's 3-0 demolition of Stranraer on Saturday.
And the striker admitted his lack of goals for Ally McCoist's men had got him down. He said: "It has been difficult not scoring this season. If I am honest, it had been getting to me.
"But now I have got off the mark hopefully I can kick on. If anything, I have been trying too hard. I had a bad afternoon against Forfar a couple of weeks ago.
"I should have buried a couple of chances in that game. Hopefully the goal on Saturday is the first of many for me this season. And hopefully I can go on a good run now and score a few for the club once again."
The one-sided triumph at Stair Park maintained the Ibrox outfit's perfect start in League One.
And it killed off fears Gers will suffer from similar problems on the road in the months ahead as they did in the 2012/13 campaign.
But Little was still unhappy that his team failed to net in the second half of the League One match.
And he echoed his manafer's sentiment that they need to start killing teams off.
He said: "We were far better in the first half than we had been away from home all of last season and that was obviously pleasing.
"I think everyone could see that we have improved as a team this season during the first 45 minutes against Stranraer.
"We are far more streetwise than we were last season. The players we have in the team, even the young boys, know how to win away from home.
"We all gained a lot of experience last season and I think that we will benefit greatly from that. We certainly killed the game off in the first half at the weekend.
"But we should have won by more. We failed to build on our lead in the second half. We have to be more ruthless."
Meanwhile, McCoist has confirmed experienced English keeper Steven Simonsen will train at Murray Park again this week in an attempt to win a permanent move to Rangers.
The Gers manager is keen for Scott Gallagher, who performed well against Stranraer on Saturday, to go out on loan to get more first team experience this season. He was impressed with Simonsen, who has spent spells at Everton, Sheffield United and Stoke City in the past, but is keen to have have a further look at him.