The English striker has just returned from a second month's loan with Irn-Bru First Division Cowdenbeath after scoring four times in seven matches.
He went straight onto the bench for last Saturday's 3-1 win over East Stirlingshire and managed to get on the pitch for the final few minutes.
McCoist has high hopes for the Murray Park product who has been troubled by injuries for the last two years.
And he will use the next two months to make his assessment of the 20-year-old frontman.
McCoist told the Rangers website: "He did well at Cowdenbeath. I spoke to Colin Cameron on a regular basis when Kane was there and he scored four goals which was good going.
"He still has a long way to go. I have had a good chat with him and I think he is strong enough, he is quick enough and he can certainly finish.
"We'll just see if he can do it here. We are hopeful he can do it here so hopefully he will get an opportunity in the remaining matches."
Last Saturday's substitute appearance was Hemmings' first outing for the top team for nearly a year having coming on against Dundee United on March 17 last year.
The striker, who was signed from Tamworth in 2008, is out of contract in the summer.
