The young Scots are second in Group 10, six points behind leaders Holland, with their bid to make the play-off round culminating in Monday's trip to Austria.
With just 10 points on the board, Stark's team have the poorest record of all the second-placed sides and know they can't afford to drop points if they are to finish one of the four best runners-up and make the play-offs.
However, the coach is confident ahead of the St Mirren Park clash and said: "Although we have lost Jordan Rhodes to the big team, I am excited about the firepower we still have up front.
"If you look at Jonny Russell, Leigh Griffiths and Tony Watt they are all on form with their clubs and playing regularly.
"In fact, despite Jordan's absence my main problem for tomorrow night is to make sure we get the most out of all three of them.
"They all give us dif-ferent options and most importantly they give us goals. We need the win to take us into the last game still in the qualification hunt."
Stark added: "I expect Luxembourg to sit in and try and play us on the counter. They will be a lot harder to break down than in the first match over there which we won 5-1.
"So there will be extra onus on the midfield to supply the creativity we need."