Caley Thistle travel to Glasgow as SPFL Premiership leaders and with an away win over the champions under their belt from last season.
Terry Butcher brought in a full team of players after his side just missed out on a Europa League place last season, but Vincent is the only outfield summer signing to have started a league game.
The 23-year-old has slotted into the playmaker role vacated by Andrew Shinnie following his move to Birmingham, with Richie Foran dropping into a central midfield berth once occupied by Owain Tudur Jones, who has gone to Hibs.
That continuity has helped Caley Thistle make their flying start - and Vincent feels the belief in the squad is strong enough to produce a shock in Parkhead.
The former Stockport and Kidderminster player said: "It's something you look forward to when you come up here, playing at such a good ground and against good players.
"We feel confident going into the game, we feel we can get something out of it. Everyone is happy and everyone knows their role. We are knocking the ball about and playing good football and I think we will all step up for the match.
"From day one since I came here there has been a good spirit. We all want to win, we all believe we can win and we all believe in each other. So I think that's going to stand us in good stead."
Vincent netted on his debut against St Mirren and is delighted with the way his move has turned out.
"From a team point of view, it has been fantastic - three wins out of three and three clean sheets," he said.
"If you can keep clean sheets then it's something you can build on because going forward we always look good enough to get goals."