William Paterson, is accused of repeatedly shooting and killing 29-year-old Mr Carroll outside Asda in Robroyston on January 13, 2010.
He has also been charged with possessing a Ruger .357 Magnum gun and 9mm self loading pistol.
It is also alleged that he attempted to defeat the ends of justice by wilfully setting fire to a car and concealing two handguns in shrubbery at an area at the back of Coatbridge library in Coatbridge, North Lanarkshire.
He faces a fourth charge of stealing a car on September 22, 2009 in Rutherglen, South Lanarkshire.
He appeared in private at Glasgow Sheriff Court yesterday and made no plea or declaration.
Paterson was remanded in custody by sheriff Kenneth Mitchell and will appear again next week for full committal.