Emergency services were called to the Springburn area at 10.30pm on Monday night following reports a man had been assaulted.
He was taken to Glasgow Royal Infirmary where he later died.
The attack happened in Petershill Road, near the Fire Station, and is said to have followed a disturbance involving other people.
It is thought the man, who was from the Springburn area, may have been chased from a nearby close in Petershill Road before the attack.
Strathclyde Police said they were following a positive line of inquiry but have urged witnesses to come forward.
A post mortem examination was being carried out to establish the exact circumstances of the death.
The detective leading the inquiry said the death had left a Glasgow family starting the New Year, "in extremely sad circumstances."
The area was sealed off by police in the early hours of the morning. Officers were carrying out door-to-door inquiries in the area yesterday and gathering CCTV images.
They are keen to speak to an elderly couple who were in the area at the time walking their dog and have appealing to them to come forward.
Det. Supt. Kenny Dewar from London Road CID said: "A young man has lost his life and one family is beginning this New Year in extremely sad circumstances.
"I am appealing to local residents who may have seen or heard anything in connection with this incident, in particular, the elderly man and woman, who were out walking their dog.
"They may have seen something or have information which could assist our investigation."
Friends of the dead man spoke of their shock and posted tributes on Twitter.
A police incident caravan has been set up in Petershill Road and anyone with information is asked to contact officers at London Road Police Office on 0141 532 4658 or 4600. Information can also be given anonymously to Crimestoppers on 0800 555 111.