The body was found in Robroyston Park, Barmulloch at around 7am yesterday.
A member of the public made the grim discovery while walking in the park in the north of the city and raised the alarm.
Police and forensic officers were called and shortly after they arrived both entrances to the park were sealed off.
Detectives are treating the death as "unexplained" and a post mortem is being carried out.
A white tent was set up yesterday morning close to a path in the park which runs parallel to Quarrywood Road.
A mobile police unit has also been set up in the area and people are being asked to pass on any information to officers there.
Police are also carrying out door-to-door inquiries in the Barmulloch area.
One woman, who works in a nearby beauty salon said: "When we arrived for work there were dozens of police. Everything had been cordoned off.
"We've not heard anything more though."
A police spokeswoman said: "At 7am the body of an as-yet unidentified man was discovered in Robyroyston Park.
"Enquiries are currently ongoing as to his identity.
"A post mortem will take place in due course to establish the circumstances of his death.
"The death is being treated as unexplained."