Lord Provost Sadie Docherty last night confirmed the City Chambers flag will fly at half mast in respect of the former president's passing.
Mrs Docherty paid tribute to Mr Mandela as a "political and moral icon".
She said: "The world has lost a true political and moral icon. Nelson Mandela dedicated his life to bringing freedom, justice and equality to the people of South Africa.
"His beliefs cost him years of his own freedom but his vision for peace and democracy prevailed. His legacy will live on and inspire generations to come.
"Glasgow was proud to be the first city in the world to honour him with a Freedom of the City award and he will be sadly missed by a city which had the greatest of respect for him."
A book of condolence, with the Lord Provost as the first signatory, will be available to sign in the City Chambers foyer.
It will sit underneath a plaque commemorating the 30th anniversary of Glasgow awarding Mr Mandela the Freedom of the City.
It was unveiled by Denis Goldberg in 2011, a fellow defendant at the now infamous Rivonia trial.
The plaque is engraved with the words which Mandela spoke from the dock during that trial on 20 April 1964.
It reads: "I have cherished the ideal of a democratic and free society in which all persons live together in harmony and with equal opportunities.
"It is an ideal which I hope to live for and to achieve. But if needs be, it is an ideal for which I am prepared to die."
The City Chambers' flag will remain at half mast until Mr Mandela's funeral is held.