The protective barrier has surrounded the Reverend Gordon Thomson's church in Drumchapel for the last 50 years.
And after speaking to local gang members he believes the church will not become a target for anti-social behaviour.
He has offered an open invitation to locals to wander around the grounds surrounding Drumchapel Baptist Church following an £8000 spend on a garden of remembrance.
The garden is being created so residents can sit in a quiet place and remember loved ones. It can also be used by anyone who simply wants a bit of peace and quiet.
And Rev Thomson, 48, is confident the garden will not be abused or vandalised.
"We decided the fence had to come down," he said.
"It was just a big, ugly 6ft fence, which I felt was a barrier between the church and the community."
The garden is not just for church members. It is open to the Drumchapel community and they will be allowed to plant a flower in memory of someone who has died.
The garden is currently under construction and is expected to open in the coming weeks.
Rev Thomson has been in Drumchapel for 16 years but has been amazed at the response. He said: "The reaction from the community has been amazing – even among those who never go to church. The garden is for everyone. We just want people to wander in and chill."
The project is part of celebrations by the church to mark 50 years in Drumchapel.
Local businesses and residents are lending support while council apprentices are also working on the garden.
A member of the congregation said: "We encourage people to use this wonderful space – and pray that the garden will be respected."
After speaking to local youths – including gang members – and pub-goers Rev Thomson believes the garden will not become a target for anti-social behaviour.
He said even youngsters need somewhere quiet to gather their thoughts.
Barrier removal welcomed by residents but some have their doubts
Alexander Campbell, 27, carer:
"It's a great idea. There's very little community round here and everything has been torn down. The fence looked terrible and you didn't feel welcome to go into the church."
Carol McAulay, 48, unemployed:
"It's a fantastic idea. My 17-year-old son, Billy, died two and a half years ago and the funeral was held at the church. It would be nice to have a garden to go and remember him."
Scott Cameron, 36, tradesman:
"It's very nice what they're doing but I don't know how long it will last. A lot of young ones go behind the church in the field to drink at the weekends. It may not be long before it's vandalised.
Jeanette Davies, 46, unemployed:
"Gordon's a good guy and there's decent people around here, someone would call the police straightaway if they saw anyone damaging the garden, they wouldn't let anything happen."