People living near the Emirates Arena say they are dealing with prison-like conditions and are unable to drive in or out of their street due to the "over-the-top" security measures.
The fencing, which is around 8ft tall, comes up to the pavement and is blocking local access.
The worst affected areas are Springfield Road between the Emirates Arena and the Athletes' Village and Baltic Street.
Eleanor Miller, 58, who lives on Springfield Road, said: "We are being barricaded into our own homes. I don't know how I will get in and out to work. "
Residents have also been told they are not allowed to park their cars in front of their homes, leaving many having to park vehicles far away.
John McGregor, 59, is disabled and lives with his wife Marjorie on Springfield Road.
They have had to move their car to a relative's house and are stranded without transport.
John said: "It's a disgrace. I have a walking stick and rely on the car. We were on holiday and were told by the police not to park our car outside the house before we left. We came back and saw all the fencing.
His wife Marjory said: "It's just not very friendly at all, is it?
"What does it say about us, that they've had to put this fence up?"
Councillor George Redmond, who looks after Calton area, said: "Consideration must be given to the safety of the athletes but consider-ation must also be given to the people who live in the area. The fences are an absolute disgrace - they are way over the top.
"There has been little or no engagement with local people.
"Bosses of 2014 need to understand locals have been living next to a building site for the past three-and-a-half years."
Mr Redmond says putting security barriers in the middle of the road would have protected athletes and allowed local people to go about their business.
He said: "The 2014 team is about looking after the athletes but this should also have been about how the residents could play their part in welcoming the athletes, visitors and officials to Glasgow.
"It is almost as if Games bosses want to push them aside.
"I don't think the athletes and officials would be happy about the way the locals have been treated here."
Angela Bothwell, 30, a care assistant, said the fences are the latest in a string of disturbances she has faced since work began at the Village.
The mum-of-three said: "I was woken up at three in the morning with banners being erected on poles outside my house.
"I have a disabled son who I had to get to school in the morning, and my husband was up at 5.30 for his job.
"I went to the bedroom window to ask what the workmen were doing, and they just said 'if you don't like it, phone the council.' We've been living in a building site for years. I love my house but I just wish I could take it as far away from here as possible."
A spokesman for Glas-gow 2014 said: "Glasgow 2014 continues to work with organisations and individuals including Glasgow City Council and local councillors, Police Scotland and local residents to keep communities up to date with work being done.
"Perimeter fencing is essential to ensure we have a safe and secure environment where the athletes can relax.
"We greatly appreciate the patience and understanding of all residents across the city, and in particular those in the East End who live close to a number of Games venues as well as the Athletes' Village.