Get Me Out Of Here after he fell ill.
It is understood the 51-year-old comedian left the camp in Australia yesterday afternoon and was expected to stay at Tweed Hospital, a 40-minute drive away, for a few days.
His wife Anne-Marie and daughters Amy, 15, and Lucy, 10, rushed to his bedside.
Earlier, viewers saw him break down in tears after a row with David Haye after the boxer flicked two burning logs on to the forest floor.
He then sparked a bizarre argument after chastising TV chef Rosemary Shrager for supposedly insulting the former heavyweight star by saying: "I don't like boxing."
A spokeswoman for the ITV show said: "Brian Conley has left the jungle due to medical reasons." She refused to give more details.
But there was good news for Helen Flanagan who escaped a Bushtucker Trial for the first time when Made in Chelsea star Hugo Taylor was picked for tonight's Savage Sewers.
On Sunday she had faced her seventh trial and won five out of a possible 12 stars by braving ants and blankets of cockroaches.
Another person seemingly getting used to jungle life was MP Nadine Dorries who said: "This has been so amazing. I have laughed so much. I realised that the day I entered politics is the day I stopped laughing."
