He stepped down as Ontario Progressive Conservative Party Leader hours later.
"I can take a punch, but it stings when it is unfairly directed at the people I love instead of me", Brown said in his statement.
Since his resignation in the wake of sexual misconduct allegations levelled against him by two women, as reported by CTV News on January 24, Brown, 39, has been facing other allegations, including financial mismanagement and questions over inflated party membership numbers.
Less than two weeks ago, Brown made the stunning decision to enter the race to find his replacement. He says he plans to rest control of the party from elites and give a voice to the grassroots members.
CTV News has received a notice of libel. The three left the bar for Brown's home, where in his upstairs bedroom he pressured the teen into performing oral sex on him.
Other Ontario PC politicians were not so supportive, like leadership hopeful Caroline Mulroney, who had gone on record to suggest that Brown should step down due to his taking emphasis away from the problems the PC party is looking to address.
CTV then reported that the first accuser had changed part of her story, saying she had been 19 and of legal drinking age at the time of the alleged incident but was sticking to the main allegations in the story, as was CTV.
Brown also criticized the media for disturbing his family with reports, including one about his "on and off relationship" with his 23-year-old partner. He openly challenges the veracity of CTV's reporting on the original story and points out discrepancies in the women's accounts that he says prove their accusations are false.
"The best thing I can do ... at this time is ensure that we win the riding of Barrie-Springwater-Oro-Medonte as party of a PC Party government on June 7", he said.
Now that Brown has quit the race for leadership of the Ontario PC party, the race comes down to Mulroney, ex-Toronto councillor Doug Ford, MPP Christine Elliott, and social conservative activist Tanya Granic Allen.
Rightly or wrongly, those seeking public office are under the microscope for deeds past and present, and Brown should know that.
Brown had launched a bid to reclaim his job earlier this month despite being kicked out of caucus.
Brown was cleared by a party committee last week to run for the top job again.
That seems to be a reference to a complaint filed against him by Randy Hillier, a Conservative member of the legislature, alleging various ethical breaches, including traveling with the woman as his girlfriend when she worked at Queen's Park.