The former Fox News host and his brother lamented their support for the president over the past decade.