He fell out of favour