For 16 months between 2018 and 2019 Rory Stewart was prisons minister, in what he calls “the most shocking, but also the most interesting and fulfilling job that I ever did in government”. It was the fourth out of five ministerial posts he held in just three years, amid the chaos of Conservative Party leadership changes, cabinet resignations and reshuffles.