Police have recovered the control unit of an electronic voting machine (EVM) after it was allegedly stolen from the office of a revenue official in Maharashtra's Pune district, and nabbed two persons in this connection, an official said on Wednesday.