Ex-MP accused of fraud 'went to constituency office once or