Dr Peter Prinsley, MP for Bury St Edmunds and Stowmarket, has called for Norfolk's new mayor to be based in the Suffolk town.