‘Bittu could have come MP for the fourth time if remains in Congress’