Japanese PM’s uphill battle to win back voters