“The challenge for them is not the BJP candidate but the Modi factor.”