This is not a setback for Modi: BJP