Asked about the BJP's criticism, Mr Gandhi told reporters, "I am a devotee of Lord Shiva. Let them say whatever they want to say. My truth is with me".
The BJP was quick to retaliate. "We are not against his temple visits. We wish that everybody goes to temples and follows our tradition," state BJP in-charge Bhupender Yadav was quoted as saying by news agency Press Trust of India. "But I want to ask... he (Gandhi) lives in Delhi and there are many temples there. Has he ever gone to any temple in Delhi? Has he visited Delhi's Akshardham temple?"
The reference was to Mr Gandhi's recent visit to Gandhinagar's Akshardham temple, with which he has started the last leg of his campaign in the politically crucial north Gujarat. The temple has a huge influence on politically powerful Patidar community, which the Congress has been trying to get on its side.
The BJP, which has often accused the Congress of Muslim appeasement, has called his frequent temple visits an attempt to draw Hindu voters in the poll-bound state. The BJP does not have the "patent on devotion", the Congress has shot back.
Last year, ahead of elections in Assam, Mr Gandhi claimed that he had been barred from visiting an iconic temple in Assam by workers of BJP's ideological mentor, the RSS. The temple authorities and the RSS had rubbished the claim.
The Congress vice-president, in another first, had introduced the country to his pet dog Pidi a few days ago. The 47-year-old, whose sharp posts on Twitter have recently caused a stir on social media, had directed the post at his detractors, claiming it was Pidi who was responsible for the tweets.
On Monday, Mr Gandhi picked a couplet from a song from the 1978 Bollywood film Gaman to take a swipe at the Delhi and the Central governments for failing to address the pollution that has been choking the national capital for a week.
(with inputs from PTI)