Claiming that Mr Sinha is known because of his party and not the other way round, Mr Vijayvargiya added, "A dog runs after a car and thinks that car is moving because of him."
Mr Sinha - a parliamentarian from Bihar who doesn't shy off from provocative comments either -- has repeatedly raised the hackles of his party during the just-concluded assembly elections in the state, in which the BJP got decimated.
But his series of tweets yesterday, lauding the "victorious friends" and criticising his own party for the loss, managed to outrage several partymen.
"It appears the issue of Bihari vs Bahari (and Bihari Babu's absence) has been settled once and for all," he had tweeted.
The tweet indicated that ignoring the Bihari babu, as he is known as, in favour of Bahari - Nitish Kumar's term for Prime Minister Narendra Modi - had cost the BJP dear.
While party leaders, including general secretary P Murlidhar Rao demanded that Mr Sinha be sacked from the party, Mr Vijayvargiya indicated that it would better to ignore him and used the dog analogy.
"The party gives us something so it is our duty to give something to the party," Mr Vijayvargiya said. "He (Mr Sinha) himself has to take care of his discipline."
Late on Monday evening, Mr Sinha tweeted:
People want my reaction to Vijayvargiya's remark. My reaction to small or big flies in any party is "Haathi chale Bihar,....bhaunken hazaar"- Shatrughan Sinha (@ShatruganSinha) November 9, 2015
While Mr Sinha has often struck a discordant note, Mr Vijayvargiya has also embarrassed his party time and again with his out of turn remarks - lately about actor Shah Rukh Khan.
In June, dismissed the massive Vyapam scam in Madhya Pradesh as a "chhutput (small)" matter. A month later, he allegedly made insensitive comments on a journalist who died while reporting on the Vyapam scam.
The public criticism, however, has not impeded his ascent within the BJP. In June, he was made a general secretary of the party.
Get Breaking news, live coverage, and Latest News from India and around the world on NDTV.com. Catch all the Live TV action on NDTV 24x7 and NDTV India. Like us on Facebook or follow us on Twitter and Instagram for latest news and live news updates.