Mr Vijayvargiya also slammed the Trinamool Congress ministers for attacking the governor by saying "those who are involved in scams should not talk much as they will soon go behind bars".
Coming out in support of the state Governor KN Tripathi, Mr Vijayvargiya said, "KN Tripathi is a seasoned politician. He was Speaker of the Uttar Pradesh Assembly. He is well aware of the constitution and its norms."
"The Trinamool Congress is verbally attacking the governor and trying to malign his office in order to divert attention from the communal violence and its failure to control the situation. In doing so, it has stooped to a new low," Mr Vijayvargiya said.
His comments comes in the backdrop of the recent war of words that broke out between the governor and Chief Minister Mamata Banerjee over the incidents of communal violence in Baduria area of North 24 Parganas district. "The TMC government, just for the sake of vote bank politics, allowed the incident to happen. In order to appease the minority, the majority community was made to suffer. Had the police taken action on the very first day, things would not have snowballed into such a situation. The police remained a mute spectator," he alleged.
Accusing the state police of failing to control the situation, Mr Vijayvargiya, who is also the party's in-charge of West Bengal, had on Tuesday urged Union Home Minister Rajnath Singh to intervene.
West Bengal Food and Supplies minister and TMC president of North 24 Parganas district, Jyotipriyo Mullick, refuted the allegations of Mr Vijayvargiya and in turn, accused the BJP of "fomenting trouble" in the area.