"Those who have reservation in saying Bharat Mata ki Jai and Vande Matram are Pakistanis and they have no right to live in the country," the lawmaker from Bairia said.
"People who do not give the status of mother to their motherland, their patriotism is doubtful... Those who have a problem in saying Bharat Mata ki Jai and Vande Matram should not have the permission to do politics," he said.
Last month, Mr Singh had made headlines by stating that India would become a Hindu nation by 2024.
"If the police can catch hold of a thief and humiliate him, people can also give the same treatment to the police," he told reporters.
Get the latest election news, live updates and election schedule for Lok Sabha Elections 2019 on ndtv.com/elections. Like us on Facebook or follow us on Twitter and Instagram for updates from each of the 543 parliamentary seats for the 2019 Indian general elections.