Mr Rai, who was accompanied by Bihar BJP vice president Devesh Kumar, said that Congress party did not stop raising fingers despite the late Judge's family stating that he died of heart attack.
Referring to the Supreme Court's judgement in Judge B H Loya's death case yesterday, Mr Rai said that the petition filed for probe into Judge Loya death was a politically motivated one and part of conspiracy against BJP chief for maligning his image.
"Congress and its allies hatched a conspiracy to malign the image of our party president Amit Shah. With the apex court judgement in Judge Loya death case, it has been clearly established that Congress has been indulging in dirty and cheap politics and also conpired to tarnish his (Shah) image... Congress and its allies should tender apology from our party president," Mr Rai said.
The BJP chief was later discharged by the judge who replaced Judge Loya.
"Congress hatched a conspiracy by putting the judicial system of the country in the dock for which it will have to pay a heavy price when it will be ousted from power in the remaining few states," said Mr Rai, a Lok Sabha member from Ujiyarpur constituency in Bihar.
Get the latest election news, live updates and election schedule for Lok Sabha Elections 2019 on ndtv.com/elections. Like us on Facebook or follow us on Twitter and Instagram for updates from each of the 543 parliamentary seats for the 2019 Indian general elections.