"If good sense prevails on him he should tender an apology to Sonia Gandhi. Making such allegations is not suitable for a person holding such a position," Mr Antony told a meet-the-press programme in Kottayam.
He, however, said he was not expecting an apology from the prime minister.
"Modi did not speak like a Prime Minister. He spoke like an RSS pracharak. Instead of making such boasts in a public platform, he should have given a reply in Parliament. But he was seen fleeing from Parliament," the former defence minister said, reacting to the prime minister's attack on Congress and its leadership over the controversial VVIP chopper deal.
On the campaign trail in Kerala and Tamil Nadu, PM Modi had repeatedly raked up the VVIP helicopter scam.
"Madam Soniaji, 'Aap ki Yae himmat (how dare you).' You and Congress leaders are making statements that false allegations are being made against you. Did Modi or Modi government in the last two years even once take the name of Congress in the helicopter deal?" PM Modi had asked, addressing an election rally in Thiruvananthapuram on Sunday night.
The prime minister had said the Congress president's name has been dragged into the deal not by him or anybody in his government but by a court in Italy.
Refuting the charges, Mr Antony said Italian court has not named anyone in the AgustaWestland case.
He said AgustaWestland came into the picture in 2003 after then National Security Advisor Brajesh Mishra played a lead role in reducing the operational requirements for the VVIP chopper.
Mr Antony alleged that PM Modi is trying to weaken Ms Gandhi and her family hoping that it would help destroy the Congress party.
"Modi is a better actor than Amitabh Bachchan," he said.
Get Breaking news, live coverage, and Latest News from India and around the world on NDTV.com. Catch all the Live TV action on NDTV 24x7 and NDTV India. Like us on Facebook or follow us on Twitter and Instagram for latest news and live news updates.