"New (Narendra Modi) government has given a new signal. So they (Pakistan) spoiled the talks, they spoilt the game," Ms Swaraj told reporters after her meeting with Foreign Ministers of IBSA (India, Brazil, South Africa) on the sidelines of the ongoing UN General Assembly session in New York.
When asked to comment on Pakistan's National Security and Foreign Affairs Adviser Sartaj Aziz's remarks on Thursday that talks between the two countries could now happen only if New Delhi took the initiative, Ms Swaraj said, "No question of first or second. As far as our reaction is we have said repeatedly that if a reaction had to come, it had to come at this time only. The initiative was there from our side," she said.
The minister added it was Prime Minister Narendra Modi who had invited Pakistani Prime Minister Nawaz Sharif for his swearing-in ceremony.
During the bilateral meeting between the two prime ministers, it was discussed that trade should start immediately at the Wagah-Attari border, Ms Swaraj said.
She said PM Sharif had suggested that foreign secretaries should meet for bilateral talks and "we agreed to that."
Mr Aziz had said that there was nothing new in Pakistani officials talking to Hurriyat leaders and that such talks had been happening for the last 20 years.
Ms Swaraj said as far as talks with Hurriyat leaders were concerned, the leaders who came from Pakistan used to talk with the group.
But "for the first time Prime Minister Nawaz Sharif came to India and he did not talk to them because he understood India's signal. Things began from there," she said.
"But before any talks, the ambassador has met with the Hurriyat leaders, that has never happened," she said.
Get Breaking news, live coverage, and Latest News from India and around the world on NDTV.com. Catch all the Live TV action on NDTV 24x7 and NDTV India. Like us on Facebook or follow us on Twitter and Instagram for latest news and live news updates.