Scores of rescuers combed the rubble at the foot of the 12-storey Yun Tsui apartment block that was left leaning at around a 50-degree angle by the quake, complicating rescue efforts due to fears of an imminent collapse.
The two bodies and the last three missing are believed to be members of a family from Beijing who arrived in Taiwan Monday, authorities said.
They were staying in a second-floor room at a hotel in the building in the eastern city of Hualien when the quake hit the following night.
"(We) are digging from the fourth floor down and even though the site is leaning at 45 degrees we are making an all-out effort for the rescue," the Hualien fire department said in a statement.
The first body pulled from the site was identified as a 12-year-old boy and the second an adult male, meaning 11 of the 14 people killed in the quake perished in the Yun Tsui building.
Rescuers also said a third body was recovered on Saturday afternoon but this has not yet been added to the official toll.
Hualien, on Taiwan's picturesque east coast, is one of the country's most popular tourist destinations, but the mountains that rise up behind the city are a testament to the deadly tectonic fault lines that run through the island.
The island's worst tremor in recent decades was a 7.6-magnitude quake in September 1999 that killed around 2,400 people.
That quake ushered in stricter building codes but many of Taiwan's older buildings remain perilously vulnerable to even moderate quakes.
(Except for the headline, this story has not been edited by NDTV staff and is published from a syndicated feed.)
Election Results for Lok Sabha Election 2019 will be out on May 23. Get the latest election news and live updates on ndtv.com/elections. Catch all the action on NDTV Live. Like us on Facebook or follow us on Twitter and Instagram for news updates from each of the 543 parliamentary seats for the election 2019