State official Olufemi Oke-Osanyintolu said a search and rescue effort had been launched for survivors of Monday's incident.
"Currently all responders are on the ground as search and rescue is ongoing," Oke-Osanyintolu said, adding that the death toll now stood at six.
Four people were rescued alive and three more treated for minor injuries at the scene, he said.
Witnesses say up to 100 people are missing after the luxury residential structure crumbled, trapping workers under a pile of rubble.
Rescue workers used excavators to sift rubble in the glare of floodlights powered by generators as heaps of shattered concrete and twisted metal engulfed the site where the building once stood, as more workers watched.
President Muhammadu Buhari has called for rescue efforts to be stepped up as emergency services, including hospitals, swing into action.
The collapsed building was part of three towers being built by private developer Fourscore Homes. The cheapest unit was selling for $1.2m. Telephone calls to numbers listed for Fourscore Homes and the main building contractor did not ring through.
Reuters, the news and media division of Thomson Reuters, is the world's largest multimedia news provider, reaching billions of people worldwide every day.Go to: https://www.reuters.com/