Crews were prepping the site for demolition. Two large excavators were brought in to begin ripping down 320 Esplanade Avenue Saturday morning.
WATCH VIDEO: Watch your Accuweather weekend forecast
"They've got to tear the front of the building down first with the small excavator and deal with the back of the building with the long arm," said Bart Willoughby.
Wind and rain also caused major trouble for the residents of a Pacifica house. No one was home when a massive tree crashed on top of it. It also knocked out power to the whole neighborhood.
"I came down about 4 p.m., the power was out, I left and came back. They wouldn't even let us up the street for an hour," said Pacifica resident Joe Everett.
Friday's break from the rain meant construction crews could continue repairing a sink hole that formed weeks ago near the downtown pier.
Sky7 HD also showed new trouble along Esplanade Avenue. Residents of the Bluffs Apartments at 380 Esplanade said the crane is part of a construction crew that has been on site for the last few weeks trying to shore up the cliff with cement and massive steel rods.
PHOTOS: Rain, storms hit Bay Area during 2016 El Nino season
Back at 320 Esplanade it was extremely windy. "The winds can get gusty out here to 50 miles per hour, In fact, just last week they were clocked at 77 mph, blew the roof off the southern portion of this building here, and landed on the street," Willoughby
He says the weather could make the planned tear down complicated.
Click here to download the ABC7 News App to get your weather forecast and severe weather alerts on the go, and click here for full coverage on El Nino.
What's the weather like #whereyoulive? Share your photos and videos on Twitter, Instagram, or Facebook by tagging them #abc7now. Your photos may be shown online or on-air!