No, you shouldn't swim in the ocean there because of the high waves and rip current (you're right on the tip of Baja where the Sea of Cortez meets the Pacific Ocean, so the ocean is roiling big time). Some people DO swim and skimboard on Solmar Beach, but they are extremely experienced, strong swimmers - or loco. Even though the beach is marked with flags, and staff patrol the beach asking you to stay out of the water, some poor tourist gets caught by a wave every year and gets in BIG trouble.
I thought I'd miss swimming in the ocean, but I don't miss it there. We love watching the massive waves roll up the beach, and seeing whales breach offshore. Swimming in one of several gorgeous infinity pools, or taking a short water taxi ride to Medano Beach, works for our family.
We own several studios at Grand Solmar and use them every year for family get togethers. Most of our brothers and sisters never had a desire to vacation in Mexico, and couldn't figure out why we went to Cabo every year. After one trip, they couldn't wait to go back. We'd be disowned by our families if we didn't bring them down with us! (We alternate years with DH's family and mine now.)