Visiting CA isn't the same as "went to the main office, and that is 3 weeks of work in CA."

"Remember, the income sourcing is determined by the location where the employee services are actually performed, not the location of the employer. A nonresident programmer who monitors and upgrades satellite dish software for a Los Angeles-based media company, all while sitting comfortably in front of his computer in his Austin, Texas condo, doesn’t earn California-source income and doesn’t have to pay California income taxes, as long as the work is performed outside of California."

From: https://www.palmspringstaxandtrustlawyers.com/nonresidents-working-remotely-for-california-businesse...