"but withdrawal of contributions should still be nontaxable"

Regular 401(k) or Roth 401(k)? I don't think 401(k) has ordering rules.

"even before we get to the QDRO."

I would say QDRO is the first consideration. Was it rolled into a qualified account for the other party?