"How does the software "know" to reduce the taxable distribution from the Roth?"

Have you confirmed all the dates are right?

Any nondeductible Trad IRA contribution is Basis. When you distribute or convert anything from Trad IRA, if there also is Basis, the distribution or conversion is Prorated for tax purposes.

Make sure everything is assigned to the proper year.