This is incorrect: "will result in a higher amount which I will have to pay tax and early withdrawal penalty on in 2021."

Because you told us this condition: "I have a question about withdrawing Excess contribution to ROTH IRA for tax year 2020"

That is all reported on the 2020 tax return.