Agreed. I have never allocated accounting, legal fees or fiduciary fees to tax exempt income. Those relate to the entity itself, not generally to the type of income being earned in the trust.
