I haven't read the Revenue Rulings, but §1402(c) says the term "Trade or Business... shall have the same meaning as when used in section 162" (with a few exceptions).

So to me, that means if it a business, it is subject to SE tax; if it is not a §162 business, it is not subject to SE tax.