Yes, only the taxable amount would be considered an early withdrawal.
The portion they contributed (Box 5) would be non taxable (it was their own after tax money) and not subject to penalty.
