"They are brothers."

And because he bosses around his brother, that relationship extends to you.

"because I did not return his call last week to tell him if I was done yet."

Answer: "Every time you contact me, it interrupts the work and delays that return even further. It will be done on time, and that won't change just because you keep calling."