You are correct that this just inactivates the client so they do not show up on your listing of active clients.  To the best of my knowledge, you cannot delete them or I have not found a way to delete.  Intuit Link still has a lot of improvements that can be implemented.