Listen to some interviews/podcasts.
Doesn't necessarily mean we lose them, but he is a huge reason as to why they signed in the first place. How many players around the league have signed because of the coach, and then end up leaving? Quite a few examples.
I'd even guess it's a part of why...