I guess there is 2 scenarios for an affiliate.
1) HGVC no longer wants the contract at the affliate and drops their management arrangement. This has yet to happened within HGVC. But it has happened at Marriott.
OR
2) The Affiliate POA no longer want HGVC as the management company and the POA fires them. This has not happened at HGVC or Marriott that I am aware of, but it has happened plenty of times with other management companies, Peppertree, Equivest, Wyndham, VRI, Berkley Group/Daily Management etc etc etc..
If the management company is HGVC and they are making money from the property and the property is being maintained and funded adequately then there is no reason to have the property dropped. HGVC Management is making money off the POA, and they want to stop this because......?
It is just rumor. Likely because this is the only situation where an Affiliate and an HGVC specific build are side by side. The Bay Club actually sold all the land the HGVC is built on to them, so perhaps there is some agreement in the sale to keep the Bay Club as an affiliate as part of the deal.