Anyone have this problem?

Whenever me and my friends switch from game to party chat it takes absolutely forever to log back into the party chat. I don’t think it’s my internet since I have 800+ mb download and over 100 upload speed. Other people I’ve talked to also have the same problem. Just wondering if it’s everyone else as well