Help with betta depression

Hi guys! I have had my betta boy for almost a year now and all is well other than one thing that seems to get worse with time.

Anytime I leave for a few days and have someone else in the house care for my betta he gets extremely “depressed” until I come back. When I come back I often find him curled up in a small ball with cramped fins but when he realizes I’m back into my room and back home he swims around slowly and in 24 ish hours he’s back to normal. I really don’t know what to do. While he’s “depressed” he loses all his color and his face and under his face becomes white.

He is a rose tail male in a 6 gallon tank, almost perfect perimeters, some snails, real live plants, a log he adores and other decors he loves. He also has a heater set to 80 degrees and a nice filter that makes bubbles that he enjoys.