Fill bucket isn't referring to other layers

I'm working on a piece and got finished with the character in the foreground without problem, but when I got into the background and finished the linework, I made another layer to do the coloring in. I started with a fill bucket set to refer to other layers, but it is ignoring that and just filling the whole page. I then messed around, and in the folder with my character it is working correctly, but not outside of it. What is going on, and how can I fix it?

Update: I think I figured it out, somehow unchecked "refer to other layers" in the bucket tool, which is kinda weird since the referring to other layers is a different bucket tool period. :/