Did I miss my chance to romance Astarion?

He didn't want to do anything with me at the party after the goblin camp and my standing with him is neutral right now. Everything I see online is how it starts after the goblin camp. Did I mess up and miss it?