I'm bi-curious in a straight relationship. Should I experiment?

So I (27F) realized I find women attractive about 3 years into my first and current serious relationship. My partner (27M) has been very supportive about it and gave me the green light when it came to kissing, hook-ups, whatever it is I need to do to figure out where I stand.

He brought it up a couple times, most recently today, saying that I should go for it while I'm still young. I agree to a degree. I am an anxious person and an overthinker. On one hand I really want to try having sex with a woman to see what it's like, on the other my thoughts just paralize me.

What if I find out I'm actually gay? I am comfortable with coming out to my friends but not my family. Then again, I find plenty of guys attractive and I enjoy sex with men. What if this ends my 8-year happy relationship? What if someone finds my dating app profile? Someone I don't want to know. What if I won't be able to stop after one hook-up? What then? Wouldn't it be better to live in blissful ignorance and keep my happy relationship?

I know my man finds that thought of me hooking up with another woman hot and I don't mind that at all. Just to be clear here, I don't care, I don't mind sharing details with him about that if it were to happen, and I don't care if he thinks about that when he jerks off.

I'd really appreciate any and all advice/experiences/opinions. Thanks!