I am about to start an affair with my boss...what should I do?

I have a boyfriend. He has a girlfriend. Both of us are in troubled relationships for similar reasons, w2e are both with younger people. He is my direct supervisor at work. My boyfriend lives out of town, and he lives with his girlfriend but they are on a break. I recently had a break with my boyfriend because I a,m trying to figure out what I want and need for myself in my life. A week back, I had a crazy birthday party/night on the town and drank too much. Ended up kissing my boss, who was at the party. My boyfriend lives hours away and never made it up. Fast forward to today. I met with my boss after work and we discussed our feelings and it's true, I have feelings for him. The thing is right after I "cheated" I told my boyfriend and it caused a huge rift between us. He never told his girlfriend, and has no intentions of doing so. He is trying to convince me that we could keep it "our little secret" and that if we feel this way we should see where it goes...and kissed me again to prove his point, that we are very attracted to each other and have been for years. Now comes in my (strong!) conscience. I am caught between trying to mend things with my boyfriend because I do love him but am also scared of what he'll do if I break up with him, and doing what I want and following my feelings for once instead of playing it safe all the time like I usually do. What I am asking, really, is: should I stay with my boyfriend and try to mend our tattered relationship or follow what I feel inside even though I know it's wrong? And should I tell my boyfriend that we met and kissed AGAIN?? I am so lost.