You say you don't want to get divorced. Do you still love your husband? Because you made vows (I assume) to be faithful and to be with your husband, but you are not being truthful, honest, or faithful.
You need to really think about what you want. Unless you have an open marriage, you need to choose one man or the other.