Jesus came and died to reconcile us back to God.

Don't follow him to any native doctor.Tell him to go and swear at a shrine that he is not having an affair and that he should swear that if does,he should lose his potency.Tell him to go and do that first.

It's good you have chosen to ignore him.I hope you have a job.Concentrate on yourself more and the kids. Don't let him threaten you.
If you continue to feel frustrated with the marriage,you can separate/take the option of divorce.

You still have years ahead of you.Don't stay in an abusive marriage.