Well, according to the Bible, the G-d of the Bible does. Commandment number 7 says' "Thou Shalt Not Commit Adultery". Furthermore, Christ says in Matthew, "And I say to you, whoever divorces his wife, except for immorality, and marries another woman commits adultery," (Matt. 19:9). The word in Greek for immorality is porneia from which we get the word pornography. Sexual immorality, i.e., adultery, is a grounds for divorce according to Jesus.
The other justifiable reason for divorce is mentioned Corinthians and that is abandonment: "Yet if the unbelieving one leaves, let him leave; the brother or the sister is not under bondage in such cases, but God has called us to peace," (1 Cor. 7:15).
Nowhere does it say in the Bible that if a spouse stops loving you, cherishing you or showing you affection that you can divorce them. Therefore, if you remarried, you would be committing adultery.
As I said before, all the things you equate with adultery can be overcome. But once a person commits adultery, they have committed it and the only way they will be forgiven is through Christ.