Informal Marriage

You can go to your local court house and sign a form that states that you have an "informal marriage".

Many people do this.  If this is done, then you need to file for divorce.