My ex and I have split custody of my daughter but however im the sole custodian i guess you would say in the s?

Do i need to have his permission to move out of state. ALready on our divore agreement he was to get her every friday and bring her home sunday.. so do i go back through the courts. or what