4. All armed action or repressive measures of all kinds directed against dependent peoples shall cease in order to enable them to exercise peacefully and freely their right to complete independence, and
the integrity of their national territory shall be respected.
5. Immediate steps shall be taken, in Trust and Non-Self-Governing Territories or all other territories which have not yet attained independence,
to transfer all powers to the peoples of those territories, without any conditions or reservations, in accordance with their freely expressed will and desire, without any distinction as to race, creed or colour, in order to enable them to enjoy complete independence and freedom.
The United Nations and Decolonization - Declaration
Of course other international law would be in place like it would be illegal to expel any of the legal residents of the territory.