Will there ever be a way to remove the ledger device as the controller of the neuron back to the II anchor?
Currently my main neuron is controlled by a ledger device and with the ledger team decommissioning older devices I would feel safer if my neuron was no longer controlled by the device and instead moved back to the original state.
Ledger controlled neuron is controlled by ledger controlled principal. Thats why they have a different principal.
Its effectively a completely different principal. Also why you add your main account as a hotkey to your ledger controlled neuron so it can do stuff like vote.
Maybe you could try use your ledger seedphrase to generate .pem file and use something like GitHub - dfinity/quill: Governance & ledger toolkit for cold wallets
I think it would generate same principal not sure, correct me if im wrong.
That or submit proposal to allow staked neuron transfers, 
.