Not sure if this is your issue, but if you are not using a static whitelist, and you are doing device add operations, you need to run database backup after adding the devices, or they may not be in the database when it restarts.
If you do this, you should not have to rejoin when the Conduit restarts.