Hi Joesi,
You can't unpublishing default currency, and it is an issue from our end too we will fix this and add a check so no one can disable default currency. Thanks for notifying this issue, we will release this fix in our next release.
As of now if you facing any issue by this let us know, we will fix for you.
Thanks