You can't delete currencies that are in use by other records; you can only deactivate them. Deactivating currency records doesn't remove the currency information stored in existing records, such as opportunities or orders. However, you won't be able to select the deactivated currency for new transactions.
Reference: https://docs.microsoft.com/en-us/power-platform/admin/manage-transactions-with-multiple- currencies