You are charged for public IP addresses. Therefore, deleting unused public IP addresses will reduce the Azure costs. References: https://docs.microsoft.com/en-us/azure/advisor/advisor-cost-recommendations#reduce-costs-by-deleting-or-reconfiguring-idle-virtual-network-gateways