@Hoppis, Jared I hope you are doing well,
Just Wait for Soft Delete retention to expire Even if you can’t access the vault, after the retention period ends, Azure will permanently purge it. For Recovery Services vaults, the period is usually 14 days for backups and 90 days for some workloads.
See algo https://learn.microsoft.com/en-us/azure/storage/blobs/soft-delete-blob-overview
😊 If my answer helped you resolve your issue, please consider marking it as the correct answer. This helps others in the community find solutions more easily. Thanks!