az disk list doesn't list a disk that definitely exists

[ondrejbudai]

Describe the bug

az disk list doesn't list a disk that definitely exists. I can confirm that by using az disk show. I can see the disk also in a resource group in Azure Portal.

To Reproduce:

az disk show --resource-group sharing-research --name test_disk1_8f9bb5540a564309ab5749c8fce60c96
az disk list --resource-group sharing-research

Logs:

$ az disk show --resource-group sharing-research --name test_disk1_8f9bb5540a564309ab5749c8fce60c96
{
  "burstingEnabled": null,
  "creationData": {
    "createOption": "Copy",
    "galleryImageReference": null,
    "imageReference": null,
    "logicalSectorSize": null,
    "sourceResourceId": "/subscriptions/8d026bb1-2a65-454d-a88f-c896db94c4f8/resourceGroups/sharing-research/providers/Microsoft.Compute/snapshots/test0_0_dqsundlpiwo",
    "sourceUniqueId": "920a5f2e-55c5-4cbf-9fd1-55bf869542e4",
    "sourceUri": null,
    "storageAccountId": null,
    "uploadSizeBytes": null
  },
  "diskAccessId": null,
  "diskIopsReadOnly": null,
  "diskIopsReadWrite": 500,
  "diskMBpsReadOnly": null,
  "diskMBpsReadWrite": 60,
  "diskSizeBytes": 2147483648,
  "diskSizeGb": 2,
  "diskState": "Unattached",
  "encryption": {
    "diskEncryptionSetId": null,
    "type": "EncryptionAtRestWithPlatformKey"
  },
  "encryptionSettingsCollection": null,
  "extendedLocation": null,
  "hyperVGeneration": "V1",
  "id": "/subscriptions/8d026bb1-2a65-454d-a88f-c896db94c4f8/resourceGroups/sharing-research/providers/Microsoft.Compute/disks/test_disk1_8f9bb5540a564309ab5749c8fce60c96",
  "location": "westeurope",
  "managedBy": null,
  "managedByExtended": null,
  "maxShares": null,
  "name": "test_disk1_8f9bb5540a564309ab5749c8fce60c96",
  "networkAccessPolicy": "AllowAll",
  "osType": "Linux",
  "provisioningState": "Succeeded",
  "purchasePlan": null,
  "resourceGroup": "sharing-research",
  "shareInfo": null,
  "sku": {
    "name": "Standard_LRS",
    "tier": "Standard"
  },
  "tags": {},
  "tier": null,
  "timeCreated": "2021-02-26T06:17:56.867885+00:00",
  "type": "Microsoft.Compute/disks",
  "uniqueId": "8f9bb554-0a56-4309-ab57-49c8fce60c96",
  "zones": null
}
$ az disk list --resource-group sharing-research
[]

Logs with --debug: https://gist.github.com/ondrejbudai/ba27559a40a07290b17202f9680f0709

Environment Summary

This is inside Ubuntu container on Fedora:

Linux-5.10.16-200.fc33.x86_64-x86_64-with-debian-bullseye-sid
Python 3.6.10
Installer: DEB

azure-cli 2.19.1

This is on Fedora:

Linux-5.10.16-200.fc33.x86_64-x86_64-with-glibc2.32
Python 3.9.1
Installer: RPM

azure-cli 2.19.1

Both environments have the same issue.

[yungezz]

hi @qwordy could you pls have a look? thanks

[qwordy]

If

azure.core.pipeline.policies._universal: Request URL: 'https://management.azure.com/subscriptions/8d026bb1-2a65-454d-a88f-c896db94c4f8/resourceGroups/sharing-research/providers/Microsoft.Compute/disks/test_disk1_8f9bb5540a564309ab5749c8fce60c96?api-version=2020-09-30'
azure.core.pipeline.policies._universal: Request method: 'GET'

returns the disk, then

azure.core.pipeline.policies._universal: Request URL: 'https://management.azure.com/subscriptions/8d026bb1-2a65-454d-a88f-c896db94c4f8/resourceGroups/sharing-research/providers/Microsoft.Compute/disks?api-version=2020-09-30'
azure.core.pipeline.policies._universal: Request method: 'GET'

should return it.
@ondrejbudai Could you confirm the disk is not deleted after the first call?

[ondrejbudai]

No, the disk is still there. Interestingly, after 3 days, this works as expected, I can see the disk using az disk list.

[ondrejbudai]

I tried it again: I created a new disk and this time, I can see it in az disk list but I cannot see it in az resource list.

Regarding the disk from Friday: I can see it in both az disk list and az resource list now (both didn't show it on Friday).

[qwordy]

@ondrejbudai It acts like a lucky draw according to your description. If it happens again, comment here.

[ondrejbudai]

I've just remembered that I dealt with the same issue like a half year ago when I implemented a test that created an azure VM from an image and then deleted it including all related resources. I used the "resource list" API call directly that time and I had issues that the disk couldn't be found many times (randomly).

I, therefore, suspect that this might be an actual API issue - may I ask you where I can report Azure API issues?

Thanks for the feedback! We are routing this to the appropriate team for follow-up. cc @Drewm3, @avirishuv, @Vaibhav-Agar, @amjads1.

Issue Details

---

Describe the bug

az disk list doesn't list a disk that definitely exists. I can confirm that by using az disk show. I can see the disk also in a resource group in Azure Portal.

To Reproduce:

az disk show --resource-group sharing-research --name test_disk1_8f9bb5540a564309ab5749c8fce60c96
az disk list --resource-group sharing-research

Logs:

$ az disk show --resource-group sharing-research --name test_disk1_8f9bb5540a564309ab5749c8fce60c96
{
  "burstingEnabled": null,
  "creationData": {
    "createOption": "Copy",
    "galleryImageReference": null,
    "imageReference": null,
    "logicalSectorSize": null,
    "sourceResourceId": "/subscriptions/8d026bb1-2a65-454d-a88f-c896db94c4f8/resourceGroups/sharing-research/providers/Microsoft.Compute/snapshots/test0_0_dqsundlpiwo",
    "sourceUniqueId": "920a5f2e-55c5-4cbf-9fd1-55bf869542e4",
    "sourceUri": null,
    "storageAccountId": null,
    "uploadSizeBytes": null
  },
  "diskAccessId": null,
  "diskIopsReadOnly": null,
  "diskIopsReadWrite": 500,
  "diskMBpsReadOnly": null,
  "diskMBpsReadWrite": 60,
  "diskSizeBytes": 2147483648,
  "diskSizeGb": 2,
  "diskState": "Unattached",
  "encryption": {
    "diskEncryptionSetId": null,
    "type": "EncryptionAtRestWithPlatformKey"
  },
  "encryptionSettingsCollection": null,
  "extendedLocation": null,
  "hyperVGeneration": "V1",
  "id": "/subscriptions/8d026bb1-2a65-454d-a88f-c896db94c4f8/resourceGroups/sharing-research/providers/Microsoft.Compute/disks/test_disk1_8f9bb5540a564309ab5749c8fce60c96",
  "location": "westeurope",
  "managedBy": null,
  "managedByExtended": null,
  "maxShares": null,
  "name": "test_disk1_8f9bb5540a564309ab5749c8fce60c96",
  "networkAccessPolicy": "AllowAll",
  "osType": "Linux",
  "provisioningState": "Succeeded",
  "purchasePlan": null,
  "resourceGroup": "sharing-research",
  "shareInfo": null,
  "sku": {
    "name": "Standard_LRS",
    "tier": "Standard"
  },
  "tags": {},
  "tier": null,
  "timeCreated": "2021-02-26T06:17:56.867885+00:00",
  "type": "Microsoft.Compute/disks",
  "uniqueId": "8f9bb554-0a56-4309-ab57-49c8fce60c96",
  "zones": null
}
$ az disk list --resource-group sharing-research
[]

Logs with --debug: https://gist.github.com/ondrejbudai/ba27559a40a07290b17202f9680f0709

Environment Summary

This is inside Ubuntu container on Fedora:

Linux-5.10.16-200.fc33.x86_64-x86_64-with-debian-bullseye-sid
Python 3.6.10
Installer: DEB

azure-cli 2.19.1

This is on Fedora:

Linux-5.10.16-200.fc33.x86_64-x86_64-with-glibc2.32
Python 3.9.1
Installer: RPM

azure-cli 2.19.1

Both environments have the same issue.

Author:	ondrejbudai
Assignees:	qwordy
Labels:	Compute, Service Attention, question
Milestone:	-

[qwordy]

Added a service attention label.
Hi service team, it is reported that https://docs.microsoft.com/en-us/rest/api/resources/resources/list or https://docs.microsoft.com/en-us/rest/api/resources/resources/listbyresourcegroup can't list the expected disk resource. Could you help take a look? @ondrejbudai can provide more details of how to reproduce it.

[amjads1]

@Vaibhav-Agar Can you please look into this issue?