Describe the bug
When using the commands az datafactory pipeline list to return a list of the pipelines associated with an Azure Data Factory the command will return a JSON parser error when there are a large number of pipelines associated with the data factory.
Related command
az datafactory pipeline list
Errors
InnerException : False
Exception : Microsoft.Rest.SerializationException: Unable to deserialize the response.
---> Newtonsoft.Json.JsonReaderException: Error reading boolean. Unexpected token: StartObject. Path 'enablePartitionDiscovery', line 11090, position 63.
at Newtonsoft.Json.JsonReader.ReadAsBoolean()
at Newtonsoft.Json.JsonReader.ReadForType(JsonContract contract, Boolean hasConverter)
at Newtonsoft.Json.Serialization.JsonSerializerInternalReader.Deserialize(JsonReader reader, Type objectType,
Issue script & Debug output
az datafactory pipeline list
Expected behavior
JSON response
Environment Summary
azure-cli: 2.52.0
azure-cli-core: 2.52.0
azure-cli-telemetry: 1.1.0
extensions:
account: 0.2.5
aks-preview: 0.5.156
azure-devops: 0.26.0
containerapp: 0.3.39
datafactory: 0.7.0
devcenter: 2.0.0
resource-graph: 2.1.0
Additional context
This appears to be because the command does not properly handle the situation where the underlying REST API response is paginated. To test this you can use az rest and note that the API returns only part of the data and indicated that there is more to follow.
Describe the bug
When using the commands az datafactory pipeline list to return a list of the pipelines associated with an Azure Data Factory the command will return a JSON parser error when there are a large number of pipelines associated with the data factory.
Related command
az datafactory pipeline list
Errors
InnerException : False
Exception : Microsoft.Rest.SerializationException: Unable to deserialize the response.
---> Newtonsoft.Json.JsonReaderException: Error reading boolean. Unexpected token: StartObject. Path 'enablePartitionDiscovery', line 11090, position 63.
at Newtonsoft.Json.JsonReader.ReadAsBoolean()
at Newtonsoft.Json.JsonReader.ReadForType(JsonContract contract, Boolean hasConverter)
at Newtonsoft.Json.Serialization.JsonSerializerInternalReader.Deserialize(JsonReader reader, Type objectType,
Issue script & Debug output
az datafactory pipeline list
Expected behavior
JSON response
Environment Summary
azure-cli: 2.52.0
azure-cli-core: 2.52.0
azure-cli-telemetry: 1.1.0
extensions:
account: 0.2.5
aks-preview: 0.5.156
azure-devops: 0.26.0
containerapp: 0.3.39
datafactory: 0.7.0
devcenter: 2.0.0
resource-graph: 2.1.0
Additional context
This appears to be because the command does not properly handle the situation where the underlying REST API response is paginated. To test this you can use az rest and note that the API returns only part of the data and indicated that there is more to follow.