Azure Datafactory can't handle empty json array in blob

1
votes

in azure data factory dataset, using the copy activity to load json blob to sqldb, when the json blob is an empty array "[]" the copy activity gets stuck with error.

{
    "errorCode": "2200",
    "message": "Failure happened on 'Source' side. ErrorCode=UserErrorTypeInSchemaTableNotSupported,'Type=Microsoft.DataTransfer.Common.Shared.HybridDeliveryException,Message=Failed to get the type from schema table. This could be caused by missing Sql Server System CLR Types.,Source=Microsoft.DataTransfer.ClientLibrary,''Type=System.InvalidCastException,Message=Unable to cast object of type 'System.DBNull' to type 'System.Type'.,Source=Microsoft.DataTransfer.ClientLibrary,'",
    "failureType": "UserError",
    "target": "BP_acctset_Blob2SQL",
    "details": []
}
1
azureetlazure-data-factoryazure-data-factory-2azure-data-factory-pipeline
Can you add a Get MetaData activity and get the size of the json file, then you juge if the size > 2 to exec the following copy activity? - Joseph Xu
Hi, @WindRider. If my answer is helpful for you, please accept(mark) it as answer. This can be beneficial to other community members. - Joseph Xu

1 Answers

0
votes

  1. Use Get Metadata to get the file size. enter image description here

  2. Use if condition to juge if the size is greater than 2. If true then exec copy activity. enter image description here