I created a test copy pipeline in azure data factory which basically reads 2 sample rows from a text file in azure blob storage and loads it into a table in Azure sql database, the run was successful.
However no records were inserted into the table. The source file is only 34 bytes, i read the minimum block size for azure blob storage is 64KB, could it because my test file is too small that azure failed to read it even though the pipeline ran successfully?
could it because my test file is too small that azure failed to read it even though the pipeline ran successfully?
I believe this is not related to the file size because i did test with single row and it works fine for me.
Please try following suggestions:
1.Check the configuration of sink dataset if it is the exactly what you want.
2.Check the preview the data of source dataset if it is correct.
3.Check the monitor log of your pipeline, especially the input size and output size.
4.Try to configure another sink dataset, for example blob storage, to check if the data could be transferred into blob storage sucessfully.
If you have other concern, please feel free to let me know.
