Data Factory - append fields to JSON sink

Question

I am using the copy activity to copy/transform a JSON source dataset into JSON sink dataset. Need to append a few audit fields to the output - such as transform date using @utcnow expression function.

How can this be accomplished?

For clarity, you only need to modify the JSON by adding the audit fields. You're don't need to append the JSON content to an existing JSON instance. Right? — Johns-305

Peter K Peter K · Accepted Answer · 2018-08-17T14:01:51

It looks like the databricks activity handles this functionality pretty well.

df_new = df.select("table.field1","table.field2","table.field3").withColumn("TransferDate", current_timestamp())

Data Factory - append fields to JSON sink

1 Answers