In My POC, am trying to implement an ETL data flow (star schema) using pig script, As you all know before loading in to fact table i would like to load dimension. Here in dimension i need to load only the new records from source(csv file), I mean records which is not there in dimension(sql server). All joins(skewed,replicate & merge join) in pig are trying to match the existing records and produce only matched records. Can you please tell me how to bring the unmatched record as an output in order to load in to my dimension?
Thanks Selvam