0
votes

I am exploring nifi, as of I have created processor group with number of processor which basically select data from Oracle DB and insert in to mongoDB. the the flow works as expected.

The flow is QueryDatabaseTable -> SplitAvro -> ConvertAvorToJson -> PutMongoRecord

In QueryDatabaseTable I have custom query select * from employee, which gives me 100 records and these 100 records inserted into mongoDB. But here issue is QueryDatabaseTable is called again and again, so in result same 100 records are get added in mongoDB again and again. Is there any way to stop this repeated execution? Thanks in advance.

Update: I am using Nifi 1.9.2

PFB QueryDatabaseTable setting tab below

enter image description here Scheduling

enter image description here

Properties

enter image description here enter image description here

Update 2: Configuration

1
please show the parameters you set for QueryDatabaseTable. - daggett
Set the timer not to be zero where it is default value or change the scheduling with cron. - Lamanus
@daggett I have attached the configuration for QueryDatabaseTable - Hitesh Ghuge
@Lamanus Yes I have changed Run Schedule to non-zore value and its works - Hitesh Ghuge

1 Answers

0
votes

Use maximum-value columns if you want to prevent duplicates selection.