How to bulk insert using Spring-Batch?

Question

I'm using spring-batch and spring-data-jpa to read large csv data files and persist (or update existing) entries to a postgresql db using hibernate.

How do I have to configure spring to make using of batch/bulk inserts?

When I configure the job step, I set the chunk size accordingly:

StepBuilderFactory step;
step.chunk(10000).reader(csvReader).writer(jpaItemWriter).build();

Do I further have to be concerned about the hibernate.jdbc.batch_size property? Do I have to also set it, maybe to the same size as the chunk size?

I have been doing some research with the batch insert for some times. But with my limited information i can say that. You can actually send a set of Query together. But not a query will a set of information together. ie; there will be multiple insert query but the turnaround time will be less. — Dileep

vikeng21 vikeng21 · Accepted Answer · 2014-12-11T12:20:35

When you set the chunk size then your reader will send data to the writer in specified chunks. so the chunk size is what governs the actual batch update to the db in spring batch.

I don't think batch_size matters as you have already setup your job for a specific chunk size for a particular step.

How to bulk insert using Spring-Batch?

2 Answers