I have a workflow that generates around 10k json files, im using a bash script which uses curl to post these json to Splunk as an event.
Each post request take time, is there an efficient way to post these 10k json to splunk endpoint ?
I had these 10k value in one single json file but due to limitation of Splunk (splunk can only handle a number of characters that json has around 1,2milion character ), so suggested to split it and make each value in that json as a new json so splunk can handle it as separate event, so i end up generating 10k json.
Any ideas?