0
votes

I'm looking into the best solution of how to sync products (items), invoices, sales orders & customers on a daily basis. I've had other portals that sync almost 1M records in a CSV every night and run flawlessly.

Netsuite offers APIs but they all seem to be riddled with limits, and you're reliant on RESTful calls which I've found are great for a few rows, or updates, but not for when you're trying to get 100K - 1M rows.

I'm leaning towards what has worked with large sets of data and that is:

  • Database connector into NetSuite (eg OBDC)
  • CSV Export (somehow... I heard you can do saved searches - eg create "all customers" search, and then automate this search every night to export to a CSV)

Any help appreciated. All the NetSuite APIs look good, but I just don't see how they can handle daily sets of such large data reliably, and without hitting limits, timeouts or any of that.


EDIT 1: I have read here that some people pay for the (expensive) SuiteAnalytics Connect add-on module and got ODBC connection access to their data.

They also say you can probably do this through RESTlets and SuiteTalk but large data just won't be reliable I don't believe.

EDIT 2: Schedule saved search which sends CSV as attachment here and Place CSV in File Cabinet folder. From external server call webservices or RESTlet to grab new CSV files in the folder.

EDIT 3: NetSuite Migrations

EDIT 4: netsuite suitescript 2.0 export(csv)

1

1 Answers

1
votes

I wrote a tool for pushing csv’s from saved searches to S3. See bundle 271853 or https://github.com/DeepChannel/netsuite-savedsearch-s3

It can trigger and then transfer very large results.

Once you have the data out you can use faster ETL tools to load the data into your BI system