There are several ways to move data:

[hasibaakterss3309]

Upload via REST API – interface for data exchange between programs. Both SF and B24 can exchange packages via API. It is complicated and slow for large volumes.

Uploading to an intermediate database in SQL. Fast, convenient, you can upload any sets, but requires access to the database. SF does not provide access to the databases and the databases themselves.

Unloading data into a CSV file and then loading it into another system.

When we moved on to the task of transferring egypt mobile database data from SF to B24, we first tried to load large data in its entirety, in one .csv.


For correct import, preliminary data cleaning using special libraries may be required;

slow if the file size is large. If the .csv has hundreds of thousands or millions of lines, then such an operation, due to reading the CSV line by line and in one thread, takes too much time (tens of hours);

the process memory is not released after each iteration, in fact the memory leaks n-times faster.

In the end, we wrote our own import library – iv/parallel, which solved most of the problems voiced. But, in the opinion of our idealistic developer, the solution is “still so-so”.