If you need to select additional Salesforce objects when you already have a Salesforce data source that is set to extract the data incrementally, adding these objects to the existing data source definition will not extract the full historical data but instead, it will only pull data since the last successful run of the relevant data source.
In order to extract the historical data for the new objects, we suggested that you follow these steps:
- Create a new Salesforce data source (you will be able to use the same data source in the future for similar cases).
- Set the new data source exactly the same as the ongoing scheduled data source except for the list of selected objects and the incremental key (it should not pull the data incrementally).
- Select the new (needed) objects in both data sources (the scheduled and the new one).
- Run both data sources. The new one will extract the historical data up until now and the scheduled one will pull data for those new objects since its last successful run and will continue doing that based on its schedule.
If you follow these steps in the future for different objects, it is suggested that you deselect the previously selected objects so they will not be pulled again.