In the S3 data source, if you mark the "Select All" option, it will only collect files that were added or modified since the last successful run of the data source. If you need to recollect older files, you have the following options:
- Deselect the "Select All" option and select the specific file/s that you wish to reload.
- Create a new S3 data source and select the relevant files there. Make sure to configure the new data source exactly the same as the original source (including the destination table and primary key).
- Contact our support team to reset the last successful runtime of that data source to recollect the files that were modified since the selected date as you wish. It can also be configured to recollect all the files. Note that this change is a one time change, and after the next successful run, the data source will return to extract only modified/new files.
Comments
0 comments
Please sign in to leave a comment.