The Jet Data Manager has the ability to split an INSERT statement up in batches during data cleansing (such as when copying data from the transformation view to the valid table).
This saves log space on the SQL Server which gives you better performance on large tables with millions of rows.
Enabling Batch Data CleansingTo enable batch data cleansing, follow the steps below.
- In your Business Unit or Data Warehouse right-click on the table for which you want to use batch data cleansing and click on Table Settings.
- Click on the Performance tab and select Enable batch data cleansing.
- (Optional) Enter the number of records you would like each batch to contain in Batch size. The default is 100,000.
- Click on OK.