Batch Operation of a Mastering Project

Batch Operation

1. Truncate Dataset: POST /dataset/datasets/{name}/truncate
   Truncate the records of the dataset {name}. This removes all existing records from the dataset.
2. Update Dataset: POST /dataset/datasets/{name}/update
   Update the records of the dataset {name} using the command CREATE. Because of Step 1, all records in this step are effectively inserted. In other words, no updates occur.
3. Update Unified Dataset: POST /projects/{project}/unifiedDataset:refresh
   Update the unified dataset using its associated project's ID. Additionally, capture the id of the operation from the response.
4. Wait For Task: GET /operations/{operationId}
   Poll the storage status of the task submitted in Step 3 using the captured id until state=SUCCEEDED is received.

If the machine learning (ML) configuration has been edited (see Configuring Inclusion in Machine Learning), then proceed to Step 5, else skip to Step 6.
5. Update Recipe using an internal API. Contact Tamr representative for assistance: POST /recipe/recipes/{id}/populate.
6. Generate Record Pairs using an internal API. POST /recipe/recipes/{recipeId}/run/pairs.
Generate record pairs using the pairs {recipeId} and the operation keyword pairs. Additionally, capture the id of the submitted job from the response.
7. Wait For Task: GET /operations/{operationId}
Poll the storage status of the task submitted in Step 6 using the captured id until status=SUCCEEDED is received.
8. Update Results, using an internal API. Contact Tamr representative for assistance: POST /recipe/recipes/{recipeId}/run/trainPredictCluster.
Apply the entity resolution model using its {recipeId} and the operation keyword trainPredictCluster. Additionally, capture the id of the submitted job from the response.
9.Wait For Task: GET /operations/{operationId}
Poll the storage status of the task submitted in Step 8 using the captured id until status=SUCCEEDED is received.
10. Materialize Clusters Dataset: POST /export
Materialize the clusters dataset {datasetId} to a specified export configuration and data format and capture the id of the submitted job from the response.
11. Fetch UUID: GET /job/jobs/{id}
Using the captured id in Step 10, fetch the job details and capture the uuid.
12. Wait For Task: GET /operations/{operationId}
Poll the storage status of the task submitted in Step 11 using the captured id until status=SUCCEEDED is received.
13. Export Dataset: GET /export/read/dataset/{datasetId}
Export the materialized categorized dataset {datasetId}.