Creating the Unified Dataset for Mastering
Working with the unified dataset of a mastering project.
The unified dataset of a mastering project represents the logical entity you wish to master, such as customers, products, contacts, or other entities important to your business. The unified attributes of the dataset are the attributes that best describe this entity across all input datasets.
The unified dataset accomplishes three important tasks for mastering:
- Defines a single schema, across many dissimilar input datasets. This schema is used for processing. See Defining a Single Schema.
- Powers entity resolution by machine learning with attribute-specific configurations. See Configuring Machine Learning.
Creating a Unified Dataset
Once you upload data, you can create your unified dataset.
To Create a Unified Dataset:
- Navigate to the Schema Mapping page.
- On the right side of your screen, in the white box name your unified dataset, then select Create Unified Dataset.
Next Steps
Once you create your unified dataset, you can continue on to schema mapping. To commit changes to the unified dataset, in the top right corner, select Update Unified Dataset.
Important You run the Update Unified Dataset job to apply your changes and view the unified dataset.
After you run Update Unified Dataset for the first time, you can:
- Enable the learned pairs feature for the project
- Add and adjust transformations
- Add and adjust your blocking model iteratively
Defining a Single Schema
The unified dataset defines a single schema across all source datasets. The unified schema is the largest set of attributes common to all input datasets in the project. The task in schema mapping is to map each common source attribute to this single schema.
Profiling Datasets
Profiling is an optional step that you can run at any point in the workflow. Profiling attributes can help you understand the data at multiple points in the project. Profiling a dataset or individual attribute creates derived metadata about a given dataset. Useful metadata includes counts and histograms of distinct values, as well as inferred data types. For more information, see Profiling a Dataset
Configuring Machine Learning
Toggle Inclusion in Machine Learning
To the right of each unified attribute on the Schema Mapping page is a Machine learning attribute that can be de-selected if you do not want that attribute to be included in machine learning. The default setting is for this to be on (and thus used in machine learning). This setting indicates to the model whether to use the unified attribute for training a model. If it is toggled off, then the attribute will be displayed as a column on the records page, but will not be used in machine learning algorithms.
If you change the attributes included in machine learning, you must select Update the Unified Dataset to apply the changes.
Choosing a Tokenizer or Similarity Function
To compare values in a unified attribute when determining potential record matches, Tamr Core uses tokenizers and similarity functions.
To specify a tokenizer or similarity function for a unified attribute:
- Open the Schema Mapping page.
- Locate a unified attribute that is included in machine learning.
- Select More > Advanced.
- Use the dropdown to change the Similarity function.
- Use the dropdown to change the Tokenizer.
Identifying Required Attributes
Configuring the Cluster Name Unified Attribute
This setting allows you to aggregate values for the unified attribute by the most common value in the set of records. The name is defined at project creation to answer, What are you mastering? and can reflect sites, suppliers, or customers.
To configure a unified attribute as the cluster name attribute:
- Select More .
- From the dropdown, choose the cluster identifier. For example, Customer.
Configuring the Spend Unified Attribute
The Spend setting allows you to specify a unified attribute of numeric data type to be aggregated per cluster. This makes it possible to navigate the clusters by Spend.
To configure a unified attribute as Spend:
- Select More .
- From the dropdown, choose Spend.
Configuring User Preferences
Configure Sorting and Searching Preferences
Select More to toggle whether the attribute is treated as a numeric value or a string for sorting and searching purposes.
Updated over 2 years ago