Overview:
The Append tool is used to add variables and/or cases to a dataset. It offers users four main functions: match, merge, master, and look-up.
To explain the functionality of each of the Append features, please consider the following “dummy” datasets.
In set one, we might have something like a CRM database and in Set 2, we might have the results of survey data:
To demonstrate the output from each of the Append tool types, we will use “Customer Email” and “Email” as the variables that are common to each dataset and allow us to match-up the data.
The four Append tool types:
Match – this Append tool type will create a combined file of the respondents who are present in BOTH datasets. It will exclude all of the others who do not match based on the variable that’s common to both datasets.
Merge – this feature will merge the two datasets together and include ALL of the data in both files. This will mean that there are blanks in rows where the data exists in one file and not the other.
Master – this feature will retain all of the data from the first file or “master file” and then bring in only the data from the second file where it can find a match.
Look-up – this Append tool type will look-up matches and merge data into a single row. For example, in our second dataset, email4 took part in two different waves of the same study.
Effectively it does the following:
How to access and use Append:
Overview
Data Operations is a data workflow tool where you can add to, edit, and manipulate your data so that your data tables and variables display the way you need them to in Analysis & Reporting.
Using Data Operations, you can append, match, merge, and split out your data in a number of different ways.
Accessing Data Operations
Step 1: Data Operations can be accessed by clicking the “Add” button at the top of each individual project folder:
Step 2: Once Data Operations is selected, you’ll need to give the file a name and click “Create”
It will then open a blank workflow template for you to work in.
Step 3: Select the tool that you want to use by clicking on either of the “+” signs:
Step 4: Select the tool type that you want to use (Append, Advanced, Match*). *Please note that as of July 2023 the Match tool is not yet available. We will issue a communication when it becomes available.
Step 5: Give the tool a name and, if desired, tag it and/or add a description.
Step 6a: Click on “Input” and select the two datasets that you want to work with:
Step 6b: If required you can filter your datasets on cases that meet your required criteria. To do this, click on the “Select” button next to one or both of the Filter rows:
This will open the filter builder where you can set-up your required filter, by entering the required variable(s) (section 1, in the screen shot below). and answer choice(s) (section 2, in the screen shot below). You have the choice of doing this visually in the Visual section (3, in the screen shot below) or you can edit the filter in the Advanced section (4, in the screen shot below). The View total section (5, in the screen shot below) will tell you the number of cases that will be included in your filter. When you’re finished, click “Save”:
Step 7: Click on “Output” select the location where you want to save your files and give the dataset a name and description (optional). Then click “Create”:
Step 8: select the function type you need, the variables from each set that you want to match on and whether you want to remove duplicates from your data. Then click "Save" and then “Run workflow” (top right):
At the bottom of the screen, you’ll see a message that says “Processing workflow” and when it’s finished, it will pop-up with a messaged that says “Finished processing.”
Both your workflow and new dataset will be in your project folder ready for use:
