Preprocessing: Move Data
JSON Configuration for move_data
When using the move_data preprocessing step, the following JSON values can be passed:
FromWorkspaceName: (Optional, default=data['ZohoWorkspaceName']) The name of the workspace from which data will be moved. Defaults to the value ofZohoWorkspaceNamein the main data.ToWorkspaceName: (Optional, default=data['ZohoWorkspaceName']) The name of the workspace to which data will be moved. Defaults to the value ofZohoWorkspaceNamein the main data.FromTableName: (Required) The name of the table from which data will be moved. This can be a table, pivot table, SQL, or other view.ToTableName: (Required) The name of the table to which data will be moved.ImportType: (Required) The type of import operation. Possible values includeTRUNCATEADD,APPEND,UPDATEADD,ADD_ONLY,ADD_ONLY(primary_key="Response ID")(requires passingZOHO_MATCHING_COLUMNStoAdditional Parameters), etc.FilterCriteria: (Optional) Criteria to filter the data being moved. Can accept SQL Select statements, for exampleSELECT DISTINCT "Response ID" FROM "Responses". FilterCriteria supports automatic replacements for \<TODAY>\<YESTERDAY> and \<X DAYS AGO>Additional Parameters: (Optional) A JSON string containing additional parameters for the operation, for exampleZOHO_MATCHING_COLUMNSorZOHO_DATE_FORMATfound from Zoho API documentation.
Example JSON Configuration
{
"1": {
"type": "move_data",
"FromWorkspaceName": "SourceWorkspace",
"ToWorkspaceName": "DestinationWorkspace",
"FromTableName": "SourceTable",
"ToTableName": "DestinationTable",
"ImportType": "UPDATEADD",
"FilterCriteria": "\"Department\" = 'Finance'",
"Additional Parameters": "{\"ZOHO_MATCHING_COLUMNS\": \"Survey Invite Code\"}"
}
}