Supplier Integration Pipeline

This guide outlines the process for onboarding supplier data, including creating import templates, normalizing data, and resolving conflicts.

Overview

The supplier integration pipeline ensures clean and consistent data ingestion by:

  1. Creating reusable Import Templates.
  2. Automating data ingestion.
  3. Applying Normalization Rules.
  4. Identifying and merging conflicting records.

[navigate:/products|Products|package]

Creating Import Templates

To streamline data onboarding, create a reusable import template for each supplier.

1. Navigate to the entity list (e.g., **Products**).
2. Click the **Import** button in the toolbar.
3. Paste your sample data (JSON or CSV) into the editor.
4. Use the **Configurator** to map source columns to system fields.
5. Click **Save** to store the template.

Automating Imports

Once your template is defined, you can automate the import process.

1. In the **Import Editor**, click the **Save as automation** button.
2. Enter a name for the automation (e.g., "Supplier Import Automation").
3. Click **Save**.

Creating Normalization Rules

Ensure imported data matches your internal standards by creating normalization rules.

1. Navigate to the entity list.
2. Click the **Mass update** button.
3. Select the fields to normalize (e.g., **Status**, **Category**).
4. Enter the desired normalized values.
5. Click **Save as automation**.
6. Name the automation "Normalization Rules" and click **Save**.

Handling Data Conflicts

Identify and resolve duplicates or conflicting data from different suppliers.

1. Create a Conflict Filter

1. Click the **Advanced Filter** button (icon with sliders).
2. Click **Condition** to add a new rule.
3. Select the identifying field (e.g., **External ID**).
4. Set the operator to **is not empty** (or **in list** to check specific IDs).
5. Click **Apply** to view conflicting records.

2. Automate Merge Resolution

1. With the conflict filter active, click **Mass update**.
2. Switch to **AI Mode**.
3. Enter a prompt: "Merge duplicate records based on External ID, keeping the latest update."
4. Click **Generate** to preview the logic.
5. Click **Save as automation** and name it "Merge Conflicts".

**Tip:** Schedule these automations to run sequentially to ensure a fully automated data pipeline.