GCP Connector (Google Cloud Storage)

How It Works

Supported Ingestion Modes

Requirements

Data Entities

Replenit requires three core datasets:

1Prepare Data

Datasets should represent the full customer lifecycle and be linkable via identifiers.

Data Format

Supported Formats

• JSON (including nested payloads)
• CSV

Data Flexibility

Replenit supports any data structure:

• Flat tables or nested JSON
• No strict limit on fields
• Additional attributes are allowed

Replenit performs:

Data Structure

gs://your-bucket/customers/
gs://your-bucket/orders/
gs://your-bucket/products/

Suggested Dataset Structure

{
  "identifiers": {
    "userId": 3253833,
    "email": "user@example.com"
  },
  "transaction": {
    "orderId": "12345",
    "orderDate": "2025-01-01T10:00:00Z",
    "totalAmount": 120,
    "currency": "EUR"
  },
  "products": [
    {
      "productId": "SKU-001",
      "price": 60,
      "quantity": 2
    }
  ]
}

{
  "productId": "UMT-U180065",
  "taxonomy": ["Bath", "Care"],
  "brand": "BrandX",
  "price": 49.99,
  "currency": "EUR"
}

Data Relationships

Key Requirements

• customer_id must be consistent across datasets
• product_id must match between orders and products
• Timestamp format should be ISO 8601

Recommended Data Scope

• Up to 24 months of historical data
• Full product catalog
• Complete order history

2Create Service Account

1. 1

   Go to Google Cloud Console → IAM & Admin → Service Accounts

2. 2

   Create a service account

3. 3

   Assign role: Storage Object Viewer

4. 4

   Create JSON key

5. 5

   Download the key file

3Grant Access

Grant access to your bucket:

• Role: Viewer
• Scope: Bucket

4Add Data Source

You can configure your data sources and provide access under the Health & Data Management section in your Replenit panel.

Configuration Fields

5Verify Data Sources

After configuration, verify that:

• All sources are Active
• Correct directories are mapped

6Historical Data Load

1. 1

   Go to Automation Jobs

2. 2

   Start historical job

3. 3

   Select data source

4. 4

   Run

7Ongoing Sync

• Configure daily job
• Enable incremental ingestion

8Monitoring

Expected Timeline

Common Issues

Security

• Service Account JSON authentication
• Read-only access supported
• No modification to source data