Skip to content

Commit c9469e0

Browse files
committed
Combine define and provision and remove errors section
1 parent 01907d8 commit c9469e0

File tree

4 files changed

+37
-45
lines changed

4 files changed

+37
-45
lines changed

content/operate/rc/databases/rdi/_index.md

Lines changed: 1 addition & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -63,7 +63,6 @@ Please be aware of the following limitations:
6363
To create a new data pipeline, you need to:
6464

6565
1. [Prepare your source database]({{<relref "/operate/rc/databases/rdi/setup">}}) and any associated credentials.
66-
2. [Provision data pipeline infrastructure]({{<relref "/operate/rc/databases/rdi/provision">}}) and troubleshoot errors.
67-
3. [Define the data pipeline]({{<relref "/operate/rc/databases/rdi/define">}}) by selecting which tables to sync.
66+
2. [Define the source connection and data pipeline]({{<relref "/operate/rc/databases/rdi/define">}}) by selecting which tables to sync.
6867

6968
Once your data pipeline is defined, you can [view and edit]({{<relref "/operate/rc/databases/rdi/view-edit">}}) it.

content/operate/rc/databases/rdi/define.md

Lines changed: 35 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -5,14 +5,45 @@ categories:
55
- docs
66
- operate
77
- rc
8-
description: Define your data pipeline by selecting which tables to sync.
8+
description: Define your data pipeline
99
hideListLinks: true
10-
weight: 3
10+
weight: 2
1111
---
1212

13-
After you have [provisioned your data pipeline]({{<relref "/operate/rc/databases/rdi/provision">}}), you need to define it. You will select the database schemas and columns that you want to import and synchronize with your primary database.
13+
After you have [prepared your source database]({{<relref "/operate/rc/databases/rdi/setup">}}) and connection information, you can set up your new pipeline. To do this:
1414

15-
## Configure a new pipeline
15+
1. [Define the source connection](#define-source-connection) by entering all required source database information.
16+
2. [Define the data pipeline](#define-data-pipeline) by selecting the data that you want to sync from your source database to the target database.
17+
18+
## Define source connection
19+
20+
1. In the [Redis Cloud console](https://cloud.redis.io/), go to your target database and select the **Data Pipeline** tab.
21+
1. Select **Start pipeline setup**.
22+
1. Enter a **Pipeline name**. This pipeline name will be the prefix to all keys generated by this pipeline in the target database.
23+
1. Enter the **Deployment CIDR** for your pipeline, or use the one generated for you. This CIDR should not conflict with your apps or other databases.
24+
1. In the **Connectivity** section, enter the **PrivateLink service name** of the [PrivateLink connected to your source database]({{< relref "/operate/rc/databases/rdi/setup#set-up-connectivity" >}}).
25+
1. Enter your database details. This depends on your database type, and includes:
26+
- **Port**: The database's port
27+
- **Database**: Your database's name, or the root database *(PostgreSQL, Oracle only)*, or a comma-separated list of one or more databases you want to connect to *(SQL Server only)*
28+
- **Database Server ID**: Unique ID for the replication client. Leave as default if you don't use replication *(mySQL and mariaDB only)*
29+
- **PDB**: Name of the Oracle pluggable database *(Oracle only)*
30+
1. Enter the ARN of your [database credentials secret]({{< relref "/operate/rc/databases/rdi/setup#share-source-database-credentials" >}}) in the **Source database secrets ARN** field.
31+
1. Select **Start pipeline setup**.
32+
1. Redis Cloud will attempt to connect to PrivateLink. Accept the incoming connection on AWS PrivateLink to proceed. See [Accept or Reject PrivateLink connection requests](https://docs.aws.amazon.com/vpc/latest/privatelink/configure-endpoint-service.html#accept-reject-connection-requests).
33+
34+
If Redis Cloud can't find your PrivateLink connection, make sure that the PrivateLink service name is correct and that Redis Cloud is listed as an Allowed Principal for your VPC. See [Set up connectivity]({{<relref "/operate/rc/databases/rdi/setup#set-up-connectivity">}}) for more info.
35+
36+
At this point, Redis Cloud will provision the pipeline infrastructure that will allow you to define your data pipeline.
37+
38+
Pipelines are provisioned in the background. You aren't allowed to make changes to your data pipeline or to your database during provisioning. This process will take a long time, so you can close the window and come back later.
39+
40+
When your pipeline is provisioned, select **Complete setup**. You will then [define your data pipeline]({{<relref "/operate/rc/databases/rdi/define">}}).
41+
42+
## Define data pipeline
43+
44+
After your pipeline is provisioned, you will be able to define your pipeline. You will select the database schemas and columns that you want to import and synchronize with your primary database.
45+
46+
### Configure a new pipeline
1647

1748
1. In the [Redis Cloud console](https://cloud.redis.io/), go to your target database and select the **Data Pipeline** tab. If your pipeline is already provisioned, select **Complete setup** to go to the **Pipeline definition** section.
1849
1. For the **Configure a new pipeline** option, select the Redis data type to write keys to the target. You can choose **Hash** or **JSON**.

content/operate/rc/databases/rdi/provision.md

Lines changed: 0 additions & 38 deletions
This file was deleted.

content/operate/rc/databases/rdi/view-edit.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -7,7 +7,7 @@ categories:
77
- rc
88
description: Edit and observe your data pipeline.
99
hideListLinks: true
10-
weight: 4
10+
weight: 3
1111
---
1212

1313
You can use the **Data pipeline** tab in your database to view and edit it.

0 commit comments

Comments
 (0)