You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: content/operate/rc/databases/rdi/define.md
+35-4Lines changed: 35 additions & 4 deletions
Original file line number
Diff line number
Diff line change
@@ -5,14 +5,45 @@ categories:
5
5
- docs
6
6
- operate
7
7
- rc
8
-
description: Define your data pipeline by selecting which tables to sync.
8
+
description: Define your data pipeline
9
9
hideListLinks: true
10
-
weight: 3
10
+
weight: 2
11
11
---
12
12
13
-
After you have [provisioned your data pipeline]({{<relref "/operate/rc/databases/rdi/provision">}}), you need to define it. You will select the database schemas and columns that you want to import and synchronize with your primary database.
13
+
After you have [prepared your source database]({{<relref "/operate/rc/databases/rdi/setup">}})and connection information, you can set up your new pipeline. To do this:
14
14
15
-
## Configure a new pipeline
15
+
1.[Define the source connection](#define-source-connection) by entering all required source database information.
16
+
2.[Define the data pipeline](#define-data-pipeline) by selecting the data that you want to sync from your source database to the target database.
17
+
18
+
## Define source connection
19
+
20
+
1. In the [Redis Cloud console](https://cloud.redis.io/), go to your target database and select the **Data Pipeline** tab.
21
+
1. Select **Start pipeline setup**.
22
+
1. Enter a **Pipeline name**. This pipeline name will be the prefix to all keys generated by this pipeline in the target database.
23
+
1. Enter the **Deployment CIDR** for your pipeline, or use the one generated for you. This CIDR should not conflict with your apps or other databases.
24
+
1. In the **Connectivity** section, enter the **PrivateLink service name** of the [PrivateLink connected to your source database]({{< relref "/operate/rc/databases/rdi/setup#set-up-connectivity" >}}).
25
+
1. Enter your database details. This depends on your database type, and includes:
26
+
-**Port**: The database's port
27
+
-**Database**: Your database's name, or the root database *(PostgreSQL, Oracle only)*, or a comma-separated list of one or more databases you want to connect to *(SQL Server only)*
28
+
-**Database Server ID**: Unique ID for the replication client. Leave as default if you don't use replication *(mySQL and mariaDB only)*
29
+
-**PDB**: Name of the Oracle pluggable database *(Oracle only)*
30
+
1. Enter the ARN of your [database credentials secret]({{< relref "/operate/rc/databases/rdi/setup#share-source-database-credentials" >}}) in the **Source database secrets ARN** field.
31
+
1. Select **Start pipeline setup**.
32
+
1. Redis Cloud will attempt to connect to PrivateLink. Accept the incoming connection on AWS PrivateLink to proceed. See [Accept or Reject PrivateLink connection requests](https://docs.aws.amazon.com/vpc/latest/privatelink/configure-endpoint-service.html#accept-reject-connection-requests).
33
+
34
+
If Redis Cloud can't find your PrivateLink connection, make sure that the PrivateLink service name is correct and that Redis Cloud is listed as an Allowed Principal for your VPC. See [Set up connectivity]({{<relref "/operate/rc/databases/rdi/setup#set-up-connectivity">}}) for more info.
35
+
36
+
At this point, Redis Cloud will provision the pipeline infrastructure that will allow you to define your data pipeline.
37
+
38
+
Pipelines are provisioned in the background. You aren't allowed to make changes to your data pipeline or to your database during provisioning. This process will take a long time, so you can close the window and come back later.
39
+
40
+
When your pipeline is provisioned, select **Complete setup**. You will then [define your data pipeline]({{<relref "/operate/rc/databases/rdi/define">}}).
41
+
42
+
## Define data pipeline
43
+
44
+
After your pipeline is provisioned, you will be able to define your pipeline. You will select the database schemas and columns that you want to import and synchronize with your primary database.
45
+
46
+
### Configure a new pipeline
16
47
17
48
1. In the [Redis Cloud console](https://cloud.redis.io/), go to your target database and select the **Data Pipeline** tab. If your pipeline is already provisioned, select **Complete setup** to go to the **Pipeline definition** section.
18
49
1. For the **Configure a new pipeline** option, select the Redis data type to write keys to the target. You can choose **Hash** or **JSON**.
0 commit comments