You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: content/rdi/installation/adding-tables-to-existing-pipeline.md
+67-6Lines changed: 67 additions & 6 deletions
Original file line number
Diff line number
Diff line change
@@ -5,7 +5,7 @@ description: Set up and use Debezium to add additional tables to an existing pip
5
5
weight: 80
6
6
alwaysopen: false
7
7
categories: ["redis-di"]
8
-
aliases:
8
+
aliases:
9
9
---
10
10
11
11
If you want to add a new table to a pipeline that is already in streaming (CDC) mode, you can do so without resetting Debezium Server and executing a new full snapshot. In Debezium, this is called incremental snapshot and it is performed using a table on the source database as the interface with the Debezium connector.
@@ -114,14 +114,75 @@ The data-collections array lists tables by their fully-qualified names, using th
-`@source_name` - Specifies the name of the table that you want to capture.
126
126
-`@role_name` - Specifies a role MyRole to which you can add users to whom you want to grant SELECT permission on the captured columns of the source table. Users in the sysadmin or db_owner role also have access to the specified change tables. Set the value of @role_name to NULL, to allow only members in the sysadmin or db_owner to have full access to captured information.
127
127
-`@filegroup_name` - Specifies the filegroup where SQL Server places the change table for the captured table. The named filegroup must be already exist. It is best not to locate change tables in the same filegroup that you use for source tables.
128
+
129
+
## Example for Adding a Signaling Table for Oracle Database
130
+
131
+
1. Creating a signaling table `DEBEZIUM_SIGNAL`:
132
+
133
+
```sql
134
+
CREATETABLEDEBEZIUM_SIGNAL
135
+
(
136
+
id VARCHAR(42) PRIMARY KEY,
137
+
type VARCHAR(32) NOT NULL,
138
+
data VARCHAR(2048) NULL
139
+
);
140
+
```
141
+
142
+
2. Adding the property `debezium.source.signal.data.collection` to the `application.properties` file:
> Note: The property `debezium.source.signal.data.collection` should be set to the fully qualified name of the table. In `Oracle`, the fully qualified name includes the schema name `C##DBZUSER` and the database name `ORCLPDB1`.
149
+
150
+
3. Enable supplemental logging for the `DEBEZIUM_SIGNAL` table:
151
+
152
+
```
153
+
ALTER table c##dbzuser.DEBEZIUM_SIGNAL add SUPPLEMENTAL LOG DATA(ALL) COLUMNS;
154
+
```
155
+
156
+
> Note: If the supplemental logging is enabled for the entire database you can skip this step.
157
+
158
+
4. Restart the Debezium Server
159
+
160
+
## Example for Adding the EMP table to the pipeline
161
+
162
+
1. Add the `EMP` table to the `debezium.source.table.include.list` property in the `application.properties` file:
163
+
164
+
```properties
165
+
debezium.source.table.include.list=C##DBZUSER.EMP
166
+
```
167
+
168
+
2. Enable supplemental logging for the `EMP`` table:
169
+
170
+
To enable supplemental logging for all the table columns:
0 commit comments