-
Notifications
You must be signed in to change notification settings - Fork 96
Open
Labels
migrate/externalgo/uc/upgrade SYNC EXTERNAL TABLES stepgo/uc/upgrade SYNC EXTERNAL TABLES step
Description
Is there an existing issue for this?
- I have searched the existing issues
Problem statement
Some customers register jdbc tables in their HMS. These tables need to be registered as Lakehouse Federation 'FOREIGN' catalogs within UC (with the appropriate connection). This functionality has not been built into UCX yet. Lakehouse Federation is now Public Preview.
Proposed Solution
Assessment
- Highlight all tables that are jdbc tables.
- Nice to have: parse out the URL to show the database server and database that each table maps to.
- Nice to have: do a test against each table to verify if the underlying table still exists or not.
Mapping Tables
- Allow user to map each jdbc table to a new home in UC
- In UC all of the tables for a particular database will need to reside within a "FOREIGN CATALOG"
- It is possible that the same physical jdbc table is registered multiple times within a HMS and will need to be mapped to a single object within UC
Upgrading Tables
- Manage the database credentials securely into a UC Connection Object
- There could be multiple credentials used in an HMS to connect via JDBC (with varying levels of access). Need to pick one.
- Need to make sure that jobs, queries, and views reference the newly consolidated UC objects in their code
Additional Context
No response
Metadata
Metadata
Assignees
Labels
migrate/externalgo/uc/upgrade SYNC EXTERNAL TABLES stepgo/uc/upgrade SYNC EXTERNAL TABLES step
Type
Projects
Status
No status