[FEATURE]: Allow Table Types to be Upgrade to Managed Delta Tables

[pohlposition]

Is there an existing issue for this?

• I have searched the existing issues

Problem statement

Customers are using the UC Upgrade as an opportunity to upgrade their tables to Managed Tables [from external tables] to take advantage of features like Predictive Optimization.

Some of these tables are regular parquet tables, so upgrading to Managed Tables provides all the benefits of Delta Tables too.

Proposed Solution

1. Include the ability to specify in the table mapping if the table will be upgraded to a managed table or not
2. If true, then perform the necessary data migration into a managed [delta] table
3. Use this mapping config to drive linting on any ETL code that might be overriding the format of the table upon write.

Things to consider:

1. Should we support only certain formats (external delta, parquet) or any kind of format (orc, csv, etc.)

Additional Context

if a customer is set on using this upgrade to better organize their data estate, the not supporting this functionality may be a reason to develop custom scripts; rather than use UCX.