Skip to content

Commit e5d5429

Browse files
authored
Add dashboard crawlers (#3397)
## Changes Add dashboard crawlers and use them: - In the assessment workflow to crawl and persist the dashboards - In the Redash migration to migrate or revert the crawled dashboards - In the QueryLinter to lint the queries of the crawled dashboards ### Linked issues Resolves #3366 Resolves #3367 Progresses #2854 ### Functionality - [x] modified existing command: `databricks labs ucx {migrate-dbsql-dashboards|revert-dbsql-dashboards}` - [x] modified existing workflow: `assessment` ### Tests - [x] added unit tests - [x] added integration tests
1 parent 574aae1 commit e5d5429

File tree

23 files changed

+1933
-654
lines changed

23 files changed

+1933
-654
lines changed

docs/table_persistence.md

Lines changed: 15 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -32,6 +32,8 @@ Table utilization per workflow:
3232
| udfs | RW | RW | RO | | | | |
3333
| logs | RW | | RW | RW | | RW | RW |
3434
| recon_results | | | | | | | RW |
35+
| redash_dashboards | RW | | | | | | RW |
36+
| lakeview_dashboards | RW | | | | | | RW |
3537

3638
**RW** - Read/Write, the job generates or updates the table.<br/>
3739
**RO** - Read Only
@@ -139,3 +141,16 @@ This is used by the permission crawler.
139141
| object_type | string | type of object (NOTEBOOK, DIRECTORY, REPO, FILE, LIBRARY) |
140142
| path | string | full path of the object in the workspace |
141143
| language | string | language of the object (applicable for notebooks only) |
144+
145+
146+
#### _$inventory_.redash_dashboards and _$inventory_.lakeview_dashboards
147+
148+
Holds a list of all Redash or Lakeview dashboards. This is used by the `QueryLinter` and `Redash` migration.
149+
150+
| Column | Datatype | Description | Comments |
151+
|-----------|--------------|---------------------------------------------------------------------------------------------|----------|
152+
| id | string | The ID for this dashboard. | |
153+
| name | string | The title of the dashboard that appears in list views and at the top of the dashboard page. | |
154+
| parent | string | The identifier of the workspace folder containing the object. | |
155+
| query_ids | list[string] | The IDs of the queries referenced by this dashboard. | |
156+
| tags | list[string] | The tags set on this dashboard. | |

0 commit comments

Comments
 (0)