profiler documentation

[sundarshankar89]

Changes

What does this PR do?

Adds documentation about profilers

• Source Pre-requisites
• Configuration Process
• Execution Process

Relevant implementation details

Pre-req

Caveats/things to watch out for when reviewing:

Linked issues

Resolves #..

Functionality

• added relevant user documentation
• added new CLI command
• modified existing command: databricks labs lakebridge ...
• ... +add your own

Tests

• manually tested
• added unit tests
• added integration tests

[github-actions]

✅ 46/46 passed, 7 flaky, 3m4s total

Flaky tests:

• 🤪 test_validate_non_empty_tables (17ms)
• 🤪 test_transpiles_informatica_to_sparksql_non_interactive[False] (13.274s)
• 🤪 test_transpile_teradata_sql_non_interactive[False] (16.005s)
• 🤪 test_transpile_teradata_sql (16.851s)
• 🤪 test_transpile_teradata_sql_non_interactive[True] (7.386s)
• 🤪 test_transpiles_informatica_to_sparksql_non_interactive[True] (8.209s)
• 🤪 test_transpiles_informatica_to_sparksql (9.289s)

_{Running from acceptance #2784}

[gueniai]

We need to add docs for deploying the local dashboard as well.

The section of "The profiler will" should be more prominent, customers will have questions regarding runtimes, impact to their system, and probably some details about the output.

[sundarshankar89]

We need to add docs for deploying the local dashboard as well.

The section of "The profiler will" should be more prominent, customers will have questions regarding runtimes, impact to their system, and probably some details about the output.

That portion is still in development, can we iterate on that once @goodwillpunning is finished withat that?

[gueniai]

Yes, of course, but that will be done before we release the docs, this was just a note so that we don't forget to add functionality too before merging this branch

[codecov]

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 64.87%. Comparing base (7be6421) to head (f02adb7).

Additional details and impacted files

@@           Coverage Diff           @@
##             main    #2098   +/-   ##
=======================================
  Coverage   64.87%   64.87%           
=======================================
  Files          96       96           
  Lines        7895     7895           
  Branches      821      821           
=======================================
  Hits         5122     5122           
  Misses       2593     2593           
  Partials      180      180           

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:

• ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.