Update databricks-sdk requirement from <0.41,>=0.40 to >=0.40,<0.42 (#3553)

Updates the requirements on
[databricks-sdk](https://github.com/databricks/databricks-sdk-py) to
permit the latest version.
<details>
<summary>Release notes</summary>
<p><em>Sourced from <a
href="https://github.com/databricks/databricks-sdk-py/releases">databricks-sdk's
releases</a>.</em></p>
<blockquote>
<h2>v0.41.0</h2>
<h3>New Features and Improvements</h3>
<ul>
<li>Add <code>serving.http_request</code> to call external functions.
(<a
href="https://redirect.github.com/databricks/databricks-sdk-py/pull/857">#857</a>).</li>
<li>Files API client: recover on download failures (<a
href="https://redirect.github.com/databricks/databricks-sdk-py/pull/844">#844</a>)
(<a
href="https://redirect.github.com/databricks/databricks-sdk-py/pull/845">#845</a>).</li>
</ul>
<h3>Bug Fixes</h3>
<ul>
<li>Properly pass query parameters in apps and oauth2 (<a
href="https://redirect.github.com/databricks/databricks-sdk-py/pull/862">#862</a>).</li>
</ul>
<h3>Internal Changes</h3>
<ul>
<li>Add unit tests for external-browser authentication (<a
href="https://redirect.github.com/databricks/databricks-sdk-py/pull/863">#863</a>).</li>
<li>Decouple oauth2 and serving (<a
href="https://redirect.github.com/databricks/databricks-sdk-py/pull/855">#855</a>).</li>
<li>Migrate workflows that need write access to use hosted runners (<a
href="https://redirect.github.com/databricks/databricks-sdk-py/pull/850">#850</a>).</li>
<li>Stop testing Python 3.7 on Ubuntu (<a
href="https://redirect.github.com/databricks/databricks-sdk-py/pull/858">#858</a>).</li>
</ul>
<h3>API Changes:</h3>
<ul>
<li>Added <a
href="https://databricks-sdk-py.readthedocs.io/en/latest/workspace/access_control.html">w.access_control</a>
workspace-level service.</li>
<li>Added <code>http_request()</code> method for <a
href="https://databricks-sdk-py.readthedocs.io/en/latest/workspace/serving_endpoints.html">w.serving_endpoints</a>
workspace-level service.</li>
<li>Added <code>no_compute</code> field for
<code>databricks.sdk.service.apps.CreateAppRequest</code>.</li>
<li>Added <code>has_more</code> field for
<code>databricks.sdk.service.jobs.BaseJob</code>.</li>
<li>Added <code>has_more</code> field for
<code>databricks.sdk.service.jobs.BaseRun</code>.</li>
<li>Added <code>page_token</code> field for
<code>databricks.sdk.service.jobs.GetJobRequest</code>.</li>
<li>Added <code>has_more</code> and <code>next_page_token</code> fields
for <code>databricks.sdk.service.jobs.Job</code>.</li>
<li>Added <code>has_more</code> field for
<code>databricks.sdk.service.jobs.Run</code>.</li>
<li>Added <code>clean_rooms_notebook_output</code> field for
<code>databricks.sdk.service.jobs.RunOutput</code>.</li>
<li>Added <code>scopes</code> field for
<code>databricks.sdk.service.oauth2.UpdateCustomAppIntegration</code>.</li>
<li>Added <code>run_as</code> field for
<code>databricks.sdk.service.pipelines.CreatePipeline</code>.</li>
<li>Added <code>run_as</code> field for
<code>databricks.sdk.service.pipelines.EditPipeline</code>.</li>
<li>Added <code>authorization_details</code> and
<code>endpoint_url</code> fields for
<code>databricks.sdk.service.serving.DataPlaneInfo</code>.</li>
<li>Added <code>contents</code> field for
<code>databricks.sdk.service.serving.GetOpenApiResponse</code>.</li>
<li>Added <code>activated</code>, <code>activation_url</code>,
<code>authentication_type</code>, <code>cloud</code>,
<code>comment</code>, <code>created_at</code>, <code>created_by</code>,
<code>data_recipient_global_metastore_id</code>,
<code>ip_access_list</code>, <code>metastore_id</code>,
<code>name</code>, <code>owner</code>, <code>properties_kvpairs</code>,
<code>region</code>, <code>sharing_code</code>, <code>tokens</code>,
<code>updated_at</code> and <code>updated_by</code> fields for
<code>databricks.sdk.service.sharing.RecipientInfo</code>.</li>
<li>Added <code>expiration_time</code> field for
<code>databricks.sdk.service.sharing.RecipientInfo</code>.</li>
<li>Added .</li>
<li>Added .</li>
<li>Added , ,  and .</li>
<li>Added .</li>
<li>Added , , ,  and .</li>
<li>Changed <code>update()</code> method for <a
href="https://databricks-sdk-py.readthedocs.io/en/latest/account/account_federation_policy.html">a.account_federation_policy</a>
account-level service with new required argument order.</li>
<li>Changed <code>update()</code> method for <a
href="https://databricks-sdk-py.readthedocs.io/en/latest/account/service_principal_federation_policy.html">a.service_principal_federation_policy</a>
account-level service with new required argument order.</li>
<li>Changed <code>update()</code> method for <a
href="https://databricks-sdk-py.readthedocs.io/en/latest/workspace/recipients.html">w.recipients</a>
workspace-level service to return
<code>databricks.sdk.service.sharing.RecipientInfo</code>
dataclass.</li>
<li>Changed <code>update()</code> method for <a
href="https://databricks-sdk-py.readthedocs.io/en/latest/workspace/recipients.html">w.recipients</a>
workspace-level service return type to become non-empty.</li>
<li>Changed <code>update()</code> method for <a
href="https://databricks-sdk-py.readthedocs.io/en/latest/workspace/recipients.html">w.recipients</a>
workspace-level service to type <code>update()</code> method for <a
href="https://databricks-sdk-py.readthedocs.io/en/latest/workspace/recipients.html">w.recipients</a>
workspace-level service.</li>
<li>Changed <code>get_open_api()</code> method for <a
href="https://databricks-sdk-py.readthedocs.io/en/latest/workspace/serving_endpoints.html">w.serving_endpoints</a>
workspace-level service return type to become non-empty.</li>
</ul>
<!-- raw HTML omitted -->
</blockquote>
<p>... (truncated)</p>
</details>
<details>
<summary>Changelog</summary>
<p><em>Sourced from <a
href="https://github.com/databricks/databricks-sdk-py/blob/main/CHANGELOG.md">databricks-sdk's
changelog</a>.</em></p>
<blockquote>
<h2>[Release] Release v0.41.0</h2>
<h3>New Features and Improvements</h3>
<ul>
<li>Add <code>serving.http_request</code> to call external functions.
(<a
href="https://redirect.github.com/databricks/databricks-sdk-py/pull/857">#857</a>).</li>
<li>Files API client: recover on download failures (<a
href="https://redirect.github.com/databricks/databricks-sdk-py/pull/844">#844</a>)
(<a
href="https://redirect.github.com/databricks/databricks-sdk-py/pull/845">#845</a>).</li>
</ul>
<h3>Bug Fixes</h3>
<ul>
<li>Properly pass query parameters in apps and oauth2 (<a
href="https://redirect.github.com/databricks/databricks-sdk-py/pull/862">#862</a>).</li>
</ul>
<h3>Internal Changes</h3>
<ul>
<li>Add unit tests for external-browser authentication (<a
href="https://redirect.github.com/databricks/databricks-sdk-py/pull/863">#863</a>).</li>
<li>Decouple oauth2 and serving (<a
href="https://redirect.github.com/databricks/databricks-sdk-py/pull/855">#855</a>).</li>
<li>Migrate workflows that need write access to use hosted runners (<a
href="https://redirect.github.com/databricks/databricks-sdk-py/pull/850">#850</a>).</li>
<li>Stop testing Python 3.7 on Ubuntu (<a
href="https://redirect.github.com/databricks/databricks-sdk-py/pull/858">#858</a>).</li>
</ul>
<h3>API Changes:</h3>
<ul>
<li>Added <a
href="https://databricks-sdk-py.readthedocs.io/en/latest/workspace/access_control.html">w.access_control</a>
workspace-level service.</li>
<li>Added <code>http_request()</code> method for <a
href="https://databricks-sdk-py.readthedocs.io/en/latest/workspace/serving_endpoints.html">w.serving_endpoints</a>
workspace-level service.</li>
<li>Added <code>no_compute</code> field for
<code>databricks.sdk.service.apps.CreateAppRequest</code>.</li>
<li>Added <code>has_more</code> field for
<code>databricks.sdk.service.jobs.BaseJob</code>.</li>
<li>Added <code>has_more</code> field for
<code>databricks.sdk.service.jobs.BaseRun</code>.</li>
<li>Added <code>page_token</code> field for
<code>databricks.sdk.service.jobs.GetJobRequest</code>.</li>
<li>Added <code>has_more</code> and <code>next_page_token</code> fields
for <code>databricks.sdk.service.jobs.Job</code>.</li>
<li>Added <code>has_more</code> field for
<code>databricks.sdk.service.jobs.Run</code>.</li>
<li>Added <code>clean_rooms_notebook_output</code> field for
<code>databricks.sdk.service.jobs.RunOutput</code>.</li>
<li>Added <code>scopes</code> field for
<code>databricks.sdk.service.oauth2.UpdateCustomAppIntegration</code>.</li>
<li>Added <code>run_as</code> field for
<code>databricks.sdk.service.pipelines.CreatePipeline</code>.</li>
<li>Added <code>run_as</code> field for
<code>databricks.sdk.service.pipelines.EditPipeline</code>.</li>
<li>Added <code>authorization_details</code> and
<code>endpoint_url</code> fields for
<code>databricks.sdk.service.serving.DataPlaneInfo</code>.</li>
<li>Added <code>contents</code> field for
<code>databricks.sdk.service.serving.GetOpenApiResponse</code>.</li>
<li>Added <code>activated</code>, <code>activation_url</code>,
<code>authentication_type</code>, <code>cloud</code>,
<code>comment</code>, <code>created_at</code>, <code>created_by</code>,
<code>data_recipient_global_metastore_id</code>,
<code>ip_access_list</code>, <code>metastore_id</code>,
<code>name</code>, <code>owner</code>, <code>properties_kvpairs</code>,
<code>region</code>, <code>sharing_code</code>, <code>tokens</code>,
<code>updated_at</code> and <code>updated_by</code> fields for
<code>databricks.sdk.service.sharing.RecipientInfo</code>.</li>
<li>Added <code>expiration_time</code> field for
<code>databricks.sdk.service.sharing.RecipientInfo</code>.</li>
<li>Changed <code>update()</code> method for <a
href="https://databricks-sdk-py.readthedocs.io/en/latest/account/account_federation_policy.html">a.account_federation_policy</a>
account-level service with new required argument order.</li>
<li>Changed <code>update()</code> method for <a
href="https://databricks-sdk-py.readthedocs.io/en/latest/account/service_principal_federation_policy.html">a.service_principal_federation_policy</a>
account-level service with new required argument order.</li>
<li>Changed <code>update()</code> method for <a
href="https://databricks-sdk-py.readthedocs.io/en/latest/workspace/recipients.html">w.recipients</a>
workspace-level service to return
<code>databricks.sdk.service.sharing.RecipientInfo</code>
dataclass.</li>
<li>Changed <code>update()</code> method for <a
href="https://databricks-sdk-py.readthedocs.io/en/latest/workspace/recipients.html">w.recipients</a>
workspace-level service return type to become non-empty.</li>
<li>Changed <code>update()</code> method for <a
href="https://databricks-sdk-py.readthedocs.io/en/latest/workspace/recipients.html">w.recipients</a>
workspace-level service to type <code>update()</code> method for <a
href="https://databricks-sdk-py.readthedocs.io/en/latest/workspace/recipients.html">w.recipients</a>
workspace-level service.</li>
<li>Changed <code>get_open_api()</code> method for <a
href="https://databricks-sdk-py.readthedocs.io/en/latest/workspace/serving_endpoints.html">w.serving_endpoints</a>
workspace-level service return type to become non-empty.</li>
<li>Changed <code>patch()</code> method for <a
href="https://databricks-sdk-py.readthedocs.io/en/latest/workspace/serving_endpoints.html">w.serving_endpoints</a>
workspace-level service to type <code>patch()</code> method for <a
href="https://databricks-sdk-py.readthedocs.io/en/latest/workspace/serving_endpoints.html">w.serving_endpoints</a>
workspace-level service.</li>
<li>Changed <code>patch()</code> method for <a
href="https://databricks-sdk-py.readthedocs.io/en/latest/workspace/serving_endpoints.html">w.serving_endpoints</a>
workspace-level service to return
<code>databricks.sdk.service.serving.EndpointTags</code> dataclass.</li>
<li>Changed <code>databricks.sdk.service.serving.EndpointTagList</code>
dataclass to.</li>
<li>Changed <code>collaborator_alias</code> field for
<code>databricks.sdk.service.cleanrooms.CleanRoomCollaborator</code> to
be required.</li>
<li>Changed <code>collaborator_alias</code> field for
<code>databricks.sdk.service.cleanrooms.CleanRoomCollaborator</code> to
be required.</li>
</ul>
<!-- raw HTML omitted -->
</blockquote>
<p>... (truncated)</p>
</details>
<details>
<summary>Commits</summary>
<ul>
<li><a
href="https://github.com/databricks/databricks-sdk-py/commit/267d369711a2ac1c27b27f3c0f56201a5ce241b0"><code>267d369</code></a>
[Release] Release v0.41.0 (<a
href="https://redirect.github.com/databricks/databricks-sdk-py/issues/864">#864</a>)</li>
<li><a
href="https://github.com/databricks/databricks-sdk-py/commit/11fdf46563ae8070c11d38a320c77430676212a1"><code>11fdf46</code></a>
[Internal] Add unit tests for external-browser authentication (<a
href="https://redirect.github.com/databricks/databricks-sdk-py/issues/863">#863</a>)</li>
<li><a
href="https://github.com/databricks/databricks-sdk-py/commit/fe9877aaa86dbdfbe54c4f83c0eed3f98c410017"><code>fe9877a</code></a>
[Fix] Properly pass query parameters in apps and oauth2 (<a
href="https://redirect.github.com/databricks/databricks-sdk-py/issues/862">#862</a>)</li>
<li><a
href="https://github.com/databricks/databricks-sdk-py/commit/ee136e2f1e05071fb3607f740d90b12e2aa635ad"><code>ee136e2</code></a>
[Feature] Add <code>serving.http_request</code> to call external
functions. (<a
href="https://redirect.github.com/databricks/databricks-sdk-py/issues/857">#857</a>)</li>
<li><a
href="https://github.com/databricks/databricks-sdk-py/commit/8c4264bcc75671bd6fe62410e612e5c6c00dac7c"><code>8c4264b</code></a>
[Internal] Stop testing Python 3.7 on Ubuntu (<a
href="https://redirect.github.com/databricks/databricks-sdk-py/issues/858">#858</a>)</li>
<li><a
href="https://github.com/databricks/databricks-sdk-py/commit/cbae014ac73b99c659646daa1e0d42f939452567"><code>cbae014</code></a>
[Internal] Decouple oauth2 and serving (<a
href="https://redirect.github.com/databricks/databricks-sdk-py/issues/855">#855</a>)</li>
<li><a
href="https://github.com/databricks/databricks-sdk-py/commit/d907c0cfa45402e7223efe7b633e0dd26f2ca7bd"><code>d907c0c</code></a>
[Feature] Files API client: recover on download failures (<a
href="https://redirect.github.com/databricks/databricks-sdk-py/issues/844">#844</a>)
(<a
href="https://redirect.github.com/databricks/databricks-sdk-py/issues/845">#845</a>)</li>
<li><a
href="https://github.com/databricks/databricks-sdk-py/commit/6d6923ebbfab94db5a3fee990501a276f4de7149"><code>6d6923e</code></a>
[Internal] Migrate workflows that need write access to use hosted
runners (<a
href="https://redirect.github.com/databricks/databricks-sdk-py/issues/850">#850</a>)</li>
<li>See full diff in <a
href="https://github.com/databricks/databricks-sdk-py/compare/v0.40.0...v0.41.0">compare
view</a></li>
</ul>
</details>
<br />

<details>
<summary>Most Recent Ignore Conditions Applied to This Pull
Request</summary>

| Dependency Name | Ignore Conditions |
| --- | --- |
| databricks-sdk | [>= 0.25.a, < 0.26] |
</details>


Dependabot will resolve any conflicts with this PR as long as you don't
alter it yourself. You can also trigger a rebase manually by commenting
`@dependabot rebase`.

[//]: # (dependabot-automerge-start)
[//]: # (dependabot-automerge-end)

---

<details>
<summary>Dependabot commands and options</summary>
<br />

You can trigger Dependabot actions by commenting on this PR:
- `@dependabot rebase` will rebase this PR
- `@dependabot recreate` will recreate this PR, overwriting any edits
that have been made to it
- `@dependabot merge` will merge this PR after your CI passes on it
- `@dependabot squash and merge` will squash and merge this PR after
your CI passes on it
- `@dependabot cancel merge` will cancel a previously requested merge
and block automerging
- `@dependabot reopen` will reopen this PR if it is closed
- `@dependabot close` will close this PR and stop Dependabot recreating
it. You can achieve the same result by closing it manually
- `@dependabot show <dependency name> ignore conditions` will show all
of the ignore conditions of the specified dependency
- `@dependabot ignore this major version` will close this PR and stop
Dependabot creating any more for this major version (unless you reopen
the PR or upgrade to it yourself)
- `@dependabot ignore this minor version` will close this PR and stop
Dependabot creating any more for this minor version (unless you reopen
the PR or upgrade to it yourself)
- `@dependabot ignore this dependency` will close this PR and stop
Dependabot creating any more for this dependency (unless you reopen the
PR or upgrade to it yourself)


</details>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

Author: dependabot[bot]

pyproject.toml

@@ -44,7 +44,7 @@ classifiers = [
     "Topic :: Utilities",
 ]
 
-dependencies = ["databricks-sdk>=0.40,<0.41",
+dependencies = ["databricks-sdk>=0.40,<0.42",
                 "databricks-labs-lsql>=0.14.0,<0.15",
                 "databricks-labs-blueprint>=0.9.1,<0.11",
                 "PyYAML>=6.0.0,<7.0.0",