Skip to content

[Internal] Move all "core" packages in the "databricks" package. #1121

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 13 commits into from
Jan 14, 2025

Conversation

renaudhartert-db
Copy link
Contributor

@renaudhartert-db renaudhartert-db commented Jan 13, 2025

What changes are proposed in this pull request?

This PR moves all the "core" packages in the "databricks" directory which is meant to become the core library.

This PR is also removing the mocked files while syncing with the latest version of main.

Note that this PR also changes generated code. This is intended as the code generator has to be updated to account for these changes.

How is this tested?

Unit tests and integration tests are still passing.

renaudhartert-db and others added 10 commits January 8, 2025 15:18
### Internal Changes

* Bump staticcheck to 0.5.1 and add go 1.23 test coverage
([#1106](#1106)).
* Bump x/net, x/crypto dependencies
([#1107](#1107)).
* Create custom codeql.yml
([#1114](#1114)).
* Decouple serving and oauth2 package
([#1110](#1110)).
* Migrate workflows that need write access to use hosted runners
([#1112](#1112)).
* Move package credentials in config
([#1115](#1115)).
* Update Queries test
([#1104](#1104)).


### API Changes:

* Added `NoCompute` field for
[apps.CreateAppRequest](https://pkg.go.dev/github.com/databricks/databricks-sdk-go/service/apps#CreateAppRequest).
* Added `HasMore` field for
[jobs.BaseJob](https://pkg.go.dev/github.com/databricks/databricks-sdk-go/service/jobs#BaseJob).
* Added `HasMore` field for
[jobs.BaseRun](https://pkg.go.dev/github.com/databricks/databricks-sdk-go/service/jobs#BaseRun).
* Added `PageToken` field for
[jobs.GetJobRequest](https://pkg.go.dev/github.com/databricks/databricks-sdk-go/service/jobs#GetJobRequest).
* Added `HasMore` and `NextPageToken` fields for
[jobs.Job](https://pkg.go.dev/github.com/databricks/databricks-sdk-go/service/jobs#Job).
* Added `HasMore` field for
[jobs.Run](https://pkg.go.dev/github.com/databricks/databricks-sdk-go/service/jobs#Run).
* Added `RunAs` field for
[pipelines.CreatePipeline](https://pkg.go.dev/github.com/databricks/databricks-sdk-go/service/pipelines#CreatePipeline).
* Added `RunAs` field for
[pipelines.EditPipeline](https://pkg.go.dev/github.com/databricks/databricks-sdk-go/service/pipelines#EditPipeline).
* Added `AuthorizationDetails` and `EndpointUrl` fields for
[serving.DataPlaneInfo](https://pkg.go.dev/github.com/databricks/databricks-sdk-go/service/serving#DataPlaneInfo).
* [Breaking] Changed `Update` method for
[a.AccountFederationPolicy](https://pkg.go.dev/github.com/databricks/databricks-sdk-go/service/oauth2#AccountFederationPolicyAPI)
account-level service with new required argument order.
* [Breaking] Changed `Update` method for
[a.ServicePrincipalFederationPolicy](https://pkg.go.dev/github.com/databricks/databricks-sdk-go/service/oauth2#ServicePrincipalFederationPolicyAPI)
account-level service with new required argument order.
* Changed `UpdateMask` field for
[oauth2.UpdateAccountFederationPolicyRequest](https://pkg.go.dev/github.com/databricks/databricks-sdk-go/service/oauth2#UpdateAccountFederationPolicyRequest)
to no longer be required.
* Changed `UpdateMask` field for
[oauth2.UpdateServicePrincipalFederationPolicyRequest](https://pkg.go.dev/github.com/databricks/databricks-sdk-go/service/oauth2#UpdateServicePrincipalFederationPolicyRequest)
to no longer be required.
* [Breaking] Changed `DaysOfWeek` field for
[pipelines.RestartWindow](https://pkg.go.dev/github.com/databricks/databricks-sdk-go/service/pipelines#RestartWindow)
to type
[pipelines.DayOfWeekList](https://pkg.go.dev/github.com/databricks/databricks-sdk-go/service/pipelines#DayOfWeekList).

OpenAPI SHA: 779817ed8d63031f5ea761fbd25ee84f38feec0d, Date: 2025-01-08
…pace test (#1120)

## What changes are proposed in this pull request?
What - The PR modifies the scope of directory traversal in the recursive
list test. It limits the search to the ".sdk" directory, where the
relevant notebook is created.

Why - The test was previously hitting API rate limits because it was
scanning too many elements in the current traversing directory. By
narrowing the scope to the ".sdk" directory, the test can now run more
efficiently without encountering these limits.

## How is this tested?
This is itself an integration test.
Copy link
Contributor

@hectorcast-db hectorcast-db left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

[nit] Let's add in the PR description that we are also removing the mock files.

Copy link

If integration tests don't run automatically, an authorized user can run them manually by following the instructions below:

Trigger:
go/deco-tests-run/sdk-go

Inputs:

  • PR number: 1121
  • Commit SHA: 3df2e38272b44ed2cab2a5d81d8d44fcca533665

Checks will be approved automatically on success.

@renaudhartert-db renaudhartert-db added this pull request to the merge queue Jan 14, 2025
Merged via the queue into dev/sdk-mod with commit 6f6e003 Jan 14, 2025
15 checks passed
@renaudhartert-db renaudhartert-db deleted the renaud.hartert/move branch January 14, 2025 11:56
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants