v1.28.4

What's Changed

• Update containerd to v1.7.13 and runc to v1.1.12 by @zetaab in #16303
• Release 1.28.4 by @hakman in #16312

Full Changelog: v1.28.3...v1.28.4

v1.27.3

What's Changed

• Update aws-sdk-go to v1.49.24 by @hakman in #16304
• Update containerd to v1.7.13 and runc to v1.1.12 by @hakman in #16305
• Release 1.27.3 by @hakman in #16309

Full Changelog: v1.27.2...v1.27.3

v1.28.3

What's Changed

• Update Cilium to v1.13.10 by @hakman in #16215
• Automated cherry pick of #16245: Update Go to v1.21.6 by @hakman in #16247
• Update aws-sdk-go to v1.49.24 by @hakman in #16261
• Automated cherry pick of #16216: aws: Retrieve instance info only when max pods is not set
  #16253: aws: fix maxPods when cilium ipam is used by @hakman in #16260
• Release 1.28.3 by @justinsb in #16273

Full Changelog: v1.28.2...v1.28.3

v1.29.0-alpha.3

Release v1.29.0-alpha.3

What's Changed

• Bump actions/dependency-review-action from 3.1.0 to 3.1.2 by @dependabot in #16097
• Don't get cluster --full when attempting leak cleanup by @rifelpet in #16102
• Update Calico to v3.26.4 by @hakman in #16107
• Update dependencies by @github-actions in #16108
• Experimental support for tracing by @justinsb in #16020
• Check cluster information when filtering instances by @zetaab in #16112
• Update kube-router to 1.6 by @aauren in #16110
• allow local file VFS in asset copy by @zetaab in #16115
• Bump actions/dependency-review-action from 3.1.2 to 3.1.3 by @dependabot in #16111
• Replace * in IAM tags when IRSA namespace has wildcard by @h3poteto in #16113
• Upgrade AWS EBS CSI Driver by @rifelpet in #16119
• bump k8s and ubuntu ami versions in alpha by @moshevayner in #16120
• Support volume modification in EBS CSI Driver by @rifelpet in #16121
• Fix parsing of newer kubernetes version URLs by @rifelpet in #16123
• Spotinst: Feature/add multi arch in VNG and resource tag specification by @yehielnetapp in #16099
• Improve kops edit command by @prashantrewar in #16109
• Update dependencies by @github-actions in #16129
• kops: Support quotes in --set flags by @justinsb in #16128
• skip file remapping if same host by @zetaab in #16117
• Enable containerd test-handler runtimeclass for k/k e2e tests by @upodroid in #16056
• Promote alpha to stable by @moshevayner in #16131
• limit jobname value to 80 by @upodroid in #16136
• Only set containerd plugins on kops versions that include quote fixes by @rifelpet in #16133
• Thread context through kubectl-auth by @justinsb in #16137
• build: add script for rapid development of kops-controller by @justinsb in #16138
• feat: Support multiple token verifiers in kops-controller by @justinsb in #16140
• Update OpenStack documentation to replace deprecated arguments by @marcvorwerk in #16135
• Skip hostname test in DigitalOcean by @rifelpet in #16144
• Update dependencies by @github-actions in #16146
• Support bootstrapping nodes using Public Key authentication by @justinsb in #16141
• docs: Remove Docker config section by @hakman in #16145
• gce: Support additional StorageClasses by @sl1pm4t in #16103
• kube-router: skip 1.28 tests that fail consistently by @aauren in #16149
• gce: Add support for publishing Service Account Issuer documents to GCS by @sl1pm4t in #16050
• feat: "enroll" command to add nodes to a bare-metal cluster by @justinsb in #16147
• Bump actions/dependency-review-action from 3.1.3 to 3.1.4 by @dependabot in #16150
• fix the gce info shown in kops get cmd and set node-tag ginkgo flag by @upodroid in #16096
• Don't set LimitNoFile for containerd systemd unit file by @upodroid in #16151
• Order instances in terms of cost by @hakuna-matatah in #16156
• Upgrade AWS Load Balancer Controller to v2.6.2 by @rifelpet in #16155
• Reduce disk volume size to reduce cost by @hakuna-matatah in #16157
• Add --max-nodes flag to toolbox dump, default to 500 by @rifelpet in #16160
• Allow EKS Pod identity env variables by @ameukam in #16162
• Upgrade Karpenter to 0.31.3 by @rifelpet in #16163
• Update dependencies by @github-actions in #16164
• Remove duplicate m5.large from scalability test by @rifelpet in #16166
• chore: Bump go to 1.21.5 by @justinsb in #16168
• Ignore HPA status when applying addons by @rifelpet in #16167
• Bump actions/setup-go from 4.1.0 to 5.0.0 by @dependabot in #16171
• aws: Add KMS to EBS CSI Driver and control plane by @hakman in #16173
• Bump metrics-server to 0.6.4 by @bohrasd in #16174
• bump cert-manager to 1.12.7 by @bohrasd in #16177
• Ignore cert-manager in LBC's webhooks by @rifelpet in #16179
• Enable pagination on GCE Instance Groups by @rifelpet in #16184
• Release 1.29.0-alpha.3 by @justinsb in #16183

New Contributors

• @aauren made their first contribution in #16110
• @prashantrewar made their first contribution in #16109
• @ameukam made their first contribution in #16162
• @bohrasd made their first contribution in #16174

Full Changelog: v1.29.0-alpha.2...v1.29.0-alpha.3

v1.28.2

Release v1.28.2

What's Changed

• Automated cherry pick of #16112: check kops cluster name when filtering instances in by @hakman in #16114
• Automated cherry pick of #16110: Update kube-router to v1.6.0 by @hakman in #16116
• Automated cherry pick of #16113: Replace * in IAM tags when IRSA namespace has wildcard by @hakman in #16118
• Automated cherry pick of #16163: Upgrade Karpenter to v0.31.3 by @rifelpet in #16165
• Automated cherry pick of #16167: Ignore HPA status when applying addons by @rifelpet in #16169
• Automated cherry pick of #16168: chore: Bump go to 1.21.5 by @justinsb in #16170
• Release 1.28.2 by @justinsb in #16182

Full Changelog: v1.28.1...v1.28.2

v1.29.0-alpha.2

What's Changed

• Update dependencies by @github-actions in #15890
• Update Go to v1.21.1 by @hakman in #15893
• Remove metadata-proxy from GCE Clusters from 1.29+ onwards by @upodroid in #15885
• Implement Cilium Ingress by @zadjadr in #15795
• Bump actions/dependency-review-action from 3.0.8 to 3.1.0 by @dependabot in #15894
• Bump actions/checkout from 3.6.0 to 4.0.0 by @dependabot in #15895
• Handle 404 properly from Service Accounts API by @upodroid in #15902
• Increase vpc cidrs to allocate more ip's for large scale k8s clusters by @hakuna-matatah in #15904
• kops-controller: Increase client-side throttling limits by @hakman in #15906
• Increase the etcd db size to accomodate large scale k8s cluster resources by @hakuna-matatah in #15908
• Add Cognito permissions for AWS LBC by @danports in #15910
• Fix COS image mounter URL by @upodroid in #15907
• scale-test: Increase validation wait time to 45m by @hakman in #15915
• Make --cloudonly sound less innocuous by @danports in #15911
• Update dependencies by @github-actions in #15917
• scale-test: Add few more cidrs to divide equally /16's by @hakuna-matatah in #15920
• Update sync target for OWNERS by @johngmyers in #15921
• Add SeccompDefault kubelet config by @colinhoglund in #15919
• Optimize subnets asignment to IGs for clusters with multiple CIDRs by @hakman in #15923
• fix a few log with percent w by @justinsb in #15926
• Revert "WIP: Need to publish IPv4 DNS records" by @justinsb in #15928
• fix some comments by @justinsb in #15927
• scale-test: Need for separate etcd cluster for events by @hakuna-matatah in #15932
• scale-test: Optimise node dumping for large clusters by @hakman in #15934
• scale-test: Re-enable etcd metrics by @hakman in #15938
• protokube: support writing AAAA records to /etc/hosts by @justinsb in #15931
• Update dependencies by @github-actions in #15944
• Cilium: Implement node encryption by @zadjadr in #15901
• Fix e2e testing logic by @upodroid in #15900
• aws: Fix minor typos for Karpenter setup by @junm-cloudnatix in #15935
• aws: Configure Karpenter resources in the cluster spec by @danports in #15916
• Update 1.28 release notes for release by @johngmyers in #15956
• gce ipv6: we can use network tags with ipv6 addresses by @justinsb in #15955
• Bump actions/checkout from 4.0.0 to 4.1.0 by @dependabot in #15960
• Update Karpenter to v0.30.0 by @hakman in #15945
• aws: Filter ENI list by VPC by @hakman in #15903
• Add info for kOps 1.22-1.24 on audit logging path changes by @michalbolek in #15941
• Update etcd-manager to v3.0.20230925 by @hakman in #15962
• bump k8s releases and ubuntu ami versions in alpha channel by @moshevayner in #15967
• bump gcp ccm image and dump more resources by @upodroid in #15968
• Add missing rbac roles and don't run gkenetparams controller by @upodroid in #15971
• Attempt to dump cluster info when encountering earlier errors by @rifelpet in #15975
• Update dependencies by @github-actions in #15976
• scaleway: terraform support by @Mia-Cross in #15892
• Promote alpha to stable by @moshevayner in #15979
• aws: Don't add dependency on additional CIDR for shared VPC by @hakman in #15987
• Allow setting map[string]string from the command line by @hakman in #15989
• Add support for installing additional packages at cluster level by @hakman in #16001
• Update Go to v1.21.2 by @hakman in #16003
• Update DigitalOcean addons by @rifelpet in #16000
• Create a temporary staging bucket for kops builds by @upodroid in #15981
• Bump GCP CCM again by @upodroid in #15972
• aws: Attach security groups to NLBs by @johngmyers in #15993
• aws: Attach security group to NLBs for kops-controller by @hakman in #16006
• Use dns=none for newly created clusters except for AWS and GCE by @hakman in #16005
• Configure GCP Kubelet Credentials Provider by @upodroid in #15974
• Update Go to v1.21.3 by @hakman in #16012
• Update dependencies by @github-actions in #16014
• Dump nodes even if controlplane is broken by @upodroid in #16010
• Update dependencies by @github-actions in #16019
• openstack: fix instance group validation if using serverGroupName annotation by @zetaab in #16022
• Refactor: Add context.Context to more VFS methods by @justinsb in #16021
• scale-test: Measure APIServer SLOs by @hakuna-matatah in #15963
• Update dependencies by @github-actions in #16030
• Bump alpha channel with October releases by @hakman in #16031
• Add cloud-platform GCP VM scope by @sl1pm4t in #16013
• containerd: introduce a new field to enable NRI by @fmuyassarov in #15994
• Build Kubernetes from source by @upodroid in #16018
• scaleway: IPAM integration by @Mia-Cross in #16016
• Add support for --cluster-signing-duration KCM flag by @hakman in #16038
• Promote alpha channel to stable by @hakman in #16041
• Bump actions/checkout from 4.1.0 to 4.1.1 by @dependabot in #16042
• Fix tests for multi-arch clusters by @hakman in #16045
• Update containerd to v1.7.7 by @hakman in #16043
• aws: Skip ASG cleanup on Karpenter managed IG deletion by @hakman in #16051
• Update controller-gen to v0.13.0 by @hakman in #16058
• Update codegen to v0.28.3 by @hakman in #16059
• Limit sanitized URLs to 200 characters by @hakman in #16061
• Add validation to help users move from experimentClusterSigningDuration by @justinsb in #16062
• Support setting CAS skip-nodes-with-custom-controller-pods parameter by @shapirus in #16060
• Bump to Cilium 1.14 by @zadjadr in #15705
• Document breaking changes for serviceClusterIPRange and OpenStack with S3 state store by @ederst in #16028
• Keep validating after timeout when cluster is healthy by @hakman in #16063
• scale-test: Scrape APIServer only metrics by @hakuna-matatah in #16029
• don't dump logs if the cluster doesn't exist by @upodroid in #16054
• Add --node-instance-group flag to ginkgo by @upodroid in #16065
• Update dependencies by @github-actions in #16068
• Add option to provide additional config entries for containerd by @hakman in #16067
• dump: include the various gateways on AWS by @justinsb in #16069
• dump: actually dump the gateway objects by @justinsb in #16070
• Fix vet errors by @hakman in #16076
• Update dependencies by @github-actions in #16077
• toolbox dump: include AWS route table objects by @justinsb in #16073
• Document incompatabi...

v1.28.1

What's Changed

• Automated cherry pick of #15901: Implement node encryption by @hakman in #15947
• Automated cherry pick of #15935: Fix minor typos for karpenter setup.
  #15957: Configure Karpenter resources. by @danports in #15958
• Automated cherry pick of #15987: aws: Don't add dependency on additional CIDR for shared VPC by @hakman in #15988
• Automated cherry pick of #16022: fix instance group validation if using serverGroupName by @zetaab in #16023
• Upgrade golang.org/x/net to 0.17.0 by @johngmyers in #16033
• Upgrade Go to 1.20.10 by @johngmyers in #16035
• Automated cherry pick of #16038: Add support for --cluster-signing-duration KCM flag by @hakman in #16039
• Automated cherry pick of #16051: aws: Skip ASG cleanup on Karpenter managed IG deletion by @hakman in #16052
• Automated cherry pick of #16043: Update containerd to v1.7.7 by @hakman in #16047
• Automated cherry pick of #16085: Update Go to v1.21.4 by @hakman in #16086
• Release 1.28.1 by @hakman in #16093

Full Changelog: v1.28.0...v1.28.1

v1.27.2

What's Changed

• Automated cherry pick of #15848: Fix warmpool to expose dependencies for dependency analysis by @johngmyers in #15864
• Automated cherry pick of #15846: Dependency analysis: include the direct task by @johngmyers in #15865
• Automated cherry pick of #15910: Add Cognito permissions for AWS LBC. by @danports in #15913
• Automated cherry pick of #15919: Update kubelet API with SeccompDefault option. by @hakman in #15925
• Upgrade golang.org/x/net to 0.17.0 by @johngmyers in #16034
• Upgrade Go to 1.20.10 by @johngmyers in #16036
• Automated cherry pick of #16038: Add support for --cluster-signing-duration KCM flag by @hakman in #16040
• Automated cherry pick of #16051: aws: Skip ASG cleanup on Karpenter managed IG deletion by @hakman in #16053
• Automated cherry pick of #16085: Update Go to v1.21.4 by @hakman in #16087
• Release 1.27.2 by @hakman in #16094

Full Changelog: v1.27.1...v1.27.2

v1.28.0

Release notes for kOps 1.28 series

Significant changes

AWS

• Node Termination Handler is now enabled by default.

GCP

• metadata-proxy is no longer deployed on GCP clusters for Kubernetes 1.29+.

Breaking changes

AWS

• The kops get assets --copy command no longer sets object-level public-read ACLs in the destination fileRepository.
  h

Other breaking changes

• Support for Kubernetes version 1.22 has been removed.

• Support for Ubuntu 18.04 is has been removed.

• Support for Canal, Flannel, and Kube-Router has been removed for Kubernetes 1.28 and later.

• RHEL-based distros will no longer have wget, curl, python2, and git packages installed. Install them with hooks if needed.

Deprecations

• Support for Kubernetes version 1.23 is deprecated and will be removed in kOps 1.29.

• Support for Kubernetes version 1.24 is deprecated and will be removed in kOps 1.30.

• Support for AWS Classic Load Balancer for API is deprecated and should not be used for newly created clusters.

• All legacy addons are deprecated in favor of managed addons, including the metrics server addon and the autoscaler addon.

What's Changed

• Add create cluster flag for specifying the list of etcd clusters by @hakman in #15552
• Add option for specifying the list of etcd metrics urls by @hakman in #15553
• Add CL2 test command to scalability scenario by @prateekgogia in #15538
• make cni plugin configurable in scaling test scenario by @prateekgogia in #15557
• Upgrade Karpenter to v0.27.5 by @anthonyhaussman in #15144
• Allow overriding uint values by @hakman in #15551
• Update dependencies by @hakman in #15562
• azure: Enable support for public load balancer by @hakman in #15563
• Revert "Remove obsolete etcd versions" by @hakman in #15564
• azure: Fix finding load balancers without subnets by @hakman in #15567
• Update etcd-manager to v3.0.20230630 by @hakman in #15568
• azure: Add support for network security groups by @hakman in #15570
• Don't download container runtime assets when skipping the installation by @hakman in #15579
• Promote alpha channel to stable by @hakman in #15581
• hetzner: Update CCM to v1.16.0 by @hakman in #15577
• aws: Avoid spurious changes in EBSVolume for KmsKeyId by @hakman in #15573
• docs(cilium): fix several broken links by @agilgur5 in #15325
• docs: remove kube-dns-autoscaler when upgrading to CoreDNS by @agilgur5 in #15584
• docs(cilium): update links to latest v1.13 by @agilgur5 in #15583
• doc: Added documentation about loadbalancer and security group configuration by @valentin-ricard in #15588
• Update Karpenter to v0.28.1 by @hakman in #15585
• kops-controller: create IPAM controller for GCE by @justinsb in #15591
• Increase client-side throttling limits by @hakman in #15593
• ipv6: containerd routes support for IPv6 by @justinsb in #15594
• Validate additionalNetworkCIDRs only set on AWS by @johngmyers in #14921
• Use private topology for apiserver e2e test by @johngmyers in #14905
• scaleway: add scaleway zones to autocompletion by @Mia-Cross in #15603
• gce: Add support for bastions by @hakman in #15602
• Fix Karpenter failure to start on IPv6 clusters by @johngmyers in #15605
• gce: Update logic for internal LB by @hakman in #15332
• Move GCE networkCIDR prohibition to validateNetworking() by @johngmyers in #15610
• v1alpha3: Rename GCE networking to GCP by @johngmyers in #15612
• Remove references to ClusterSpec from nodeup sysctls.go by @johngmyers in #15613
• gce: Set firewall rules for Internal LBs also by @justinsb in #15611
• gce: Rename firewall SSH rules for bastion by @hakman in #15614
• scaleway: switched credentials reading order by @Mia-Cross in #15618
• Remove more references to ClusterSpec from nodeup by @johngmyers in #15620
• Update Go to v1.20.6 by @hakman in #15621
• Update aws-sdk-go to support new AWS SSO profile by @avdhoot in #15616
• scaleway: refactoring: utils functions to get info from tags by @Mia-Cross in #15626
• aws: Allow using the same instance ID as egress for multiple subnets by @hakman in #15628
• scaleway: documentation improvement by @Mia-Cross in #15604
• Deprecate Canal, Flannel, and Kube-router by @johngmyers in #15634
• openstack: Open hubble port 4244 by @zetaab in #15635
• Add support for using swap memory by @hakman in #15632
• gce: Use user-data instead of startup-script metadata key by @hakman in #15607
• Add VFSContext to various clientsets by @johngmyers in #14960
• add removeAll to vfs by @Codelax in #15395
• kops-controller: load objects with version conversion by @justinsb in #15608
• Remove references to ClusterSpec.API from nodeup by @johngmyers in #15615
• azure: Add support for dns=none by @hakman in #15627
• spot: update docs about setting the VNG Size Limits in Launch Spec by @IdanShohamNetApp in #15631
• Remove references to more ClusterSpec fields from nodeup by @johngmyers in #15645
• Remove dead code for non-kops-controller bootstrap by @johngmyers in #15646
• Remove support for bootstrap tokens by @johngmyers in #15648
• Fix comment on patchNodePodCIDRs by @justinsb in #15651
• Support removal of managed node labels by @justinsb in #15650
• feat(karpenter): Variabilize image, logFormat and logLevel by @anthonyhaussman in #15601
• azure: Add mode dependency logic to deletion by @hakman in #15617
• Refactor out references to global vfs.Context by @johngmyers in #15640
• Fix modifying backupRetentionDays by @hakman in #15655
• Update release nodes for kOps 1.27 by @hakman in #15653
• Update scaleway-sdk-go to v1.0.0-beta.19 by @hakman in #15658
• Update dependencies by @github-actions in #15661
• More VFSContext refactoring by @johngmyers in #15662
• Update channels by @hakman in #15660
• azure: Verify node identity using VMSS name instead of tags by @hakman in #15659
• docs: revise the bastion ssh guideline to mitigate permission denied errors by @techieforfun in #15657
• Fix long auth helper cache file name by @norseto in #15547
• More VFSContext refactoring by @johngmyers in #15663
• verify-boilerplate: stricter error checking by @justinsb in #15665
• Add golden-output test for cacheFilePath by @justinsb in #15664
• Determine default API access method by IG subnet type by @johngmyers in #14996
• Improve validation of PodCIDR and ServiceClusterIPRange by @johngmyers in #15623
• azure: Avoid spurious changes in NetworkSecurityGroup by @hakman in #15668
• Continue skipping SCTP tests for cilium until we upgrade to 1.13 by @rifelpet in #15671
• Bump k8s and kops versions used in scenario scripts by @rifelpet in #15672
• Add 1.27 release notes to docs menu...

v1.26.6

What's Changed

• Automated cherry pick of #15674: kubetest2-kops: rename control-plane-size flag to by @justinsb in #15718
• Automated cherry pick of #15725: kubetest2: Mark --control-plane-size as deprecated by @hakman in #15729
• Automated cherry pick of #15762: fix: fixed an edge case with setting NodePort access in by @hakman in #15769
• Automated cherry pick of #14861: Mount the audit config dir for kube-apiserver by @hakman in #15940
• Automated cherry pick of #15919: Update kubelet API with SeccompDefault option. by @hakman in #15949
• Release 1.26.5 by @johngmyers in #15951
• Release 1.26.6 by @johngmyers in #15952

Full Changelog: v1.26.5...v1.26.6