Skip to content

Prevent using Azure Low Priority VMs when using Batch Managed mode #6267

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 3 commits into
base: master
Choose a base branch
from

Conversation

adamrtalbot
Copy link
Collaborator

@adamrtalbot adamrtalbot commented Jul 10, 2025

Azure Low Priority VMs are deprecated in Batch Managed pool allocation mode but still supported in User Subscription mode. This adds validation to:

  • Block low priority VMs for Batch Managed accounts with clear error message
  • Allow low priority VMs for User Subscription accounts
  • Gracefully handle unknown allocation modes with warnings

This required adding a subscriptionId to the azure.batch config to enable creation of the management client. If not supplied Nextflow will raise a warning and continue. This does open us up to being able to do more with Azure Batch because we have access to the management API.

Fix Azure Low Priority VM deprecation for Batch Managed accounts (#6258)

adamrtalbot and others added 2 commits July 10, 2025 19:15
Azure Low Priority VMs are deprecated in Batch Managed pool allocation mode but
still supported in User Subscription mode. This adds validation to:
- Block low priority VMs for Batch Managed accounts with clear error message
- Allow low priority VMs for User Subscription accounts
- Gracefully handle unknown allocation modes with warnings

Adds subscriptionId to config to enable retrieval of this value. If not
supplied Nextflow will raise a warning and continue. This does open us
up to being able to do more with Azure Batch because we have access to
the management API.

🤖 Generated with [Claude Code](https://claude.ai/code)

Co-Authored-By: Claude <noreply@anthropic.com>
Signed-off-by: adamrtalbot <12817534+adamrtalbot@users.noreply.github.com>
Signed-off-by: adamrtalbot <12817534+adamrtalbot@users.noreply.github.com>
Copy link

netlify bot commented Jul 10, 2025

Deploy Preview for nextflow-docs-staging ready!

Name Link
🔨 Latest commit a93c938
🔍 Latest deploy log https://app.netlify.com/projects/nextflow-docs-staging/deploys/68700714c6055f0008a4b5a3
😎 Deploy Preview https://deploy-preview-6267--nextflow-docs-staging.netlify.app
📱 Preview on mobile
Toggle QR Code...

QR Code

Use your smartphone camera to open QR code link.

To edit notification comments on pull requests, go to your Netlify project configuration.

@adamrtalbot
Copy link
Collaborator Author

adamrtalbot commented Jul 10, 2025

This is a sledgehammer to crack a nut - it may be easier just to drop support for low priority VMs altogether 😢

but it was a fun exercise with Claude Code reading an unfamiliar API for me.

@adamrtalbot adamrtalbot linked an issue Jul 11, 2025 that may be closed by this pull request
@pditommaso
Copy link
Member

Not sure this makes sense considering "low priority" feature is going to be retired on 30th Sept, 2025 by Microsoft

@bentsherman
Copy link
Member

bentsherman commented Jul 14, 2025

Apparently the lowPriority setting is also used to enable spot VMs which are the new replacement 🤦

@pditommaso
Copy link
Member

Apparently the lowPriority setting is also used to enable spot VMs which are the new replacement

Umm, very confusing. We may still consider to call spot in Nextflow and align it with other cloud providers. In any case this PR needs a detailed docs to highlight what's new and how to use the new spot instances

https://learn.microsoft.com/en-us/azure/batch/batch-spot-vms

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Deprecation of Azure Low Priority VMs
3 participants