Skip to content

Cannot submit job to AWS batch when the compute env of Batch is AWS EKS #5817

Open
@waynewang117

Description

@waynewang117

Bug report

Expected behavior and actual behavior

I configured the AWS EKS as the compute env of AWS batch.
Then I submit a job to AWS batch, I got below error.
com.amazonaws.services.batch.model.ClientException: Container overrides or node overrides should not be set for Batch on EKS jobs.

Steps to reproduce the problem

nextflow.config

process {
executor = ‘awsbatch’
queue = 'xxxxxx'
container = 'job-definition://xxxxxx'
}

nextflow run hello -workdir=s3://xxxxxx

Program output

com.amazonaws.services.batch.model.ClientException: Container overrides or node overrides should not be set for Batch on EKS jobs.

Additional context

I guess this is cased by the hardcode "result.setContainerOverrides(container)" in below file.
https://github.com/nextflow-io/nextflow/blob/master/plugins/nf-amazon/src/main/nextflow/cloud/aws/batch/AwsBatchTaskHandler.groovy#L794

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions