Added provision to assert job status, updated HPO script for disconne…

[abhijeet-dhumal]

Depends on PR : project-codeflare/codeflare-common#61

Description

• Removed local-queue parameter usage from cluster configuration to make it optional - Related PR : Add local-queue annotation to use created local queue by default in g… project-codeflare/codeflare-common#59
• Updated s3 bucket endpoint url to remove https prefix - Related PR : Update s3 bucket endpoint url to remove https prefix project-codeflare/codeflare-sdk#643
• Added provision to fetch job logs to assert ray job submission status
• Updated HPO script to support disconnected automation

How Has This Been Tested?

Manually :

Merge criteria:

• The commits are squashed in a cohesive manner and have meaningful messages.
• Testing instructions have been added in the PR body (for PRs involving changes that are not immediately obvious).
• The developer has manually tested the changes and verified that the changes work

[astefanutti]

/lgtm

[openshift-ci]

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: sutaakar

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

• OWNERS [sutaakar]

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment