[WIP] Run tests as part of the CI process

[AdelekeBankole]

On moving forward for the test suite in CAM-ML. This PR aims to run our tests as part of the continuous integration process.

[jatkinson1000]

Hi @AdelekeBankole This is a good start and it is good to see it is running with GitHub CI!

There are a few things that I don't think we need here (I know I said to start with the FTorch CI as an example) that I have provided 'suggestions' to remove.

The next step I think is to define a series of steps to run the test suite as we would on a local machine. This will include:

• Install any python dependencies
• Generate the sounding files using python
• Build the code using CMake
• Run the test suites
• Modify the test suites to return exit codes for success/failure

Let me know if you want me to take another look after further changes or have any queries.

[jatkinson1000]

I think the CI currently fails because it does not build the sounding in the correct location.
Try the suggestion below, and we can take a closer look this afternoon.

[jatkinson1000]

@AdelekeBankole Looking at the latest failure on the test script it seems python netcdf cannot find the HDF5 library or something.
It may be that you need to install netcdf4 and/or HDF5 libraries to the CI runner as well.

[jatkinson1000]

@AdelekeBankole Looks like the versions are too strict in the YOG/resources/requirements.txt
Perhaps remove the specifiers and see if things run OK.

Though note you may need to restrict numpy to <2.0 as I recall it had issues with the major version change and I do not know if they have been resolved yet.

[AdelekeBankole]

@AdelekeBankole Looks like the versions are too strict in the YOG/resources/requirements.txt Perhaps remove the specifiers and see if things run OK.

Though note you may need to restrict numpy to <2.0 as I recall it had issues with the major version change and I do not know if they have been resolved yet.

@jatkinson1000, you mean restricting it to >=3.7,<3.11 ?

[jatkinson1000]

@AdelekeBankole I meant from the pip dependencies in the requirements.txt file - the workflow was complaining that it could not find the exact version of numpy.

See PR #90 to this branch that has a patch to do this.
This worked, but there were still issues (documented various places online) with running netcdf.save on GitHub CI so I uploaded the NetCDF file as an artifact to fix this.

I also added netCDF-Fortran that was missing from the dependencies.

My branch now builds the test suite so hopefully allows you to continue troubleshooting.

[jatkinson1000]

That's looking good @AdelekeBankole !
Now you just need to un-break it ;)

A quick thought - did you also want to run the other test suite as well?

[jatkinson1000]

Hi @AdelekeBankole This all looks like good work to me and I have approved.

I have made one small suggestions regarding what I believe is an unnecessary python setup in the job that you might want to look at.
I'm happy for you to merge after checking this.