Skip to content
This repository was archived by the owner on Jul 11, 2025. It is now read-only.

Disk-based job system and improved analysis #57

Merged
merged 13 commits into from
Apr 29, 2025
Merged

Conversation

ConnectedSystems
Copy link
Collaborator

Adds a naive disk-based job system to avoid duplicate work being triggered.

Also mingled into this PR (bad practice I know) are improvements to the analyses for accuracy.
These changes depend on an updated dataset that will be made available shortly.

In short:

We now search for an approximately optimal candidate location by assessing rotations of their indicative polygons in steps of 10 degrees (this is somewhat arbitrary to balance computational cost, and can be adjusted).

image

The previous implementation heavily favoured straight vertical/horizonal rotations

image

The reason for this turned out to be the vector representation of the raster, which defaults to the bottom left corner of each pixel rather than the centroid:

image

Correcting this resulted in more accurate and diverse rotations:

image

Previous address did not work/was confusing
Was unnecessary and confused users
Previously the polygon was rotated to align with the identified reef edge and only rotated a certain number of times to reduce computational cost.

However, the reef edge was based on the available outlines which are problematic in some cases as they may not represent the actual reef edge (when compared to the bathymetry data).

Instead, we rotate and assess the polygon in steps of 10 degrees to identify the approximately optimal rotation.
@ConnectedSystems
Copy link
Collaborator Author

FYI @arlowhite am merging this now. Datasets being uploaded too as discussed

@ConnectedSystems ConnectedSystems merged commit 545c280 into main Apr 29, 2025
1 check passed
@ConnectedSystems ConnectedSystems deleted the data-flow branch April 29, 2025 00:58
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant