Skip to content

Add processing tools for exclusion sets #22

@egrace479

Description

@egrace479

This is for test-set filtering, removal of human faces, removal of images of labels (vs. specimens), removal of empty camera trap frames (from GBIF), general cleaning for citizen science data (remove cluttered occurrences and set camera traps to proper processing), etc. in more detail...

  • All lookup table exclude creators from TreeOfLife-dev (many of these are here) should be in src/ for this repo:
    • PDQ hash process
    • Image type separator (museum, camera trap, and citizen science categories)
    • Museum Specimen processing: label vs specimen filter
    • camera trap processing: megadetector & reducer
    • citizen science image processing
    • face detection
  • Add slurm scripts that run these processes from TreeOfLife-dev to root-level scripts/ directory (these will be more template (your/path/here) style.

This whole process then also needs clear documentation for how to use each of these tools and the pipeline.

Metadata

Metadata

Labels

structureRefactoring or architecture, general code organization

Type

No type

Projects

No projects

Relationships

None yet

Development

No branches or pull requests

Issue actions