-
Notifications
You must be signed in to change notification settings - Fork 8
File Organization for Images, PSCs and Light Curves
See Terminology page
Lowercase items are variable.
Stored on unit, by field:
field/cameraid/seq_time/img_time.cr2 (raw image files)
field/cameraid/seq_time/img_time.jpg (jpg files)
A "pre-processing" algorithm runs on the unit and makes 10,000s of PSCs from whole field images for each PIC star. These are stored on the unit and copied to the cloud:
PSC/unitid/cameraid/seq_time/picid.fits
The PIAA algorithm operates on each batch of PSCs and outputs light curve JSON files. These are stored in a separate file structure on the unit and copied to the cloud, organized by PICID:
LC/picid/unitid/cameraid/seq_time.json
An algorithm will operate on all of the light curves for each PIC object on the cloud, and output a master light curve for every object to a Cloud Storage bucket. These will be named with the PICID, and for now are stored as JSON objects like the light curve segments:
MLC/picid.json