List view
This milestone is to add features that help in performing experimentation to assess the app performance. This includes: - Saving of captured frames as datasets for post-hoc analysis - Creating a node for device location so that we can correct the predicted nodes and ways accordingly.
Due by July 31, 2025•3/3 issues closedImplementation of depth-aware panoptic segmentation using the segmentation masks generated by the segmentation model and the depth map generated from either the LiDAR sensor or the depth estimation model. (Closed for now, as we are only using semantic segmentation. This can potentially be combined with polygon mesh for Pro devices. We may come back to this task, potentially to handle both polygon mesh and image-based depth-aware instance segmentation)
No due date•5/5 issues closed- Due by March 28, 2025•24/24 issues closed
(Note: This milestone was not explicitly tracked with Github issues, hence the following show some of the tasks that were completed for it.) Aim is to promote modularity and extensibility of the app UI Architecture Changes - Create a separate constants file for storing all the supported classes. UI Changes - Make UI compatible with iPad - Make the frame generation logic across all the ViewController files flexible - Add theming using Color Sets (in Assets) - Make app only support Portrait Mode temporarily UX Changes - (Temporary) Set the app to support only portrait mode (to make ContentView refactoring easier) ContentView Specifics - Stop annotationView from being global - Move common components such as SpinnerView to separate file - Make the camera and segmentation frame sizes flexible to screen size - Move CameraViewController and SegmentationViewController to separate files - Fix navigation issues between ContentView and AnnotationView (add to navigation stack instead of re-creating the views in each other's code) CameraController - Move Image Processing (CIImage, CVPixelBuffer) functionality to separate file - Streamline code that sets depthFiltering - Add more context to both synchronizer delegate and photo output delegate SegmentationViewController - Move unused functions to extension - Move CIFilter code to separate file - Fix the function that processes segmentations per class AnnotationView Specifics - Fix navigation issues between ContentView and AnnotationView (add to navigation stack instead of re-creating the views in each other's code) - Fix the nextSegment function logic - Handle the edge case of when the AnnotationView is opened for an image with no segments ObjectLocation - Improve its object references - Modularize the logic for getting the location and heading details
No due date•1/1 issues closed