Skip to content

Commit 2136e8e

Browse files
committed
docs: add CellVIT finetuning notebook example
1 parent 4b9b2de commit 2136e8e

File tree

3 files changed

+1014
-1
lines changed

3 files changed

+1014
-1
lines changed
Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,2 @@
1+
## Docs
2+
- Add notebook example on finetuning CellVIT-SAM with accelerate.

examples/pannuke_nuclei_segmentation_cellvit.ipynb

Lines changed: 1011 additions & 0 deletions
Large diffs are not rendered by default.

examples/pannuke_nuclei_segmentation_omnipose.ipynb

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -215,7 +215,7 @@
215215
"All of these are defined in the `train()`-wrapper function.\n",
216216
"\n",
217217
"**The model**.\n",
218-
"First, we will define the CellPose nuclei segmentation model with a `imagenet` pre-trained encoder. Specifically, we will use the `focalnet_small_lrf` backbone for this demonstration. Many more encoders can be used, since these are imported from the `timm` library. There are also support for some transformer based encoders, but these are shown in another notebooks.\n",
218+
"First, we will define the OmniPose nuclei segmentation model with a `imagenet` pre-trained encoder. Specifically, we will use the `focalnet_small_lrf` backbone for this demonstration. Many more encoders can be used, since these are imported from the `timm` library. There are also support for some transformer based encoders, but these are shown in another notebooks.\n",
219219
"\n",
220220
"**Branch losses**.\n",
221221
"For each output of the model, we define a joint-loss function. These losses are summed together during backprop to form a multi-task loss. For the `\"omnipose\"`branch output we set MAE-loss (Mean Absolute Error) and for the `\"type\"` (cell type predictions) outputs we will set a joint-loss composed of CE-loss (Cross Entropy) and DICE-loss for both. For the CE-losses, we will also be using [spectral decoupling](https://arxiv.org/abs/2011.09468) to regularize the model. \n",

0 commit comments

Comments
 (0)