bcm

Leejaegun·2025년 4월 21일
post-thumbnail

🧩 GFSS Problem Settings (Section 3.1)

  • 입력 이미지: XRH×W×3(RGB image of height H and width W)X \in \mathbb{R}^{H \times W \times 3} \quad\text{(RGB image of height H and width W)}

  • 세그멘테이션 정답 맵 (GT): YYH×W(semantic label per pixel)Y \in \mathcal{Y}^{H \times W} \quad\text{(semantic label per pixel)}

  • 클래스 셋 정의:

    Yb: base classes (e.g., {0,1,2,3})\mathcal{Y}_b: \text{ base classes (e.g., } \{0, 1, 2, 3\} \text{)}
    Yn: novel classes (e.g., {4,5})\mathcal{Y}_n: \text{ novel classes (e.g., } \{4, 5\} \text{)}
    Yall=YbYnwith YbYn=\mathcal{Y}_{all} = \mathcal{Y}_b \cup \mathcal{Y}_n \quad\text{with } \mathcal{Y}_b \cap \mathcal{Y}_n = \emptyset
  • 픽셀 단위 레이블 정의:

    [Y]j=yclass y exists at pixel j{1,,HW}[Y]_j = y \Rightarrow \text{class } y \text{ exists at pixel } j \in \{1, \dots, HW\}
  • base-class segmentation model: gb(X)=Y^bYbH×Wg_{b}(X) = \hat{Y}_b \in \mathcal{Y}_b^{H \times W}

  • K-shot novel class support set:

    K support images per each yYnK×Yn total annotated images\text{K support images per each } y \in \mathcal{Y}_n \quad\Rightarrow\quad K \times |\mathcal{Y}_n| \text{ total annotated images}
  • 최종 목표 (GFSS prediction): gbBCM(X)=Y^BCMYallH×Wg^{BCM}_b(X) = \hat{Y}^{BCM} \in \mathcal{Y}_{all}^{H \times W}


βB,train gβ using modified K-shot set where yYn{0}\forall \beta \in \mathcal{B}, \quad \text{train } g_\beta \text{ using modified } K\text{-shot set where } y \in \mathcal{Y}_n \cup \{0\}

{β}β\setminus \{\beta\} \rightarrow \beta

gβ=argming LCE or other effective lossesg_\beta = \arg\min_{g} \ \mathcal{L}_{\text{CE}} \text{ or other effective losses}

🔁 BCM Flow (Symbolic Steps)

  • 1️⃣: Y^b=gb(X)\hat{Y}_b = g_b(X)

  • 2️⃣: βB,Iβ={j[Y^b]j=β}\forall \beta \in \mathcal{B}, \quad \mathcal{I}_\beta = \{j \mid [\hat{Y}_b]_j = \beta\}

  • 3️⃣: Y^β=gβ(Feature(X))\hat{Y}_\beta = g_\beta(\text{Feature}(X))

  • 4️⃣: [Y^b]j[Y^β]j,jIβ[\hat{Y}_b]_j \leftarrow [\hat{Y}_\beta]_j, \quad \forall j \in \mathcal{I}_\beta

  • 5️⃣: Y^BCM=Y^b\hat{Y}_{BCM} = \hat{Y}_b


필요하면 이 수식을 코드 스타일이나 LaTeX 박스, 논문 형식으로 재정렬해드릴 수 있어요!

profile
Lee_AA

0개의 댓글