Architecture v2: - Query branch: drone + text -> GatedFusion -> proj -> query_emb - Gallery branch: satellite -> proj -> gallery_emb - Single InfoNCE loss (asymmetric 0.6/0.4) - GatedFusion: learnable gated addition (sigma(alpha)*img + (1-sigma(alpha))*text) - Baseline mode: gate=1.0 (text ignored) Dataset: - UAV-GeoLoc loader with template captions from path metadata - 27 terrain types with predefined features - Random positive crop sampling per epoch Configs: balanced (gate=0.7), baseline (no text), text_heavy (gate=0.3) Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
11 lines
297 B
Plaintext
11 lines
297 B
Plaintext
# Baseline: no text fusion (gate forced to 1.0).
|
|
# query = drone_only -> InfoNCE vs satellite
|
|
# Reference R@1 for delta computation.
|
|
|
|
include 'balanced.gin'
|
|
|
|
DualEncoderCaptionTest.baseline_mode = True
|
|
GatedFusion.baseline_mode = True
|
|
|
|
TrainConfig.output_dir = "out/caption_test/baseline_no_text"
|