abb3337f8d
Architecture v2: - Query branch: drone + text -> GatedFusion -> proj -> query_emb - Gallery branch: satellite -> proj -> gallery_emb - Single InfoNCE loss (asymmetric 0.6/0.4) - GatedFusion: learnable gated addition (sigma(alpha)*img + (1-sigma(alpha))*text) - Baseline mode: gate=1.0 (text ignored) Dataset: - UAV-GeoLoc loader with template captions from path metadata - 27 terrain types with predefined features - Random positive crop sampling per epoch Configs: balanced (gate=0.7), baseline (no text), text_heavy (gate=0.3) Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
10 lines
245 B
Plaintext
10 lines
245 B
Plaintext
# Text-heavy: gate initialized low (more text weight).
|
|
# query = sigma(0.3) * drone + 0.7 * text
|
|
|
|
include 'balanced.gin'
|
|
|
|
DualEncoderCaptionTest.init_gate = 0.3
|
|
GatedFusion.init_gate = 0.3
|
|
|
|
TrainConfig.output_dir = "out/caption_test/text_heavy"
|