8.5 KiB
8.5 KiB
tags
| tags | |
|---|---|
|
Gate-Fusion механизмы для мультимодальных CVGL-моделей - Claude
GeoText-1652
#Датасеты #CVGL
- https://dl.acm.org/doi/10.1007/978-3-031-73247-8_13
- https://github.com/MultimodalGeo/GeoText-1652
- https://arxiv.org/html/2412.17007v1
- https://link.springer.com/chapter/10.1007/978-3-031-73247-8_13
- https://huggingface.co/datasets/GeoText/GeoText-1652
Where Am I
#CVGL
- https://arxiv.org/pdf/2212.04074
- https://arxiv.org/pdf/1703.07815
- https://arxiv.org/pdf/2303.15676
- https://github.com/yejy53/CVG-Text
- https://arxiv.org/abs/2412.17007
- https://arxiv.org/html/2412.17007
- https://arxiv.org/pdf/2412.17007
DEGF-YOLO Quality Aware Gating Unit 2025
#CVGL #gate #YOLO
- https://arxiv.org/pdf/2405.02591
- https://www.sciencedirect.com/science/article/abs/pii/S1474034626000881
- https://pmc.ncbi.nlm.nih.gov/articles/PMC11962121/
- https://www.mdpi.com/2673-2688/6/7/132
- https://arxiv.org/html/2506.23252v1
- https://pmc.ncbi.nlm.nih.gov/articles/PMC12473487/
Learned Gating residual Connections
#CVGL #gate
- https://www.nature.com/articles/s41598-025-11989-6
- https://www.mdpi.com/2076-3417/15/20/11259
- https://www.sciencedirect.com/science/article/abs/pii/S0893608025003624
- https://dl.acm.org/doi/10.1145/3756423.3756555
- https://www.preprints.org/manuscript/202409.1917/v1
- https://www.emergentmind.com/topics/early-fusion-methods
- https://www.emergentmind.com/topics/gated-fusion-mechanism
Multimodal Teacher-Studen Distillation
#CVGL #дистилляция Knowledge_Distillation
- https://arxiv.org/pdf/2509.00039
- https://www.sciencedirect.com/science/article/abs/pii/S1566253524005207
- https://www.ijcai.org/proceedings/2025/0248.pdf
- https://arxiv.org/pdf/2506.08772
- https://www.sciencedirect.com/science/article/abs/pii/S1051200424005001
UC Merced Saturation
#CVGL #Датасеты
- https://paperswithcode.com/sota/scene-classification-on-uc-merced-land-use
- https://www.researchgate.net/figure/UC-Merced-dataset-some-example-images-are-displayed-It-contains-21-scene-categories_fig3_271855526
- https://arxiv.org/html/2408.16265
- https://www.researchgate.net/publication/381622097_Classification_of_University_of_California_UC_Merced_Land-Use_Dataset_Remote_Sensing_Images_Using_Pre-Trained_Deep_Learning_Models
- https://arxiv.org/pdf/1703.00121
- https://arxiv.org/pdf/1608.05167
- https://onlinelibrary.wiley.com/doi/abs/10.1002/9781394234271.ch4
CrossText2Loc method architecture
#CVGL
- https://arxiv.org/html/2510.09586v1
- https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12390620/
- https://arxiv.org/pdf/2401.00421
- https://voxel51.com/blog/iccv-multimodal-ai
- https://arxiv.org/pdf/2412.17007
- https://arxiv.org/pdf/2412.17007
- https://arxiv.org/html/2504.09925v1
- https://arxiv.org/html/2504.09925v1
CVGL Adaptive Fusion Gating 2024-25
#CVGL #gate
- https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12299452/
- https://pmc.ncbi.nlm.nih.gov/articles/PMC11207219/
- https://arxiv.org/pdf/2509.12673
- https://link.springer.com/chapter/10.1007/978-981-95-5628-1_26
- https://www.mdpi.com/1424-8220/24/12/3719
- https://pmc.ncbi.nlm.nih.gov/articles/PMC11548418/
- https://arxiv.org/html/2510.22582v1
- https://dl.acm.org/doi/10.1145/3728482.3757381
Modality Reliability Score Mahalanobis Fusion DL
#CVGL InfoScore for residual routing
- https://www.sciencedirect.com/science/article/abs/pii/S1566253524004263
- https://arxiv.org/pdf/2309.05919
- https://arxiv.org/pdf/2303.13810
- https://arxiv.org/html/2505.05811
- https://arxiv.org/html/2309.05919v2
- https://arxiv.org/pdf/2504.16524
Multimodal Fusion RS Scene Classification (text, img)
#CVGL #fusion
- https://link.springer.com/article/10.1007/s42452-025-06689-9
- https://arxiv.org/pdf/2503.13814
- https://www.mdpi.com/2673-2688/7/1/5
- https://arxiv.org/pdf/2509.23310
- https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11838890/
- https://arxiv.org/pdf/2412.02531
Feature Norm Gating MM Fusion NN
#CVGL #fusion #gate #method/gate-fusion
- https://www.preprints.org/manuscript/202409.1917/v1
- https://arxiv.org/pdf/2204.00102
- https://arxiv.org/pdf/1807.06233
- https://arxiv.org/pdf/1702.01992
- https://arxiv.org/pdf/1803.09374
- https://www.emergentmind.com/topics/gated-fusion-mechanism
- https://arxiv.org/pdf/2512.04943
- https://www.emergentmind.com/topics/gated-multimodal-units
UAV Remote Sensing CLIP Scene Classification benchmark
#CVGL #VLM
- https://arxiv.org/pdf/1703.00121
- https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7070946/
- https://arxiv.org/pdf/2510.24321
- https://arxiv.org/abs/2510.24321
- https://arxiv.org/html/2510.24321v1
Text-Image Teacher Student Distillation (single modality Inference or missing modality)
#CVGL Knowledge_Distillation
- https://arxiv.org/pdf/2207.01426
- https://arxiv.org/pdf/2505.21549
- https://aclanthology.org/2024.emnlp-main.351.pdf
- https://arxiv.org/pdf/2603.24208
- https://arxiv.org/pdf/2504.07029
- https://arxiv.org/pdf/2309.15238
- https://arxiv.org/pdf/2507.18192
- https://arxiv.org/pdf/1703.00121
- https://arxiv.org/pdf/2303.15083
- https://openreview.net/forum?id=S5coB5kqSD¬eId=hUnKfBwGvh
- https://arxiv.org/pdf/2512.15311
- https://openaccess.thecvf.com/content/CVPR2024/html/Huo_C2KD_Bridging_the_Modality_Gap_for_Cross-Modal_Knowledge_Distillation_CVPR_2024_paper.html
- https://papers.nips.cc/paper_files/paper/2024/file/e34d908241aef40440e61d2a27715424-Paper-Conference.pdf missing modality RS distillation
- https://www.arxiv.org/pdf/2511.11460
- https://www.ijcai.org/proceedings/2025/
- https://www.researchgate.net/publication/395685476_DPMamba_Distillation_Prompt_Mamba_for_Multimodal_Remote_Sensing_Image_Classification_with_Missing_Modalities
- https://arxiv.org/html/2511.11460
- https://www.ijcai.org/proceedings/2025/0248.pdf
Entropy-Based Modality Weighted Adaptive Fusion
#CVGL #fusion
- https://arxiv.org/pdf/2510.01677
- https://www.emergentmind.com/topics/adaptive-modality-fusion-modules
- https://arxiv.org/pdf/2505.15417
- https://www.emergentmind.com/topics/dynamic-modality-weighting
- https://www.emergentmind.com/topics/entropy-gated-contrastive-fusion
- https://jrnl.kai.edu.ua/index.php/PIU/article/view/21098
- https://www.sciencedirect.com/science/article/abs/pii/S1566253525006530
- https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7513103/
- https://dl.acm.org/doi/10.1007/978-981-96-0972-7_2
Learnable Scalar Residual MM Fusion and Gate
#CVGL #fusion #gate
- https://www.emergentmind.com/topics/gated-multimodal-units
- https://arxiv.org/pdf/1907.00135
- https://link.springer.com/article/10.1007/s40747-025-02023-3
- https://www.emergentmind.com/topics/gated-fusion-module
- https://arxiv.org/html/2510.17078v1
- https://www.emergentmind.com/topics/adaptive-modality-fusion-modules
- https://www.themoonlight.io/en/review/beyond-simple-fusion-adaptive-gated-fusion-for-robust-multimodal-sentiment-analysis
- https://arxiv.org/html/2510.01677v1
Region Level Cross-Modal Matching
#CVGL
- https://arxiv.org/pdf/2603.08491
- https://www.ecva.net/papers/eccv_2024/papers_ECCV/papers/01738.pdf
- https://arxiv.org/pdf/2510.20291
- https://arxiv.org/html/2603.08491
- https://arxiv.org/pdf/2311.12751
- https://link.springer.com/chapter/10.1007/978-3-031-73247-8_13
- https://link.springer.com/chapter/10.1007/978-981-95-6123-0_53
Gated Residual Feature Fusion RS UAV 2024
#CVGL #gate #residual
- https://www.tandfonline.com/doi/full/10.1080/01431161.2024.2429784
- https://www.sciencedirect.com/science/article/abs/pii/S0031320325013858
- https://arxiv.org/pdf/2304.11422
- https://www.tandfonline.com/doi/abs/10.1080/2150704X.2024.2305177
- https://www.tandfonline.com/doi/abs/10.1080/01431161.2024.2425875
DEGF-YOLO
#CVGL #YOLO
- https://arxiv.org/pdf/2506.23252
- https://pmc.ncbi.nlm.nih.gov/articles/PMC12360555/
- https://www.mdpi.com/2504-446X/9/11/804
- https://www.mdpi.com/2072-4292/17/24/3936
- https://arxiv.org/pdf/2510.10765
- https://www.mdpi.com/2504-446X/9/7/479
Feature Quality, Norm, MM VL Fusion Gate
#CVGL #gate #VLM
- https://arxiv.org/pdf/2601.10710
- https://www.sciencedirect.com/science/article/pii/S1566253525011248
- https://arxiv.org/html/2504.02477v1
- https://arxiv.org/pdf/2501.08443
- https://arxiv.org/pdf/2504.09925
- https://arxiv.org/pdf/2410.17779
- https://arxiv.org/html/2511.02113v1
- https://medium.com/@xiaxiami/exploring-feature-fusion-and-matching-in-vision-language-models-3573b6e529b4