Skip to content
/ FSMR Public

The source code of paper "A Feature Swapping Multi-modal Reasoning Framework for PMR""

License

Notifications You must be signed in to change notification settings

THU-BPM/FSMR

Folders and files

NameName
Last commit message
Last commit date

Latest commit

Oct 21, 2023
ab37ede · Oct 21, 2023

History

3 Commits
Oct 18, 2023
Oct 18, 2023
Oct 18, 2023
Oct 18, 2023
Oct 18, 2023
Oct 15, 2023
Oct 21, 2023
Oct 18, 2023
Oct 18, 2023

Repository files navigation

A Feature Swapping Multi-modal Reasoning Framework for PMR

Fold Structure

FSMR
├── a_transformers #code
├── clip #code
├── data_processing #code
├── local_transformers #code and the roberta-large checkpoint
├── modeling #code
├── utils #code
├── output #output path (generated after running)
│   └── checkpoint #checkpoints and log files
│   └── results #test result jsons
├── Checkpoints_and_Data #checkpoints and pre-processd PMR dataset
├── Multi-View-Reasoning-cold-start-1.pth #cold-start checkpoint
├── config.yaml #configuration
└── run_PMR_FSMR.py

Training

  1. modify config.yaml

    • set do_train to True

    • modify output_dir

    # modify config.yaml as this
    do_train: True
    output_dir: ./output/checkpoint/output1/
  2. run

    python run_PMR_FSMR.py

Testing

  1. modify config.yaml

    • set do_train to False

    • modify eval_model_dir

    • modify result_dir

    # modify config.yaml as this
    do_train: False
    eval_model_dir: ./output/checkpoint/output1/FSMR-2-0.6326397919375812-1600.pth
    result_dir: ./output/results/output1/
  2. run

    python run_PMR_FSMR.py

About

The source code of paper "A Feature Swapping Multi-modal Reasoning Framework for PMR""

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages