Call for Reproducibility Submissions

Overview

ICMR Repro (ICMR Reproducibility) is dedicated to fostering a research principle and cultural consensus where transparency, repeatability, and rigorous validation of multimedia research findings are the norm rather than the exception. Reproducibility is a major principle of the scientific method, ensuring that experimental results can be independently verified and built upon by the research community. The ICMR Reproducibility Committee facilitates this process by encouraging researchers to share not only their replication descriptions but also their code, data, experimental frameworks or systems, and analysis results. 

As part of this initiative, authors of accepted ACM ICMR papers can submit companion reproducibility papers, which undergo a formal review process. Successful submissions receive ACM Reproducibility Badges, signaling to the community that the research findings have been independently validated. By supporting repeatable and shareable research, this program enhances the impact and credibility of multimedia research, accelerates knowledge dissemination, and ensures that scientific advancements are robust, reliable, and reusable.

Important Dates

Submission Start Date: February 8, 2025

Submission Deadline: March 10, 2025

Paper Notification: April 1, 2025

Camera-Ready Due: April 14, 2025

Any future update will be released here.

Submission Guidelines

Submissions to ICMR Repro must include the following components:
Registration & Submission

Please register at ICMR 2025 CMT, select Reproducibility on the left top option bar to enter the ICMR Repro 2025 Submission Webpage.

For best practices in preparing your submission, please refer to: https://icmr-reproducibility.github.io/website/best_practices

Reproducibility Paper (2-3.5 pages)

The paper in the standard ICMR format should clearly outline, including a high-level overview description of the original experiments/system, and their implementation and techstack in detail, how the results can be reproduced, etc. 

Archive

All materials should be cleanly organized and packaged in a git repository and readily available for evaluation.

A well-structured repository containing:

  • Code and scripts
  • Datasets and protocols
  • Detailed README files with instructions for executing the experiments
  • Any additional materials necessary to ensure the successful reproduction of results

Review and Badging Process

The ICMR 2025 Reproducibility follows the Reproducibility Review and ACM Badging processes. Accepted submissions will be awarded the ACM badges, indicating that an independent group has successfully validated the results using the provided materials. The badged companion paper will be included in the ICMR 2025 proceedings.

During the process of assessing the submission, the reviewers interact with the submitting authors in order to work through any technical issues or gaps in the documentation that they find. If it is possible to address all the issues, then the reviewers document the review process in a description which is added as a section to the reproducibility companion paper that is under review. If the reviewers find that the technical issues or problems with the documentation cannot be resolved, then the reproducibility companion paper is rejected. 

Contact Information

For inquiries, please contact the ICMR 2025 Repro Committee at: icmrrepro@gmail.com

Chairs:

Bo Wu, MIT-IBM Watson AI Lab

Qiushi Huang, University of Surrey

©Copyright. All rights reserved.

We need your consent to load the translations

We use a third-party service to translate the website content that may collect data about your activity. Please review the details in the privacy policy and accept the service to view the translations.