The fundamental principles of reproducibility

Area of Science:

• Computational Science
• Scientific Methodology

Background:

• The term 'reproducibility' is often used ambiguously in scientific literature.
• Lack of clear definitions hinders reliable scientific research and validation.

Purpose of the Study:

• To fundamentally analyze and characterize the scientific method to establish a robust definition of reproducibility.
• To survey existing literature on reproducibility and replication.
• To propose a clear taxonomy for understanding and implementing reproducibility.

Main Methods:

• Analysis of the scientific method to derive core principles.
• Literature review of reproducibility and replication studies.
• Modeling experiments as tasks and problem-solving methods.
• Application of machine learning as a case study.

Main Results:

• A fundamental definition of reproducibility is established.
• Three distinct degrees of reproducibility are specified.
• Four unique types of reproducibility are identified.

Conclusions:

• The proposed framework enhances clarity and consistency in scientific research.
• This work contributes to improving reliability and reproducibility in computational science.
• The defined terminology aids in verification, validation, and uncertainty quantification.