Experiment Design: A Guide to the Goal-Question-Metric Approach

Learn how to define a software engineering experiment using the Goal-Question-Metric (GQM) framework. This article outlines the design and hypotheses for a study on pair vs. solo programming, focusing on duration and effort.


This content originally appeared on HackerNoon and was authored by Pair Programming AI Agent

Abstract and 1. Introduction

2. Experiment Definition

3. Experiment Design and Conduct

3.1 Latin Square Designs

3.2 Subjects, Tasks and Objects

3.3 Conduct

3.4 Measures

4. Data Analysis

4.1 Model Assumptions

4.2 Analysis of Variance (ANOVA)

4.3 Treatment Comparisons

4.4 Effect Size and Power Analysis

5. Experiment Limitations and 5.1 Threats to the Conclusion Validity

5.2 Threats to Internal Validity

5.3 Threats to Construct Validity

5.4 Threats to External Validity

6. Discussion and 6.1 Duration

6.2 Effort

7. Conclusions and Further Work, and References

2. Experiment Definition

We use the Goal-Question-Metric approach [2] for defining the experiment. This approach facilitates to identify the object of study, purpose, quality focus, perspective and context of an experiment. We define the experiment as follows:

\ Study pair and solo programming with the purpose of evaluating possible differences between these two programming types with respect to duration and effort. This study is conducted from the point of view of the researcher under an academic context. This context is composed by juniors students enrolled in a course of DOE where they will write, by pairs or individually, two small programs.

\ From the experiment definition we derive the following hypotheses:

\

\

:::info Authors:

(1) Omar S. Gómez, full time professor of Software Engineering at Mathematics Faculty of the Autonomous University of Yucatan (UADY);

(2) José L. Batún, full time professor of Statistics at Mathematics Faculty of the Autonomous University of Yucatan (UADY);

(3) Raúl A. Aguilar, Faculty of Mathematics, Autonomous University of Yucatan Merida, Yucatan 97119, Mexico.

:::


:::info This paper is available on arxiv under CC BY-NC-ND 4.0 DEED license.

:::

\


This content originally appeared on HackerNoon and was authored by Pair Programming AI Agent


Print Share Comment Cite Upload Translate Updates
APA

Pair Programming AI Agent | Sciencx (2025-08-19T01:29:03+00:00) Experiment Design: A Guide to the Goal-Question-Metric Approach. Retrieved from https://www.scien.cx/2025/08/19/experiment-design-a-guide-to-the-goal-question-metric-approach/

MLA
" » Experiment Design: A Guide to the Goal-Question-Metric Approach." Pair Programming AI Agent | Sciencx - Tuesday August 19, 2025, https://www.scien.cx/2025/08/19/experiment-design-a-guide-to-the-goal-question-metric-approach/
HARVARD
Pair Programming AI Agent | Sciencx Tuesday August 19, 2025 » Experiment Design: A Guide to the Goal-Question-Metric Approach., viewed ,<https://www.scien.cx/2025/08/19/experiment-design-a-guide-to-the-goal-question-metric-approach/>
VANCOUVER
Pair Programming AI Agent | Sciencx - » Experiment Design: A Guide to the Goal-Question-Metric Approach. [Internet]. [Accessed ]. Available from: https://www.scien.cx/2025/08/19/experiment-design-a-guide-to-the-goal-question-metric-approach/
CHICAGO
" » Experiment Design: A Guide to the Goal-Question-Metric Approach." Pair Programming AI Agent | Sciencx - Accessed . https://www.scien.cx/2025/08/19/experiment-design-a-guide-to-the-goal-question-metric-approach/
IEEE
" » Experiment Design: A Guide to the Goal-Question-Metric Approach." Pair Programming AI Agent | Sciencx [Online]. Available: https://www.scien.cx/2025/08/19/experiment-design-a-guide-to-the-goal-question-metric-approach/. [Accessed: ]
rf:citation
» Experiment Design: A Guide to the Goal-Question-Metric Approach | Pair Programming AI Agent | Sciencx | https://www.scien.cx/2025/08/19/experiment-design-a-guide-to-the-goal-question-metric-approach/ |

Please log in to upload a file.




There are no updates yet.
Click the Upload button above to add an update.

You must be logged in to translate posts. Please log in or register.