Evaluation of management methods

Combined evaluation report. Created on 2026-09-04.

Analysis complementing the paper "Evaluating an AI-supported serious game in digital health management education: Mixed-Methods Approach" (Hering et al., 2026).

1. Data overview

Overall means and standard deviations by method

MethodnMSD
Stakeholder Analysis204.260.84
Empathy Map184.340.86
Process Analysis334.240.79
PESTEL Analysis164.190.79
SWOT Analysis144.550.74
IRLM and KPIs34.220.64

Note: n = individual rating per student summarized across HSO and MSH; HSO = Osnabrück University of Applied Sciences; MSH = Medical School Hamburg; M = Mean score; SD = Standard deviation; for process analysis, evaluations of both the current-state and target-state analyses were pooled.

2. Instrument Results / Figures

Stakeholder Analysis

Individual rating per student summarized across HSO and MSH (n = 20)

Stakeholder Analysis

Note: HSO = Osnabrück University of Applied Sciences; MSH = Medical School Hamburg.

Empathy Map

Individual rating per student summarized across HSO and MSH (n = 18)

Empathy Map

Note: HSO = Osnabrück University of Applied Sciences; MSH = Medical School Hamburg.

Process Analysis

Individual rating per student summarized across HSO and MSH; evaluations of both the current-state and target-state analyses were pooled (n = 33)

Process Analysis

Note: HSO = Osnabrück University of Applied Sciences; MSH = Medical School Hamburg.

PESTEL Analysis

Individual rating per student summarized across HSO and MSH (n = 16)

PESTEL Analysis

Note: HSO = Osnabrück University of Applied Sciences; MSH = Medical School Hamburg; PESTEL = Political, Economic, Social, Technological, Environmental, Legal.

SWOT Analysis

Individual rating per student summarized across HSO and MSH (n = 14)

SWOT Analysis

Note: HSO = Osnabrück University of Applied Sciences; MSH = Medical School Hamburg; SWOT = Strengths, Weaknesses, Opportunities, Threats.

IRLM and KPIs

Individual rating per student summarized across HSO and MSH (n = 3)

IRLM and KPIs

Note: HSO = Osnabrück University of Applied Sciences; MSH = Medical School Hamburg; IRLM = Implementation Research Logic Model; KPI = Key Performance Indicator.

3. Instrument Results / Statistics

Item means and standard deviations

MethodItemnMSD
Stakeholder AnalysisI1: The lecturer's introduction to the method was helpful.204.600.60
Stakeholder AnalysisI2: The description of the method in the game was clearly worded.204.350.49
Stakeholder AnalysisI3: Working with the method was clearly structured.204.750.55
Stakeholder AnalysisI4: The individual work steps were logically connected.204.650.49
Stakeholder AnalysisI5: I understood why the method was applied.204.150.81
Stakeholder AnalysisI6: The implementation of the method was comprehensible to me.204.300.73
Stakeholder AnalysisI7: I was able to apply the method independently after the introduction and the information provided in the game.204.150.88
Stakeholder AnalysisI8: The method helped me better understand the complexity of implementing a digitalization strategy.204.050.69
Stakeholder AnalysisI9: The method helped me derive actions for the Gantt chart.203.351.14
Stakeholder AnalysisI10: The results of the method were substantively coherent and comprehensible.204.200.83
Stakeholder AnalysisI11: I perceived the exchange with the stakeholders as helpful for applying the method.204.750.44
Stakeholder AnalysisI12: I can imagine applying the method in practice.203.801.06
Empathy MapI1: The lecturer's introduction to the method was helpful.184.110.83
Empathy MapI2: The description of the method in the game was clearly worded.184.720.46
Empathy MapI3: Working with the method was clearly structured.184.720.46
Empathy MapI4: The individual work steps were logically connected.184.670.49
Empathy MapI5: I understood why the method was applied.184.330.84
Empathy MapI6: The implementation of the method was comprehensible to me.184.330.84
Empathy MapI7: I was able to apply the method independently after the introduction and the information provided in the game.184.330.97
Empathy MapI8: The method helped me better understand the complexity of implementing a digitalization strategy.184.060.87
Empathy MapI9: The method helped me derive actions for the Gantt chart.183.561.15
Empathy MapI10: The results of the method were substantively coherent and comprehensible.184.500.71
Empathy MapI11: I perceived the exchange with the stakeholders as helpful for applying the method.184.830.38
Empathy MapI12: I can imagine applying the method in practice.183.941.16
Process AnalysisI1: The lecturer's introduction to the method was helpful.333.940.83
Process AnalysisI2: The description of the method in the game was clearly worded.334.270.91
Process AnalysisI3: Working with the method was clearly structured.334.420.75
Process AnalysisI4: The individual work steps were logically connected.334.480.71
Process AnalysisI5: I understood why the method was applied.334.480.67
Process AnalysisI6: The implementation of the method was comprehensible to me.334.330.69
Process AnalysisI7: I was able to apply the method independently after the introduction and the information provided in the game.334.270.72
Process AnalysisI8: The method helped me better understand the complexity of implementing a digitalization strategy.334.300.64
Process AnalysisI9: The method helped me derive actions for the Gantt chart.333.670.78
Process AnalysisI10: The results of the method were substantively coherent and comprehensible.334.270.67
Process AnalysisI11: I perceived the exchange with the stakeholders as helpful for applying the method.334.550.71
Process AnalysisI12: I can imagine applying the method in practice.333.940.97
PESTEL AnalysisI1: The lecturer's introduction to the method was helpful.163.380.89
PESTEL AnalysisI2: The description of the method in the game was clearly worded.164.310.60
PESTEL AnalysisI3: Working with the method was clearly structured.164.380.62
PESTEL AnalysisI4: The individual work steps were logically connected.164.500.63
PESTEL AnalysisI5: I understood why the method was applied.164.440.73
PESTEL AnalysisI6: The implementation of the method was comprehensible to me.164.380.72
PESTEL AnalysisI7: I was able to apply the method independently after the introduction and the information provided in the game.164.120.72
PESTEL AnalysisI8: The method helped me better understand the complexity of implementing a digitalization strategy.164.310.70
PESTEL AnalysisI9: The method helped me derive actions for the Gantt chart.163.940.77
PESTEL AnalysisI10: The results of the method were substantively coherent and comprehensible.164.440.63
PESTEL AnalysisI11: I perceived the exchange with the stakeholders as helpful for applying the method.164.380.89
PESTEL AnalysisI12: I can imagine applying the method in practice.163.690.87
SWOT AnalysisI1: The lecturer's introduction to the method was helpful.143.571.16
SWOT AnalysisI2: The description of the method in the game was clearly worded.144.570.51
SWOT AnalysisI3: Working with the method was clearly structured.144.640.63
SWOT AnalysisI4: The individual work steps were logically connected.144.860.36
SWOT AnalysisI5: I understood why the method was applied.144.790.43
SWOT AnalysisI6: The implementation of the method was comprehensible to me.144.790.58
SWOT AnalysisI7: I was able to apply the method independently after the introduction and the information provided in the game.144.790.43
SWOT AnalysisI8: The method helped me better understand the complexity of implementing a digitalization strategy.144.500.76
SWOT AnalysisI9: The method helped me derive actions for the Gantt chart.144.210.80
SWOT AnalysisI10: The results of the method were substantively coherent and comprehensible.144.710.47
SWOT AnalysisI11: I perceived the exchange with the stakeholders as helpful for applying the method.144.710.61
SWOT AnalysisI12: I can imagine applying the method in practice.144.430.94
IRLM and KPIsI1: The lecturer's introduction to the method was helpful.33.671.15
IRLM and KPIsI2: The description of the method in the game was clearly worded.34.330.58
IRLM and KPIsI3: Working with the method was clearly structured.34.670.58
IRLM and KPIsI4: The individual work steps were logically connected.34.670.58
IRLM and KPIsI5: I understood why the method was applied.34.330.58
IRLM and KPIsI6: The implementation of the method was comprehensible to me.34.330.58
IRLM and KPIsI7: I was able to apply the method independently after the introduction and the information provided in the game.34.000.00
IRLM and KPIsI8: The method helped me better understand the complexity of implementing a digitalization strategy.34.330.58
IRLM and KPIsI9: The method helped me derive actions for the Gantt chart.33.670.58
IRLM and KPIsI10: The results of the method were substantively coherent and comprehensible.34.330.58
IRLM and KPIsI11: I perceived the exchange with the stakeholders as helpful for applying the method.34.670.58
IRLM and KPIsI12: I can imagine applying the method in practice.33.670.58

Note: n = individual rating per student summarized across HSO and MSH; HSO = Osnabrück University of Applied Sciences; MSH = Medical School Hamburg; M = Mean score; SD = Standard deviation; for process analysis, evaluations of both the current-state and target-state analyses were pooled.