A Content Validity: Organisational Performance’s Assessment Instrument in the Construction Industry
DOI:
https://doi.org/10.24191/bej.v21i2.947Keywords:
Content validity, CVR, Lawshe's Technique, Construction, organisational performanceAbstract
Evaluating the performance of construction organisations is crucial for the success of construction projects. However, there are no standardized instruments and a single way to measure how well construction organisations perform, making it difficult for researchers and practitioners to get a clear picture of their performance. This study aims to validate an instrument for assessing the organisational performances of construction organisations through content validity. A panel of eight (8) experts reviewed the instrument, rating the relevance of each item to the concept of organisational performance. The Content Validity Ratio (CVR) results showed that twenty-one (21) of fifty-two (52) items were considered the most critical by the content experts, and the results for the Item Level Content Validity Index (I-CVI) showed that forty-six (46) items were considered appropriate. These findings demonstrate that the instrument has adequate content validity. The outcomes of this study have important implications for the use of this instrument in organisational performance assessment for the construction industry. The instrument can be used to measure construction organisational performance comprehensively and systematically. This will help researchers and practitioners better understand the factors that contribute to performance and develop interventions to improve it.
References
Ayre, C. & Scally, A. J (2014). Critical values for Lawshe’s content validity ratio: Revisiting the original methods of calculation Meas. Eval. Couns. Dev. (Sage Publ. Inc.) 47(1) 79–86. https://doi.org/10.1177/0748175613513808
Beck, C.T., & Gable, R. K., (2001). Further validation of the Postpartum Depression Screening Scale Nurs. Res. 50 155–164
Bititci, U. S., Carrie, A. S., & McDevitt, L. (1997). Integrated performance measurement systems: a development guide. International journal of operations & production management, 17(5), 522-534. https://doi.org/10.1108/01443579710167230
Cho, J. & Dansereau, F. (2010). Are transformational leaders fair? A multi-level study of transformational leadership, justice perceptions, and organisational citizenship behaviors. The Leadership Quarterly, Vol. 21 No. 3, pp. 409-421. https://doi.org/10.1016/j.leaqua.2010.03.006
Cicchetti, D. V., & Sparrow, S. A (1981). Developing criteria for establishing interrater reliability of specific items: Applications to assessment of adaptive behavior Am. J. Ment. Defic. 86(2) 127–137
Cook, D.A, Beckman, T.J., (2006). Current concepts in validity and reliability for psychometric instruments: theory and application. The American Journal of Medicine. 119(2): 166.e7–16, https://doi.org/10.1016/j.amjmed.2005.10.036
Cooper, D. & Schindler, P. (2011). Business research methods (New York: McGraw Hill)
Davis, L. L., (1992). Instrument review: Getting the most from a panel of experts. Appl. Nurs. Res. 5(4)194–197, https://doi.org/10.1016/s0897-1897(05)80008-4
DeVellis, R.F (2003). Scale Development: Theory and application (2nd ed.) Thousand Oaks, CA: Sage Publications
Gimbert, X., Bisbe, J. & Mendoza, X. (2010). The role of performance measurement systems in strategy formulation processes. Long Range Planning 43(4): 477-497.
Haynes, S.N, Richard D, Kubany, E.S. (1995). Content validity in psychological assessment: a functional approach to concepts and methods. Psychological Assessment. 7(3):238. https://doi.org/10.1037//1040-3590.7.3.238
Indeed Editorial Team (2023). What is performance measurement? (With benefits and methods). Retrieved from https://sg.indeed.com/career-advice/career-development/performance-measurement
Jiao, Y., Saeed, M. & Fu, S, & Wang, X. (2019). How knowledge sharing contributes to project portfolio success: Empirical analysis of construction firms in China. International Journal of Managing Projects in Business, IJMPB-10-2018-0221, https://doi.org/10.1108/IJMPB-10-2018-0221
Kagioglou, M., Cooper, R., & Aouad, G. (2001). Performance management in construction: a conceptual framework. Construction Management and Economics, 19(1), 85-95
Lawshe, C. H. (1975). A Quantitative Approach to Content Validity. Personnel Psychology Inc. 28(4)563–
https://doi.org/10.1111/j.1744-6570.1975.tb01393.x
Lin, G.B. & Shen, Q.P. (2007). Measuring the performance of value management studies in construction: a critical review. Journal of Management in Engineering, Vol. 23 No. 1, pp. 2‐9. https://doi.org/10.1061/(ASCE)0742-597X(2007)23:1(2)
Lynn, M. R., (1986). Determination and Quantification of Content Validity, Nursing Research 35(6)382–
https://doi.org/10.1097/00006199-198611000-00017
MacKenzie, S. B., & Podsakoff, P. M. (2012). Common Method Bias in Marketing: Causes, Mechanisms, and Procedural Remedies. Journal of Retailing, 88(4), 542–555. https://doi.org/10.1016/j.jretai.2012.08.001
Maqbool, R., Sudong, Y., Manzoor, N. and Rashid, Y. (2017). The impact of emotional intelligence, project managers ‘competencies, and transformational leadership on project success: an empirical perspective”, Project Management Journal, Vol. 48 No. 3, pp. 58-75. https://doi.org/10.1177/875697281704800304
Negron, L.A. (2020) Relationship between quality management practices, performance and maturity quality management, a contingency approach, Quality Management Journal, 27:4, 215-228, DOI: 10.1080/10686967.2020. https://doi:10.1080/10686967.2020.1809582
Padovani, M., & Carvalho, M. M. (2016). Integrated PPM process: Scale development and validation. International Journal of Project Management, 34(4), 627-642. https://doi.org/10.1016/j.ijproman.2016.01.006
Polit, D. F, Beck, C, T., & Owen, S. V. (2007). Focus on Research Methods: Is the CVI an Acceptable Indicator of Content Validity? Appraisal and Recommendations, Res. Nurs. Health 30 459–467. https://doi.org/ 10.1002/nur.20199
Polit, D. F., & Beck, C. T., (2006). The Content Validity Index Are You Sure You Know What’s Being Reported Critique and Recommendations, Research in Nursing & Health, 29 489–497, https://doi.org/10.1002/nur.20147
Rudd, J., Greenley, G., Beastson, A. & Lings, I. (2008). Strategic planning and performance: extending the debate. Journal of Business Research, Vol. 61 No. 2, pp. 99-108. https://doi.org/10.1016/j.jbusres.2007.06.014
Satyendra (2020). Organisational Performance and its influencing factors. Retrieved from https://www.ispatguru.com/organisational-performance-and-its-influencing-factors/
Straub, D. W., Boudreau, M. C., & Gefen, D. (2004). Validation guidelines for IS positivist research.
Communications of the AIS, 13(1), 380-427. https://doi.org/10.17705/1CAIS.01324
Tan, Y., Shen, L. & Langston, C. (2012), “Competition Environment, Strategy, and Performance in the Hong Kong Construction Industry”, Journal of Construction Engineering and Management, Vol. 138 No. 3, pp. 352-360. https://doi.org/10.1061/(ASCE)CO.1943-7862.0000407
Tomal, D.R. & Jones, K.J. (2015), “A comparison of core competencies of women and men leaders in the manufacturing industry”, The Coastal Business Journal, Vol. 14 No. 1, pp. 13-25.
Waltz, C. F, Strickland, O. L., & Lenz, E. R., (2005). Measurement in Nursing and Health Research Third Ed. (New York: Springer Publishing Company Inc)
Wang H. & Huang J (2006). The relationships between key stakeholders’ project performance and project success: Perceptions of Chinese construction supervising engineers. Int. Journal Project. Management., 24(3): 253- 260
Wynd, C. A, Schmidt, B. & Schaefer, M. A (2003). Two Quantitative Approaches for Estimating Content Validity West. J. Nurs. Res. 25(5) 508–518
Yaghmale, F. (2003). Content validity and its estimation J. Med. Educ. 3 25–27
Yang, Huan, John FY Yeung, Albert PC Chan, Yat Hung Chiang, and Daniel WM Chan. (2010). A critical review of performance measurement in construction. Journal of Facilities Management 8, no. 4: 269-284. https://doi.org/10.1108/14725961011078981
Yusoff M. S. B. (2019). ABC of content validation and content validity index calculation. Education in Medicine Journal. 11(2):49–54. https://doi.org/10.21315/eimj2019.11.2.6
Zamanzadeh V, Ghahramanian A, Rassouli M, Abbaszadeh A, Alavi-Majd H, & Nikanfar AR. (2015). Design and Implementation Content Validity Study: Development of an instrument for measuring Patient-Centered Communication. J Caring Sci. Jun 1;4(2):165-78. https://doi:10.15171/jcs.2015.017
Downloads
Published
Versions
- 06-08-2024 (2)
- 01-07-2024 (1)
How to Cite
Issue
Section
License
Copyright (c) 2024 Khairul Firdaus Anuar, Khairul Firdaus Anuar, Nurhaizan Mohd Zainudin, Muhammad Ashraf Fauzi
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
CC BY-NC-ND 4.0 DEED
Attribution-NonCommercial-NoDerivs 4.0 International
