This is an outdated version published on 01-07-2024. Read the most recent version.

A Content Validity: Organisational Performance’s Assessment Instrument in the Construction Industry

Authors

  • Khairul Firdaus Anuar Department of Science & Technology, Faculty of Technology, Design & Management, UCYP University
  • Khairul Firdaus Anuar Faculty of Industrial Management, Universiti Malaysia Pahang Al-Sultan Abdullah, 26300, Gambang, Pahang.
  • Nurhaizan Mohd Zainudin Faculty of Industrial Management, Universiti Malaysia Pahang Al-Sultan Abdullah, 26300, Gambang, Pahang
  • Muhammad Ashraf Fauzi Faculty of Industrial Management, Universiti Malaysia Pahang Al-Sultan Abdullah, 26300, Gambang, Pahang

DOI:

https://doi.org/10.24191/bej.v21i2.947

Keywords:

Content validity, CVR, Lawshe's Technique, Construction, organisational performance

Abstract

Evaluating the performance of construction organisations is crucial for the success of construction projects. However, there are no standardized instruments and a single way to measure how well construction organisations perform, making it difficult for researchers and practitioners to get a clear picture of their performance. This study aims to validate an instrument for assessing the organisational performances of construction organisations through content validity. A panel of eight (8) experts reviewed the instrument, rating the relevance of each item to the concept of organisational performance. The Content Validity Ratio (CVR) results showed that twenty-one (21) of fifty-two (52) items were considered the most critical by the content experts, and the results for the Item Level Content Validity Index (I-CVI) showed that forty-six (46) items were considered appropriate. These findings demonstrate that the instrument has adequate content validity. The outcomes of this study have important implications for the use of this instrument in organisational performance assessment for the construction industry. The instrument can be used to measure construction organisational performance comprehensively and systematically. This will help researchers and practitioners better understand the factors that contribute to performance and develop interventions to improve it.

References

Ayre, C. & Scally, A. J (2014). Critical values for Lawshe’s content validity ratio: Revisiting the original methods of calculation Meas. Eval. Couns. Dev. (Sage Publ. Inc.) 47(1) 79–86. https://doi.org/10.1177/0748175613513808

Beck, C.T., & Gable, R. K., (2001). Further validation of the Postpartum Depression Screening Scale Nurs. Res. 50 155–164

Bititci, U. S., Carrie, A. S., & McDevitt, L. (1997). Integrated performance measurement systems: a development guide. International journal of operations & production management, 17(5), 522-534. https://doi.org/10.1108/01443579710167230

Cho, J. & Dansereau, F. (2010). Are transformational leaders fair? A multi-level study of transformational leadership, justice perceptions, and organisational citizenship behaviors. The Leadership Quarterly, Vol. 21 No. 3, pp. 409-421. https://doi.org/10.1016/j.leaqua.2010.03.006

Cicchetti, D. V., & Sparrow, S. A (1981). Developing criteria for establishing interrater reliability of specific items: Applications to assessment of adaptive behavior Am. J. Ment. Defic. 86(2) 127–137

Cook, D.A, Beckman, T.J., (2006). Current concepts in validity and reliability for psychometric instruments: theory and application. The American Journal of Medicine. 119(2): 166.e7–16, https://doi.org/10.1016/j.amjmed.2005.10.036

Cooper, D. & Schindler, P. (2011). Business research methods (New York: McGraw Hill)

Davis, L. L., (1992). Instrument review: Getting the most from a panel of experts. Appl. Nurs. Res. 5(4)194–197, https://doi.org/10.1016/s0897-1897(05)80008-4

DeVellis, R.F (2003). Scale Development: Theory and application (2nd ed.) Thousand Oaks, CA: Sage Publications

Gimbert, X., Bisbe, J. & Mendoza, X. (2010). The role of performance measurement systems in strategy formulation processes. Long Range Planning 43(4): 477-497.

Haynes, S.N, Richard D, Kubany, E.S. (1995). Content validity in psychological assessment: a functional approach to concepts and methods. Psychological Assessment. 7(3):238. https://doi.org/10.1037//1040-3590.7.3.238

Indeed Editorial Team (2023). What is performance measurement? (With benefits and methods). Retrieved from https://sg.indeed.com/career-advice/career-development/performance-measurement

Jiao, Y., Saeed, M. & Fu, S, & Wang, X. (2019). How knowledge sharing contributes to project portfolio success: Empirical analysis of construction firms in China. International Journal of Managing Projects in Business, IJMPB-10-2018-0221, https://doi.org/10.1108/IJMPB-10-2018-0221

Kagioglou, M., Cooper, R., & Aouad, G. (2001). Performance management in construction: a conceptual framework. Construction Management and Economics, 19(1), 85-95

Lawshe, C. H. (1975). A Quantitative Approach to Content Validity. Personnel Psychology Inc. 28(4)563–

https://doi.org/10.1111/j.1744-6570.1975.tb01393.x

Lin, G.B. & Shen, Q.P. (2007). Measuring the performance of value management studies in construction: a critical review. Journal of Management in Engineering, Vol. 23 No. 1, pp. 2‐9. https://doi.org/10.1061/(ASCE)0742-597X(2007)23:1(2)

Lynn, M. R., (1986). Determination and Quantification of Content Validity, Nursing Research 35(6)382–

https://doi.org/10.1097/00006199-198611000-00017

MacKenzie, S. B., & Podsakoff, P. M. (2012). Common Method Bias in Marketing: Causes, Mechanisms, and Procedural Remedies. Journal of Retailing, 88(4), 542–555. https://doi.org/10.1016/j.jretai.2012.08.001

Maqbool, R., Sudong, Y., Manzoor, N. and Rashid, Y. (2017). The impact of emotional intelligence, project managers ‘competencies, and transformational leadership on project success: an empirical perspective”, Project Management Journal, Vol. 48 No. 3, pp. 58-75. https://doi.org/10.1177/875697281704800304

Negron, L.A. (2020) Relationship between quality management practices, performance and maturity quality management, a contingency approach, Quality Management Journal, 27:4, 215-228, DOI: 10.1080/10686967.2020. https://doi:10.1080/10686967.2020.1809582

Padovani, M., & Carvalho, M. M. (2016). Integrated PPM process: Scale development and validation. International Journal of Project Management, 34(4), 627-642. https://doi.org/10.1016/j.ijproman.2016.01.006

Polit, D. F, Beck, C, T., & Owen, S. V. (2007). Focus on Research Methods: Is the CVI an Acceptable Indicator of Content Validity? Appraisal and Recommendations, Res. Nurs. Health 30 459–467. https://doi.org/ 10.1002/nur.20199

Polit, D. F., & Beck, C. T., (2006). The Content Validity Index Are You Sure You Know What’s Being Reported Critique and Recommendations, Research in Nursing & Health, 29 489–497, https://doi.org/10.1002/nur.20147

Rudd, J., Greenley, G., Beastson, A. & Lings, I. (2008). Strategic planning and performance: extending the debate. Journal of Business Research, Vol. 61 No. 2, pp. 99-108. https://doi.org/10.1016/j.jbusres.2007.06.014

Satyendra (2020). Organisational Performance and its influencing factors. Retrieved from https://www.ispatguru.com/organisational-performance-and-its-influencing-factors/

Straub, D. W., Boudreau, M. C., & Gefen, D. (2004). Validation guidelines for IS positivist research.

Communications of the AIS, 13(1), 380-427. https://doi.org/10.17705/1CAIS.01324

Tan, Y., Shen, L. & Langston, C. (2012), “Competition Environment, Strategy, and Performance in the Hong Kong Construction Industry”, Journal of Construction Engineering and Management, Vol. 138 No. 3, pp. 352-360. https://doi.org/10.1061/(ASCE)CO.1943-7862.0000407

Tomal, D.R. & Jones, K.J. (2015), “A comparison of core competencies of women and men leaders in the manufacturing industry”, The Coastal Business Journal, Vol. 14 No. 1, pp. 13-25.

Waltz, C. F, Strickland, O. L., & Lenz, E. R., (2005). Measurement in Nursing and Health Research Third Ed. (New York: Springer Publishing Company Inc)

Wang H. & Huang J (2006). The relationships between key stakeholders’ project performance and project success: Perceptions of Chinese construction supervising engineers. Int. Journal Project. Management., 24(3): 253- 260

Wynd, C. A, Schmidt, B. & Schaefer, M. A (2003). Two Quantitative Approaches for Estimating Content Validity West. J. Nurs. Res. 25(5) 508–518

Yaghmale, F. (2003). Content validity and its estimation J. Med. Educ. 3 25–27

Yang, Huan, John FY Yeung, Albert PC Chan, Yat Hung Chiang, and Daniel WM Chan. (2010). A critical review of performance measurement in construction. Journal of Facilities Management 8, no. 4: 269-284. https://doi.org/10.1108/14725961011078981

Yusoff M. S. B. (2019). ABC of content validation and content validity index calculation. Education in Medicine Journal. 11(2):49–54. https://doi.org/10.21315/eimj2019.11.2.6

Zamanzadeh V, Ghahramanian A, Rassouli M, Abbaszadeh A, Alavi-Majd H, & Nikanfar AR. (2015). Design and Implementation Content Validity Study: Development of an instrument for measuring Patient-Centered Communication. J Caring Sci. Jun 1;4(2):165-78. https://doi:10.15171/jcs.2015.017

Downloads

Published

01-07-2024

Versions

How to Cite

Anuar, K. F. ., Anuar, K. F., Mohd Zainudin, N. ., & Fauzi, M. A. . (2024). A Content Validity: Organisational Performance’s Assessment Instrument in the Construction Industry. Built Environment Journal, 21(2), 141–158. https://doi.org/10.24191/bej.v21i2.947