Structural equation model-based performance measurement system for transferring PPP water projects: a China perspective
Abstract
A series of performance measurement need to be carried out throughout the project life cycle to ensure the successful transfer of public-private partnership (PPP) assets and meet stakeholder needs. More and more water projects are stepping into the transfer phase, but less studies carry out in-depth and systematic discussion on the performance measurement of PPP water projects at the transfer phase. Hence, to fill this gap, this research establishes a new performance measurement system (PMS) for evaluating the performance of the PPP projects stepping into the transfer phase based on the key performance indicators (KPIs). Through case study, expert interview and questionnaire, this paper formulates the logical basis behind PPP water projects at the transfer phase and subsequently constructs the transfer performance measurement system (TPMS) of these projects. Then, it conducts a confirmatory analysis of the impact relationship between the indicators based on structural equation modeling (SEM). Findings of expert interview and questionnaire indicate that there are 7 primary and 26 secondary indicators, and the model has a good fit. The TPMS will provide governments, operators and other stakeholders with a comprehensive and complete understanding as to indicators required of an effective performance measurement of PPP water projects.
Keyword : PPP, water sector, transfer phase, performance measurement
This work is licensed under a Creative Commons Attribution 4.0 International License.
References
Bagozzi, R. P., & Yi, Y. (1988). On the evaluation of structural equation models. Journal of the Academy of Marketing Science, 16(1), 74–94. https://doi.org/10.1007/BF02723327
Bao, F., Chen, C., Chan, A.P.C., Martek, I., & Shrestha, A. (2019). Dynamic framework transfer model for public-private partnerships: Lessons from a China water sector case study. Engineering, Construction and Architectural Management, 26(7), 1218–1239. https://doi.org/10.1108/ECAM-01-2018-0028
Bao, F., Martek, I., Chen, C., Wu, Q., & Chan, A. P. C. (2022). Critical risks inherent to the transfer phase of public–private partnership water projects in China. Journal of Management in Engineering, 38(3), Article 04022006. https://doi.org/10.1061/(ASCE)ME.1943-5479.0001024
Barraza, G. A., Back, W. E., & Mata, F. (2000). Probabilistic monitoring of project performance using SS-curves. Journal of Construction Engi-neering and Management, 126(2), 142–148. https://doi.org/10.1061/(ASCE)0733-9364(2000)126:2(142)
Bassioni, H. A., Price, A. D. F., & Hassan, T. M. (2004). PM in construction. Journal of Management in Engineering, 20(2), 42–50. https://doi.org/10.1061/(ASCE)0742-597X(2004)20:2(42)
Beatham, S., Anumba, C., Thorpe, T., & Hedges, I. (2005). An integrated business improvement system (IBIS) for construction. Measuring Busi-ness Excellence, 9(2), 42–55. https://doi.org/10.1108/13683040510602876
Bentler, P. M. (1989). EQS: Structural equations program manual. Los Angeles, CA: BMDP Statistical Software.
Bollen, K. A. (1989). A new incremental fit index for general structural equation models. Sociological Methods & Research, 17(3), 303–316. https://doi.org/10.1177/0049124189017003004
Boomsma, A. (2005). Structural equation modeling introduction. Department of Statistics and Measurement Theory, University of Groningen, The Netherlands.
Chan, W. T., Chen, C., Messner, J. I., & Chua, D. K. (2005). Interface management for China’s build-operate-transfer projects. Journal of Con-struction Engineering and Management, 131(6), 645–655. https://doi.org/10.1061/(ASCE)0733-9364(2005)131:6(645)
Chen, C. (2009). Can the pilot BOT Project provide a template for future projects? A case study of the Chengdu No. 6 Water Plant B Project. International Journal of Project Management, 27(6), 573–583. https://doi.org/10.1016/j.ijproman.2008.10.006
Chinese Ministry of Finance. (2014). PPP phases.
Cho, K. M., Hong, T. H., & Hyun, C. T. (2009). Effect of project characteristics on project performance in construction projects based on structural equation model. Expert Systems with Applications, 36(7), 10461–10470. https://doi.org/10.1016/j.eswa.2009.01.032
Colin, J., & Vanhoucke, M. (2015). A comparison of the performance of various project control methods using earned value management systems. Expert Systems with Applications, 42(6), 3159–3175. https://doi.org/10.1016/j.eswa.2014.12.007
Cozzetto, D. A. (1994). Quantitative research in public administration. Administration & Society, 26(3), 337–343. https://doi.org/10.1177/009539979402600303
Cui, C., Liu, Y., Hope, A., & Wang, J. (2018). Review of studies on the public–private partnerships (PPP) for infrastructure projects. International Journal of Project Management, 36(5), 773–794. https://doi.org/10.1016/j.ijproman.2018.03.004
Dharmapuri, T. V. R. R. S., Tiwari, P., Sawhney, A., & Pranatharthiharan, K. K. (2020). Analyzing configurational paths for successful PPPs in Indian urban drinking water sector. Journal of Infrastructure Systems, 26(3), Article 04020023. https://doi.org/10.1061/(ASCE)IS.1943-555X.0000557
European Investment Bank. (2012). The guide to guidance: How to prepare, procure and deliver PPP projects. Luxembourg.
Fleming, Q. W., & Koppelman, J. M. (2000). Earned value project management (2th ed). Project Management Institute.
Fornell, C., & Larcker, D. F. (1981). Evaluating structural equation models with unobserved variables and measurement error. Journal of Market-ing Research, 18(1), 39–50. https://doi.org/10.2307/3151312
Garvin, M. J., & Bosso, D. (2008). Assessing the effectiveness of infrastructure public – private partnership programs and projects. Public Works Management & Policy, 13(2), 162–178. https://doi.org/10.1177/1087724X08323845
Goshu, Y. Y., & Kitaw, D. (2017). PM and its recent challenge: a literature review. International Journal of Business Performance Management, 18(4), 381–402. https://dx.doi.org/10.1504/IJBPM.2017.087103
Grigg, N. S. (2002). Water, wastewater, and stormwater infrastructure management. Lewis Publishers.
Haponava, T., & Al-Jibouri, S. (2012). Proposed system for measuring project performance using process-based key performance indicators. Journal of Management in Engineering, 28(2), 140–149. https://doi.org/10.1061/(ASCE)ME.1943-5479.0000078
Horta, I. M., Camanho, A. S., & Costa, J. M. D. (2010). Performance assessment of construction companies integrating key performance indicators and data envelopment analysis. Journal of Construction Engineering and Management, 136(5), 581–594. https://doi.org/10.1061/(ASCE)CO.1943-7862.0000145
Ismail, S., Mohamad, R., & Mohd Said, J. (2021). Performance indicators for lifecycle process of public private partnership (PPP) projects in Ma-laysia. Built Environment Project and Asset Management, 12(5), 704–718. https://doi.org/10.1108/BEPAM-02-2021-0030
Joreskog, K. G., & Sorbom, D. (1993). LISREL 8: Structural equation modeling with the SIMPL1S command language.
Kagioglou, M., Cooper, R., & Aouad, G. (2001). Performance management in construction: a conceptual framework. Construction Management and Economics, 19(1), 85–95. https://doi.org/10.1080/01446190010003425
Khosravi, S., & Afshari, H. (2011). A success measurement model for construction projects. In 2011 International Conference on Financial Man-agement and Economics (ICFME 2011) (pp. 186–190), Hong Kong, China.
Kim, S. Y., & Thuc, L. D. (2021). Life cycle performance measurement in public–private partnership infrastructure projects. Journal of Infrastruc-ture Systems, 27(4), 06021001. https://doi.org/10.1061/(ASCE)IS.1943-555X.0000639
Kline, R. B. (2005). Principles and practice of structural equation modeling (2nd ed). Guilford Press.
Lin, G., & Shen, Q. (2007). Measuring the performance of value management studies in construction: Critical review. Journal of Management in Engineering, 23(1), 2–9. https://doi.org/10.1061/(ASCE)0742-597X(2007)23:1(2)
Lin, G., Shen, G. Q., Sun, M., & Kelly, J. (2011). Identification of key performance indicators for measuring the performance of value management studies in construction. Journal of Construction Engineering and Management, 137(9), 698–706. https://doi.org/10.1061/(ASCE)CO.1943-7862.0000348
Liu, J., E.D. Love, P., Smith, J., Regan, M., & Sutrisna, M. (2014). Public-private partnerships: a review of theory and practice of performance measurement. International Journal of Productivity and Performance Management, 63(4), 499–512. https://doi.org/10.1108/IJPPM-09-2013-0154
Liu, J., Love, P. E. D., Smith, J., Regan, M., & Palaneeswaran, E. (2015a). Review of performance measurement: Implications for public-private partnerships. Built Environment Project and Asset Management, 5(1), 35–51. https://doi.org/10.1108/BEPAM-12-2013-0070
Liu, J., Love, P., Davis, P. R., Smith, J., & Regan, M. (2015b). Conceptual framework for the performance measurement of public-private partner-ships. Journal of Infrastructure Systems, 21(1), Article 04014023. https://doi.org/10.1061/(ASCE)IS.1943-555X.0000210
Liu, J., Love, P., Smith, J., Matthews, J., & Sing, C.-P. (2016). Praxis of performance measurement in public-private partnerships: Moving beyond the iron triangle. Journal of Management in Engineering, 32(4), Article 04016004. https://doi.org/10.1061/(ASCE)ME.1943-5479.0000433
Love, P. E. D., Liu, J., Matthews, J., Sing, C.-P., & Smith, J. (2015). Future proofing PPPs: Life-cycle performance measurement and Building Information Modelling. Automation in Construction, 56, 26–35. https://doi.org/10.1016/j.autcon.2015.04.008
Luu, V. T., Kim, S.-Y., & Huynh, T.-A. (2008). Improving project management performance of large contractors using benchmarking approach. International Journal of Project Management, 26(7), 758–769. https://doi.org/10.1016/j.ijproman.2007.10.002
Luu, T. V., Kim, S. Y., Cao, H. L., & Park, Y. M. (2010). PM of construction firms in developing countries. Construction Management and Eco-nomics, 26(4), 373–386. https://doi.org/10.1080/01446190801918706
Ming, Z., Hu, Y., & Zheng, M. (2021). The performance evaluation of expressway PPP project during operation period based on RF. In Proceed-ings of the International Conference on Construction and Real Estate Management 2021 (ICCREM 2021) (pp. 917–924), Beijing, China. https://doi.org/10.1061/9780784483848.105
Mladenovic, G., Vajdic, N., Wundsch, B., & Temeljotov-Salaj, A. (2013). Use of key performance indicators for PPP transport projects to meet stakeholders’ performance objectives. Built Environment Project and Asset Management, 3(2), 228–249. https://doi.org/10.1108/BEPAM-05-2012-0026
Moselhi, O., Li, J., & Alkass, S. (2004). Web‐based integrated project control system. Construction Management and Economics, 22(1), 35–46. https://doi.org/10.1080/0144619042000186040
Nassar, N., & Abourizk, S. (2014). Practical application for integrated performance measurement of construction projects. Journal of Management in Engineering, 30(6), Article 04014027. https://doi.org/10.1061/(ASCE)ME.1943-5479.0000287
Neely, A. (1999). The performance measurement revolution: why now and what next?. International Journal of Operations & Production Man-agement, 19(2), 205–228. https://doi.org/10.1108/01443579910247437
Neely, A., Gregory, M., & Platts, K. (2005). Performance measurement system design: A literature review and research agenda. International Journal of Operations & Production Management, 25(12), 1228–1263.
Ng, S. T., Wong, Y. M. W., & Wong, J. M. W. (2010). A structural equation model of feasibility evaluation and project success for public–private partnerships in Hong Kong. IEEE Transactions on Engineering Management, 57(2), 310–322. https://doi.org/10.1109/TEM.2009.2037142
Okudan, O., Budayan, C., & Dikmen, I. (2020). Development of a conceptual life cycle performance measurement system for build–operate–transfer (BOT) projects. Engineering, Construction and Architectural Management, 28(6), 1635–1656. https://doi.org/10.1108/ECAM-01-2020-0071
Opawole, A., Kajimo-Shakantu, K., Alao, O. O., & Ogbaje, C. P. (2019). Risk factors associated with procuring university hostel facilities through build-operate-transfer model. Journal of Engineering Design & Technology, 17(1), 136–154. https://doi.org/10.1108/JEDT-05-2018-0079
Poister, T. H. (2003). Measuring performance in public and nonprofit organizations. Jossey Bass Nonprofit & Public Management.
Price Water House Coopers. (2010). Public-private-partnerships: The US perspective.
Project Management Institute. (2013). A guide to the project management body of knowledge (PMBOK guide) (5th ed.). https://doi.org/10.1002/pmj.21345
Qian, N., House, S., Wu, A. M., & Wu, X. (2020). Public–private partnerships in the water sector in China: A comparative analysis. International Journal of Water Resources Development, 36(4), 631–650. https://doi.org/10.1080/07900627.2019.1685951
Quiggin, J. (2019). The diffusion of public private partnerships: a world systems analysis. Globalizations, 16(6), 838–856. https://doi.org/10.1080/14747731.2018.1560186
Savenije, H. H. G. (2002). Why water is not an ordinary economic good, or why the girl is special. Physics and Chemistry of the Earth, Parts A/B/C, 27(11–22), 741–744. https://doi.org/10.1016/S1474-7065(02)00060-8
Shrestha, A., Chan, T. K., Aibinu, A. A., & Chen, C. (2017). Efficient risk transfer in PPP wastewater treatment projects. Utilities Policy, 48, 132–140. https://doi.org/10.1016/j.jup.2017.03.003
Steiger, J. H., & Lind, J. C. (1980). Statistically-based tests for the number of common factors [conference presentation]. The Psychometric Society Annual Meeting, Iowa City, IA.
Su, L., & Cao, Y. (2022). Performance monitoring and evaluation of water environment treatment PPP projects with multi-source heterogeneous information. Frontiers in Environmental Science, 10, Article 2407. https://doi.org/10.3389/fenvs.2022.1024701
Sun, C., Liu, Y, & Zhang, T. (2019). Research on operational performance evaluation system of urban waste treatment PPP project based on AHP. IOP Conference Series: Earth and Environmental Science, 267(4), Article 042067. https://doi.org/10.1088/1755-1315/267/4/042067
Surachman, E. N., Perwitasari, S. W., & Suhendra, M. (2022). Stakeholder management mapping to improve public-private partnership success in emerging country water projects: Indonesia’s experience. Utilities Policy, 78, Article 101411. https://doi.org/10.1016/j.jup.2022.101411
Wang, L., & Zhang, X. Q. (2019). Determining the value of standby letter of credit in transfer stage of a PPP project to control concessionaire’s opportunistic behavior. Journal of Management in Engineering, 35(3), Article 04019003. https://doi.org/10.1061/(ASCE)ME.1943-5479.0000682
Ward, C. S., Curtis, B., & Chapman, C. B. (1991). Objectives and performance in construction projects. Construction Management and Econom-ics, 9(4), 343–354. https://doi.org/10.1080/01446199100000027
World Bank. (2016). The APMG PPP certification program guide. Washington, DC, USA.
World Bank. (2017a). Private participation in infrastructure (PPI) database. http://ppi.worldbank.org/data
World Bank. (2017b). Public-private partnerships reference guide (3rd ed.). Washington, DC, USA.
World Bank. (2017c). Caribbean public-private partnerships (PPP) toolkit. Washington, DC, USA.
World Bank. (2019). Private participation in infrastructure (PPI) database. http://ppi.worldbank.org/data
World Bank. (2020). Private participation in infrastructure (PPI) database. http://ppi.worldbank.org/data
Xu, Y, Chong, H. Y., & Chi, M. (2022). Impact of contractual flexibility on BIM-enabled PPP project performance during the construction phase. Journal of Infrastructure Systems, 28(1), Article 04021057. https://doi.org/10.1061/(ASCE)IS.1943-555X.0000671
Yang, H., Yeung, J. F. Y., Chan, A. P. C., Chiang, Y. H., & Chan, D. W. M. (2010). A critical review of performance measurement in construc-tion. Journal of Facilities Management, 8(4), 269–284. https://doi.org/10.1108/14725961011078981
Yao, D., & Chen, Q. (2012). Case study of performance management for PPP projects. In 2012 Fifth International Conference on Business Intelli-gence and Financial Engineering (pp. 39–42). IEEE. https://doi.org/10.1109/BIFE.2012.16
Yu, I., Kim, K., Jung, Y., & Chin, S. (2007). Comparable performance measurement system for construction companies. Journal of Management in Engineering, 23(3), 131–139. https://doi.org/10.1061/(ASCE)0742-597X(2007)23:3(131)
Yuan, J., Zeng, A. Y., Skibniewski, M. J., & Li, Q. (2009). Selection of performance objectives and key performance indicators in public–private partnership projects to achieve value for money. Construction Management and Economics, 27(1–3), 253–270. https://doi.org/10.1080/01446190902748705
Yuan, J., Chan, A., Xiong, W., Skibniewski, M. J., & Li, Q. (2015). Perception of residual value risk in public private partnership projects: Critical review. Journal of Management in Engineering, 31(3), Article 04014041. https://doi.org/10.1061/(ASCE)ME.1943-5479.0000256
Zou, P. X. W., Zhang, G., & Wang, J. (2007). Understanding the key risks in construction projects in China. International Journal of Project Management, 25(6), 601–614. https://doi.org/10.1016/j.ijproman.2007.03.001
Zhang, S., Chan, A. P. C., Feng, Y., Duan, H., & Ke, Y. (2016). Critical review on PPP research – A search from the Chinese and international journals. International Journal of Project Management, 34(4), 597–612. https://doi.org/10.1016/j.ijproman.2016.02.008
Zhong, L., Mol, A. P. J., & Fu, T. (2008). Public-private partnerships in China’s urban water sector. Environmental Management, 41(6), 863–877. https://doi.org/10.1007/s00267-008-9070-1