Supreme Ayewoh Okoh; Elizabeth N. Onwuka; Suleiman Zubairu; Bala Alhaji Salihu; Peter Y. Dibal

Performance Analysis of IoT Cloud-based Platforms using Quality of Service Metrics

Full Text (PDF, 1930KB), PP.45-58

Views: 0 Downloads: 0

Author(s)

Supreme Ayewoh Okoh ^1,* Elizabeth N. Onwuka ¹ Suleiman Zubairu ¹ Bala Alhaji Salihu ¹ Peter Y. Dibal ²

1. Department of Telecommunication Engineering, Federal University of Technology Minna, Nigeria

2. Department of Computer Engineering, University of Maiduguri, Nigeria

* Corresponding author.

DOI: https://doi.org/10.5815/ijwmt.2023.01.05

Received: 17 Jul. 2022 / Revised: 16 Aug. 2022 / Accepted: 28 Sep. 2022 / Published: 8 Feb. 2023

Index Terms

Performance analysis, IoT platform, response time, throughput, efficiency.

Abstract

There are several IoT platforms providing a variety of services for different applications. Finding the optimal fit between application and platform is challenging since it is hard to evaluate the effects of minor platform changes. Several websites offer reviews based on user ratings to guide potential users in their selection. Unfortunately, review data are subjective and sometimes conflicting – indicating that they are not objective enough for a fair judgment. Scientific papers are known to be the reliable sources of authentic information based on evidence-based research. However, literature revealed that though a lot of work has been done on theoretical comparative analysis of IoT platforms based on their features, functions, architectures, security, communication protocols, analytics, scalability, etc., empirical studies based on measurable metrics such as response time, throughput, and technical efficiency, that objectively characterize user experience seem to be lacking. In an attempt to fill this gap, this study used web analytic tools to gather data on the performance of some selected IoT cloud platforms. Descriptive and inferential statistical models were used to analyze the gathered data to provide a technical ground for the performance evaluation of the selected IoT platforms. Results showed that the platforms performed differently in the key performance metrics (KPM) used. No platform emerged best in all the KPMs. Users' choice will therefore be based on metrics that are most relevant to their applications. It is believed that this work will provide companies and other users with quantitative evidence to corroborate social media data and thereby give a better insight into the performance of IoT platforms. It will also help vendors to improve on their quality of service (QoS).

Cite This Paper

Supreme A. Okoh, Elizabeth N. Onwuka, Suleiman Zubairu, Bala A. Salihu, Peter Y. Dibal, "Performance Analysis of IoT Cloud-based Platforms using Quality of Service Metrics", International Journal of Wireless and Microwave Technologies(IJWMT), Vol.13, No.1, pp. 45-58, 2023. DOI:10.5815/ijwmt.2023.01.05

Reference

[1]M. Agarwal, Pretti; Alam, “IoT Cloud Platforms : an Application Development Perspective Investigating IoT Middleware Platforms for Smart Application Development The advancement in sensor , actuator , computing and storage technologies has given,” Sel. Proc. ICSC 2019, no. October, pp. 231–244, 2018.

[2]A. S. Muhammed and D. Ucuz, “Comparison of the IoT Platform Vendors, Microsoft Azure, Amazon Web Services, and Google Cloud, from Users’ Perspectives,” 8th Int. Symp. Digit. Forensics Secur. ISDFS 2020, pp. 19–22, 2020, doi: 10.1109/ISDFS49300.2020.9116254.

[3]R. Sikarwar, P. Yadav, and A. Dubey, “A survey on IOT enabled cloud platforms,” Proc. - 2020 IEEE 9th Int. Conf. Commun. Syst. Netw. Technol. CSNT 2020, pp. 120–124, 2020, doi: 10.1109/CSNT48778.2020.9115735.

[4]L. Babun, K. Denney, Z. B. Celik, P. McDaniel, and A. S. Uluagac, “A survey on IoT platforms: Communication, security, and privacy perspectives,” Comput. Networks, vol. 192, no. March, p. 108040, 2021, doi: 10.1016/j.comnet.2021.108040.

[5]M. Asemani, F. Abdollahei, and F. Jabbari, “Understanding IoT Platforms,” 2019 5th Int. Conf. Web Res., pp. 172–177, 2019.

[6]J. B. Hoffmann, P. Heimes, and S. Senel, “IoT platforms for the internet of production,” IEEE Internet Things J., vol. 6, no. 3, pp. 4098–4105, 2019, doi: 10.1109/JIOT.2018.2875594.

[7]J. Yu and Y. Kim, “2016 International Conference on Platform Technology and Service, PlatCon 2016 - Proceedings,” 2016 Int. Conf. Platf. Technol. Serv. PlatCon 2016 - Proc., pp. 1–5, 2016.

[8]A. A. Hamza, I. T. Abdel-Halim, M. A. Sobh, and A. M. Bahaa-Eldin, “A survey and taxonomy of program analysis for IoT platforms,” Ain Shams Eng. J., vol. 12, no. 4, pp. 3725–3736, 2021, doi: 10.1016/j.asej.2021.03.026.

[9]M. Ullah and K. Smolander, “Highlighting the key factors of an IoT platform,” 2019 42nd Int. Conv. Inf. Commun. Technol. Electron. Microelectron. MIPRO 2019 - Proc., pp. 901–906, 2019, doi: 10.23919/MIPRO.2019.8756748.

[10]H. Hejazi, H. Rajab, T. Cinkler, and L. Lengyel, “Survey of platforms for massive IoT,” in 2018 IEEE International Conference on Future IoT Technologies, Future IoT 2018, 2018, vol. 2018-Janua, pp. 1–8, doi: 10.1109/FIOT.2018.8325598.

[11]V. Araujo, K. Mitra, S. Saguna, and C. Åhlund, “Performance evaluation of FIWARE: A cloud-based IoT platform for smart cities,” J. Parallel Distrib. Comput., vol. 132, pp. 250–261, 2019, doi: 10.1016/j.jpdc.2018.12.010.

[12]M. Ullah, P. H. J. Nardelli, A. Wolff, and K. Smolander, “Twenty-One Key Factors to Choose an IoT Platform: Theoretical Framework and Its Applications,” IEEE Internet Things J., vol. 7, no. 10, pp. 10111–10119, 2020, doi: 10.1109/JIOT.2020.3000056.

[13]J. De C. Silva, P. H. M. Pereira, L. L. De Souza, C. N. M. Marins, G. A. B. Marcondes, and J. J. P. C. Rodrigues, “Performance Evaluation of IoT Network Management Platforms,” 2018 Int. Conf. Adv. Comput. Commun. Informatics, ICACCI 2018, pp. 259–265, 2018, doi: 10.1109/ICACCI.2018.8554364.

[14]B. Nakhuva and T. Champaneria, “Study of Various Internet of Things Platforms,” Int. J. Comput. Sci. Eng. Surv., vol. 6, no. 6, pp. 61–74, 2015, doi: 10.5121/ijcses.2015.6605.

[15]R. Mahmud, R. Kotagiri, and R. Buyya, “Fog Computing: A taxonomy, survey and future directions,” Internet of Things, vol. 0, no. 9789811058608, pp. 103–130, 2018, doi: 10.1007/978-981-10-5861-5_5.

[16]K. O. Shakerkhan and E. T. Abilmazhinov, “Development of a Method for Choosing Cloud Computing on the Platform of Paas for Servicing the State Agencies,” Int. J. Mod. Educ. Comput. Sci., vol. 11, no. 9, pp. 14–25, 2019, doi: 10.5815/ijmecs.2019.09.02.

[17]“Website Monitoring, Website Monitoring Service, Server Monitoring: Site24x7.” [Online]. Available: https://www.site24x7.com/. [Accessed: 25-Mar-2022].

[18]Similarweb, “Website Traffic,” 2021. [Online]. Available: https://www.similarweb.com/. [Accessed: 25-Mar-2022].

[19]M. Sahai, P. Agarwal, V. Mishra, M. Bag, and V. Singh, “Supplier Selection through Application of DEA,” Int. J. Eng. Manuf., vol. 4, no. 1, pp. 1–9, 2014, doi: 10.5815/ijem.2014.01.01.

[20]C. Stȩpniak, “Coefficient of Variation,” Int. Encycl. Stat. Sci., pp. 267–267, 2011, doi: 10.1007/978-3-642-04898-2_177.

[21]Y. Gökşen, O. Doğan, and B. Özkarabacak, “A Data Envelopment Analysis Application for Measuring Efficiency of University Departments,” Procedia Econ. Financ., vol. 19, no. 15, pp. 226–237, 2015, doi: 10.1016/s2212-5671(15)00024-6.

[22]L. S. Zaremba and W. H. Smoleński, “Optimal portfolio choice under a liability constraint,” Ann. Oper. Res., vol. 97, no. 1–4, pp. 131–141, 2000, doi: 10.1023/A.

[23]B. Bolstad, “Data Normalization and Standardization,” Bmbolstad.Com, no. 1, pp. 1–3, 2012, doi: 10.13140/RG.2.2.28948.04489.

International Journal of Wireless and Microwave Technologies (IJWMT)