An Experimental Evaluation of Tools for Estimating Bandwidth-Related Metrics

Full Text (PDF, 613KB), PP.1-11

Views: 0 Downloads: 0

Author(s)

Fatih Abut 1,* Martin Leischner 2

1. Adana Science and Technology University, Dept. of Computer Engineering, Adana, 01250, Turkey

2. Bonn-Rhein-Sieg University of Applied Sciences, Dept. of Computer Science, Sankt Augustin, 53757, Germany

* Corresponding author.

DOI: https://doi.org/10.5815/ijcnis.2018.07.01

Received: 20 Apr. 2018 / Revised: 7 May 2018 / Accepted: 14 Jun. 2018 / Published: 8 Jul. 2018

Index Terms

Capacity, Available Bandwidth, Throughput, Bandwidth Estimation, Measurement, Quality of Service

Abstract

For many different applications, current information about the bandwidth-related metrics of the utilized connection is very useful as they directly impact the performance of throughput sensitive applications such as streaming servers, IPTV and VoIP applications. In literature, several tools have been proposed to estimate major bandwidth-related metrics such as capacity, available bandwidth and achievable throughput. The vast majority of these tools fall into one of Packet Pair (PP), Variable Packet Size (VPS), Self-Loading of Periodic Streams (SLoPS) or Throughput approaches. In this study, seven popular bandwidth estimation tools including nettimer, pathrate, pathchar, pchar, clink, pathload and iperf belonging to these four well-known estimation techniques are presented and experimentally evaluated in a controlled testbed environment. Differently from the rest of studies in literature, all tools have been uniformly classified and evaluated according to an objective and sophisticated classification and evaluation scheme. The performance comparison of the tools incorporates not only the estimation accuracy but also the probing time and overhead caused.

Cite This Paper

Fatih Abut, Martin Leischner, "An Experimental Evaluation of Tools for Estimating Bandwidth-Related Metrics", International Journal of Computer Network and Information Security(IJCNIS), Vol.10, No.7, pp.1-11, 2018. DOI:10.5815/ijcnis.2018.07.01

Reference

[1]R. Prosad et al., “Bandwidth estimation: metrics, measurement techniques, and tools,” IEEE Netw., vol. 17, no. 6, pp. 27–35, 2003.
[2]A. S. Sairam, “Survey of Bandwidth Estimation Techniques,” Wirel. Pers. Commun., pp. 1425–1476, 2015.
[3]M. Jain and C. Dovrolis, “End-to-end available bandwidth: Measurement methodology, dynamics, and relation with TCP throughput,” IEEE/ACM Trans. Netw., vol. 11, no. 4, pp. 537–549, 2003.
[4]C. Dovrolis, P. Ramanathan, and D. Moore, “Packet-dispersion techniques and a capacity-estimation methodology,” IEEE/ACM Trans. Netw., vol. 12, no. 6, pp. 963–977, 2004.
[5]K. Lai and M. Baker, “Nettimer: A tool for measuring bottleneck link bandwidth,” in Proceedings of the USENIX Symposium on Internet Technologies and Systems, 2001, vol. 134, pp. 1–12.
[6]C. Dovrolis, P. Ramanathan, and D. Moore, “What do packet dispersion techniques measure?,” Proc. - IEEE INFOCOM, vol. 2, pp. 905–914, 2001.
[7]A. B. Downey, “Using pathchar to estimate Internet link characteristics,” ACM SIGCOMM Comput. Commun. Rev., vol. 29, no. 4, pp. 241–250, 1999.
[8]B. A. Mah, “pchar: A Tool for Measuring Internet Path Characteristics,” 2001. [Online]. Available: http://www.employees.org/?bmah/software/pchar.
[9]A. B. Downey, “Clink,” 1999. [Online]. Available: http://rocky.xn--wellesley-3ma.edu/ ~downey/clink.
[10]M. Jain and C. Dovrolis, “Pathload: a measurement tool for end-to-end available bandwidth,” in Proceedings of the Passive and Active Measurements (PAM) Workshop, 2002, pp. 1–12.
[11]A. Tirumala, L. Cottrell, and T. Dunigan, “Measuring end-to-end bandwidth with Iperf using Web100,” Proc. Passiv. Act. Meas. Work., pp. 1–8, 2003.
[12]M. Koubàa, N. Amdouni, and T. Aguili, “Efficient Traffic Engineering Strategies for Optimizing Network Throughput in WDM All-Optical Networks,” Int. J. Comput. Netw. Inf. Secur., vol. 7, no. 6, pp. 39–49, May 2015.
[13]K. Ahuja, B. Singh, and R. Khanna, “Available Link Bandwidth Based Network Selection in Multi-access Networks,” Int. J. Intell. Syst. Appl., vol. 6, no. 3, pp. 76–83, Feb. 2014.
[14]E. Yildirim and T. Kosar, “End-to-End Data-Flow Parallelism for Throughput Optimization in High-Speed Networks,” J. Grid Comput., vol. 10, no. 3, pp. 395–418, Sep. 2012.
[15]V. Gaur, P. Dhyani, and O. P. Rishi, “A Multi-Objective Optimization of Cloud Based SLA-Violation Prediction and Adaptation,” Int. J. Inf. Technol. Comput. Sci., vol. 8, no. 6, pp. 60–65, Jun. 2016.
[16]S. Saroiu, P. Gummadi, and S. Gribble, “Sprobe: A fast technique for measuring bottleneck bandwidth in uncooperative environments,” IEEE INFOCOM, pp. 1–11, 2002.
[17]R. Kapoor, L. Chen, and M. Gerla, “CapProbe?: A Simple and Accurate Capacity Estimation Technique,” in Proceedings of Applications, technologies, architectures, and protocols for computer communications, 2004, pp. 67–68.
[18]L. Chen, T. Sun, G. Yang, M. Y. Sanadidi, and M. Gerla, “End-to-End Asymmetric Link Capacity Estimation,” in IFIP Networking, 2005, pp. 780–791.
[19]T. En-Najjary and G. Urvoy-Keller, “Passive capacity estimation: Comparison of existing tools,” in International Symposium on Performance Evaluation of Computer and Telecommunication Systems, 2008.
[20]S. Katti, D. Katabi, C. Blake, E. Kohler, and J. Strauss, “MultiQ: automated detection of multiple bottleneck capacities along a path,” IMC ’04 Proc. 4th ACM SIGCOMM Conf. Internet Meas., pp. 245–250, 2004.
[21]N. Hu and P. Steenkiste, “Estimating Available Bandwidth Using Packet Pair Probing,” Security, p. 28, 2002.
[22]J. Strauss, D. Katabi, and F. Kaashoek, “A measurement study of available bandwidth estimation tools,” in Proceedings of the ACM SIGCOMM Internet Measurement Conference, IMC, 2003, pp. 39–44.
[23]J. Sommers, P. Barford, and W. Willinger, “A proposed framework for calibration of available bandwidth estimation tools,” in Proceedings - International Symposium on Computers and Communications, 2006, pp. 709–718.
[24]E. Goldoni, G. Rossi, and A. Torelli, “Assolo, a New Method for Available Bandwidth Estimation,” Fourth Int. Conf. Internet Monit. Prot., pp. 130–136, 2009.
[25]M. ?adyga, R. H. Riedi, R. G. Baraniuk, J. Navratil, and L. Cottrell, “pathChirp: Efficient Available Bandwidth Estimation for Network Paths,” in Passive and Active Measurement Workshop, 2003.
[26]A. Johnsson, B. Melander, M. Bj?rkman, and M. Bjorkman, “DietTopp?: A first implementation and evaluation of a simplified bandwidth measurement method,” Proc. 2nd Swedish Natl. Comput. Netw. Work., pp. 1–5, 2004.
[27]“Test TCP (TTCP) Benchmarking Tool for Measuring TCP and UDP Performance,” 2005. [Online]. Available: http://www.pcausa.com/-Utilities/pcattcp.htm.
[28]R. Jones, “The netperf website,” 2005. [Online]. Available: http://www.netperf.org/.
[29]C. U. Castellanos, D. L. Villa, O. M. Tyeb, J. Elling, and J. Wigard, “Comparison of Available Bandwidth Estimation Techniques in Packet-Switched Mobile Networks,” 17th Annu. IEEE Int. Symp. Pers. Indoor andMobile Radio Commun., pp. 1–5, 2006.
[30]H. Young-Tae, L. Eun-Mi, P. Hong-Shik, R. Ji-Yun, K. Chin-Chol, and S. Myung-Won, “Test and Performance Comparison of End-to-End Available Bandwidth Measurement Tools,” Adv. Commun. Technol. 2009. ICACT 2009. 11th Int. Conf., pp. 370–372, 2009.
[31]Y. Labit, P. Owezarski, and N. Larrieu, “Evaluation of active measurement tools for bandwidth estimation in real environment,” in 3rd IEEE/IFIP Workshop on End-to-End Monitoring Techniques and Services, E2EMON, 2005, vol. 2005, pp. 71–85.
[32]F. Abut, “Towards a Generic Classification and Evaluation Scheme for Bandwidth Measurement Tools,” Signals Telecommun. J., vol. 1, no. 2, pp. 78–88, 2012.
[33]A. Botta, A. Dainotti, and A. Pescapé, “A tool for the generation of realistic network workload for emerging networking scenarios,” Comput. Networks, vol. 56, no. 15, pp. 3531–3547, Oct. 2012.
[34]R. S. Prasad, G. Tech, and B. A. Mah, “The effect of layer-2 store-and-forward devices on per-hop capacity estimation,” in INFOCOM, 2003, pp. 2090–2100.
[35]K. Lai and M. Baker, “Measuring bandwidth,” Proc. - IEEE INFOCOM, vol. 1, pp. 235–245, 1999.
[36]R. S. Prasad, C. Dovrolis, and B. A. Mah, “The effect of layer-2 switches on pathchar-like tools,” Proc. Second ACM SIGCOMM Work. Internet Meas. - IMW ’02, no. 5, p. 321, 2002.