skip to main content
10.1145/3318265.3318283acmotherconferencesArticle/Chapter ViewAbstractPublication Pageshp3cConference Proceedingsconference-collections
research-article

Research load balancing technology of distributed database based on consistent hash

Authors Info & Claims
Published:08 March 2019Publication History

ABSTRACT

Consistent hash algorithm is applied to build a distributed database load balancing model, but this model should deal with thousands of user requests, handle 10 billion data information, along with low-latency response scenarios, all of this is a grim challenge. When load balancing control mechanism is built by the consistency hash, some nodes in the database cluster are overloaded, but some are idle. These load imbalances can seriously do great damage to the overall performance of distributed database system. This paper proposes a detailed description of variance mathematics model about dynamic load balancing, the core is to track system load, evaluation, classification and storage of each node in distributed cluster. This algorithm controls mutual feedback between node load states, idle data node allots the item of overload node, overall suppression of single point overload. After by experimental simulation, compared with the auxiliary loop hash model, this algorithm improves load balancing efficiency by 30% and settles disputes about distributed database load imbalance based on consistent hashing.

References

  1. Venkateswaran N., Changder D.S. Simplified data partitioning in a consistent hashing based sharding implementation. In TENCON 2017 - 2017 IEEE Region 10 Conference, pp. 895 -- 900Google ScholarGoogle Scholar
  2. Venkateswaran N., Changder S. Handling workload skew in a consistent hashing based partitioning implementation. In 2017 International Conference on Advances in Computing, Communications and Informatics (ICACCI). pp. 1163 -- 1169Google ScholarGoogle Scholar
  3. W. Lan, F. Li, X. Liu. Dynamic Load Balancing Mechanism for Distributed Controllers in SoftwareDefined Networking. In: 2018 10th International Conference on Measuring Technology and Mechatronics Automation (ICMTMA), Changsha, Hunan, China, 2018, pp. 259--262. DIOGoogle ScholarGoogle Scholar
  4. Man Q., Yang L. 2014. Big Data Management in Digital Forensics. In: Computational Science and Engineering(CSE), 2014 IEEE 17th International Conference on.Dec. 2014, pp. 238--243. Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. Thar K., Ullah S., Hong C. S. 2014. Consistent hashing based cooperative caching and forwarding in content centric network. In:The 16th Asia-Pacific Network Operations and Management Symposium, pp. 1 -- 4.Google ScholarGoogle ScholarCross RefCross Ref
  6. Patel D. K., C. R. Tripathy. An Efficient Load Balancing Mechanism with Cost Estimation on GridSim. In: 2016 International Conference on Information Technology (ICIT), pp. 75 -- 80.Google ScholarGoogle Scholar
  7. P. Ravi Babu, Shenoy R. Implementation of ACO technique for load balancing through reconfiguration in electrical distribution system. In: 2014 Annual International Conference on Emerging Research Areas: Magnetics, Machines and Drives (AICERA/iCMMD), pp 1 -- 5.Google ScholarGoogle Scholar
  8. Wan H., Fuyang Li. NVLH: Crash-Consistent Linear Hashing for Non-Volatile Memory. In:2018 IEEE 7th Non-Volatile Memory Systems and Applications Symposium (NVMSA), pp.117--118.Google ScholarGoogle Scholar
  9. Mandai D., Biswas S. Label consistent matrix factorization based hashing for cross-modal retrieval. In: 2017 IEEE International Conference on Image Processing (ICIP), pp.2901 -- 2905.Google ScholarGoogle Scholar
  10. Goel P., Rishabh K. An Alternate Load Distribution Scheme in DHTs. In:2017 IEEE International Conference on Cloud Computing Technology and Science (CloudCom), pp.218 -- 222.Google ScholarGoogle Scholar
  11. Vuluvala M. R., Saini L. M. Load balancing of electrical power distribution system: An overview. In:2018 International Conference on Power, Instrumentation, Control and Computing (PICC), pp 1 -- 5.Google ScholarGoogle Scholar
  12. B. Muruganantham, M. Muthamizh Selvam. Energy loss reduction and load balancing through network reconfiguration in practical LV distribution feeder using GAMS. In: 2017 7th International Conference on Power Systems (ICPS), pp 509 -- 513.Google ScholarGoogle Scholar
  13. Jagdish, Patni C. Distributed load balancing model for grid computing environment. In: 2015 1st International Conference on Next Generation Computing Technologies (NGCT), pp.123 -- 126.Google ScholarGoogle Scholar
  14. https://scholar.google.com/Google ScholarGoogle Scholar
  15. https://en.wikipedia.org/wiki/WikiGoogle ScholarGoogle Scholar
  16. https://xueshu.baidu.com/Google ScholarGoogle Scholar
  17. http://www.cplusplus.com/reference/stl/Google ScholarGoogle Scholar
  18. https://www.openssl.org/Google ScholarGoogle Scholar

Index Terms

  1. Research load balancing technology of distributed database based on consistent hash

        Recommendations

        Comments

        Login options

        Check if you have access through your login credentials or your institution to get full access on this article.

        Sign in
        • Published in

          cover image ACM Other conferences
          HP3C '19: Proceedings of the 3rd International Conference on High Performance Compilation, Computing and Communications
          March 2019
          201 pages
          ISBN:9781450366380
          DOI:10.1145/3318265
          • Conference Chair:
          • Steven Guan

          Copyright © 2019 ACM

          Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

          Publisher

          Association for Computing Machinery

          New York, NY, United States

          Publication History

          • Published: 8 March 2019

          Permissions

          Request permissions about this article.

          Request Permissions

          Check for updates

          Qualifiers

          • research-article

        PDF Format

        View or Download as a PDF file.

        PDF

        eReader

        View online with eReader.

        eReader