Skip to main content
SpringerLink
Log in

A Survey on Big Data—Its Challenges and Solution from Vendors

  • Chapter
  • First Online:
Big Data Processing Using Spark in Cloud

Part of the book series: Studies in Big Data ((SBD,volume 43 ))

Abstract

Step by step there comes another innovation, gadgets and techniques which offer ascent to the fast development of information. Presently today, information is immensely expanding inside each ten minutes and it is difficult to oversee it and it offers ascend to the term Big data. This paper depicts the enormous information and its difficulties alongside the advancements required to deal with huge data. This moreover portrays the conventional methodologies which were utilized before, to manage information their impediments and how it is being overseen by the new approach Hadoop. It additionally portrays the working of Hadoop along with its pros cons and security on huge data.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 109.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Roger Schell: Security—A Big Question for Big Data. In: 2013 IEEE International Conference on Big Data. https://doi.org/10.1109/bigdata.2013.6691547

  2. Michael, K., Miller, K.W.: Big Data: New Opportunities and New Challenges. Published by the IEEE Computer Society 0018-9162/13/$31.00 © 2013 IEEE

    Google Scholar 

  3. Ji, C., Li, Y., Qiu, W., Awada, U., Li, K.: December. Big data processing in cloud computing environments. In: 2012 12th International Symposium on Pervasive Systems, Algorithms and Networks (ISPAN), pp. 17–23. IEEE (2012)

    Google Scholar 

  4. Muhtaroglu, F.C.P., Demir, S., Obali, M., Girgin, C.: Business model canvas perspective on big dataapplications. In: 2013 IEEE International Conference on Big Data, Silicon Valley, CA, 6–9 Oct 2013, pp. 32–37

    Google Scholar 

  5. Kaur, K., Kaur, I., Kaur, N., Tanisha, Gurmeen, Deepi: Big data management: characteristics, challenges and solutions. Int. J. Comput. Sci. Technol. JCST 7(4) (2016). ISSN 0976-8491, ISSN 2229-4333 (Print)

    Google Scholar 

  6. Tankard, C.: Big data security. Netw. Secur. 2012(7), 5–8 (2012)

    Article  Google Scholar 

  7. Mahajan, P., Gaba, G., Chauhan, N.S.: Big data security. IITM J. Manag. IT 7(1), 89–94 (2016)

    Google Scholar 

  8. Bhosale, H.S., Gadekar, D.P.: A Review on Big Data and Hadoop, JSPM’s Imperial College of Engineering & Research, Wagholi, Pune

    Google Scholar 

  9. Shirudkar et al.: A review on—big data: challenges, security & privacy issues. Int. J. Adv. Res. Comput. Sci. Softw. Eng. 5(3), 1100–1109 (2015)

    Google Scholar 

  10. Shirudkar, K., Motwani, D.: Big-data security, department of computer engineering VIT, Mumbai, India. Int. J. Adv. Res. Comput. Sci. Softw. Eng. 5(3) (2015)

    Google Scholar 

  11. Inukollu1, V.N., Arsi, S., Ravuri, S.R.: Security Issues Associated with Big Data in Cloud Computing. (IJNSA) 6(3), (2014)

    Google Scholar 

  12. Zhao, Y., Wu, J.: Dache: a data aware caching for big-data applications using the Map Reduce framework. In: 2013 Proceedings IEEE INFOCOM, Turin, 14–19 Apr 2013, pp. 35–39

    Google Scholar 

  13. Lu, J., Senellart, P., Lin, C., Du, X., Wang, S., Chen, X.: Optimal top-k generation of attribute combinations based on ranked lists. In: Proceedings of the 2012 International Conference on Management of Data. 2012, pp. 409–420

    Google Scholar 

  14. Aggarwal, C.C., Wang, H.: Managing and Mining Graph Data. Springer Publishing Company, Incorporated (2010)

    Book  Google Scholar 

  15. Patel, A.B., Birla, M., Nair, U.: Addressing big data problem using hadoop and map reduce. In: 2012 Nirma University International Conference on Engineering (NUiCONE), 6 Dec 2012

    Google Scholar 

  16. Chen, J., Chen, Y., Du, X., Li, C., Lu, J., Zhao, S., Zhou, X.: Big data challenge: a data management perspective. In: Key Laboratory of Data Engineering and Knowledge Engineering. School of Information, Renmin University of China, Beijing, China

    Google Scholar 

  17. Ahmed, E.S.A., Saeed, R.A.: A survey of big data cloud computing security. Int. J. Comput. Sci. Softw. Eng. (IJCSSE), 3(1), 78–85 (2014)

    Google Scholar 

  18. http://www.thewindowsclub.com/what-is-big-data

  19. Muhtaroglu, F.C.P., Demir, S., Obali, M., Girgin, C.: Business model canvas perspective on big dataapplications. In: Big Data, 2013 IEEE International Conference, Silicon Valley, CA, 6–9 Oct 2013, pp. 32–37

    Google Scholar 

  20. Big Data Working Group: Big Data Analytics for Security Intelligence, Sept 2013

    Google Scholar 

  21. Big Data Meets Big Data Analytics Three Key Technologies for Extracting Real-Time Business Value from the Big Data That Threatens to Overwhelm Traditional Computing Architectures (white paper)

    Google Scholar 

  22. Singh, R., Ali, K.A.: Challenges and security issues in big data analysis. Int. J. Innov. Res. Sci. Eng. Technol. 5, (1) (2016)

    Google Scholar 

  23. http://data-flair.training/blogs/apache-spark-tutorial/

  24. https://en.wikipedia.org/wiki/Big_data

  25. Security and privacy in the era of big data arenci/nationalconsortiumfordatascience white paper

    Google Scholar 

  26. http://www.sas.com/en_us/insights/big-data/what-is-big-data.html

  27. http://www.sas.com/en_us/insights/big-data/what-is-big-data.html

  28. Shilpa, M.K.: A Review on Big Data and Methodology. LPU, Phagwara, India

    Google Scholar 

  29. Labrinidis, A., Jagadish, H.V.: Challenges and opportunities with big data. Proc. VLDB Endowment 5(12), 2032–2033 (2012)

    Article  Google Scholar 

  30. https://en.wikipedia.org/wiki/Big_data

  31. https://www.Big Data Analytics Tools Overview & Benefits _ Qubole.htm

  32. https://safenet.gemalto.com/data-encryption/big-data-security-solutions/

  33. http://www.darkreading.com/security-monitoring/167901086/security/news/232602339/a-case-study-in-security-big-data-analysis.html

  34. Marko Grobelnikmarko.grobelnik@ijs.siJozef Stefan Institute Ljubljana, SloveniaStavanger, May 8th 2012

    Google Scholar 

  35. https://intellipaat.com/tutorial/spark-tutorial/

  36. An Oracle White Paper June 2013 Oracle: Big Data for the Enterprise

    Google Scholar 

  37. http://www.darkreading.com/monitoring/a-case-study-in-security-big-dataanalys/232602339

  38. Security issues associated with big data in cloud computing, (IJNSA), vol.6, no.3, may 2014))

    Google Scholar 

  39. http://searchsecurity.techtarget.com/feature/Comparing-the-top-big-data-security-analytics-tools

Download references

Author information

Authors and Affiliations

  1. Chandigarh Engineering College, Mohali, India

    Kamalinder Kaur

  2. Chandigarh University, Ajitgarh, India

    Vishal Bharti

Authors
  1. Kamalinder Kaur
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Vishal Bharti
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Kamalinder Kaur .

Editor information

Editors and Affiliations

  1. Department of Computer Science and Engineering, GB Pant Government Engineering College, New Delhi, India

    Mamta Mittal

  2. Department of Automation and Applied Informatics, Aurel Vlaicu University of Arad, Arad, Romania

    Valentina E. Balas

  3. Department of Computer Science and Engineering, Bharati Vidyapeeth’s College of Engineering, New Delhi, India

    Lalit Mohan Goyal

  4. Department of Computer Science and Engineering, Laxmi Narayan College of Technology, Jabalpur, Madhya Pradesh, India

    Raghvendra Kumar

Rights and permissions

Reprints and permissions

Copyright information

© 2019 Springer Nature Singapore Pte Ltd.

About this chapter

Check for updates. Verify currency and authenticity via CrossMark

Cite this chapter

Kaur, K., Bharti, V. (2019). A Survey on Big Data—Its Challenges and Solution from Vendors. In: Mittal, M., Balas, V., Goyal, L., Kumar, R. (eds) Big Data Processing Using Spark in Cloud. Studies in Big Data, vol 43 . Springer, Singapore. https://doi.org/10.1007/978-981-13-0550-4_1

Download citation

  • DOI: https://doi.org/10.1007/978-981-13-0550-4_1

  • Published:

  • Publisher Name: Springer, Singapore

  • Print ISBN: 978-981-13-0549-8

  • Online ISBN: 978-981-13-0550-4

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics

Search

Navigation