Big Data Hadoop Tutorial by Easylearning Guru

Learn Big data and Hadoop online at Easylearning Guru. We are offer Instructor led online training and Life Time LMS (Learning Management System). Join Our Free Live Demo Classes of Big Data Hadoop .
of 23
All materials on our website are shared by users. If you have any questions about copyright issues, please report us to resolve them. We are always happy to assist you.
Related Documents
  • 1. Welcome to the World of Big Data & Hadoop
  • 2. Agenda What is Big Data ? Different Kinds of Big Data Big Data Global Market Hadoop Global job trends What is Hadoop ?
  • 3. What is Big Data? Big data is the term for a collection of data sets so large and complex that it becomes difficult to process using on-hand database management tools or traditional data processing applications.
  • 4. Types of Big Data ? Traditional RDBMS deals with only Structured data. Semi-Structured Data Need of a technology which deals with Semi-structured data, Unstructured data and Structured data as well
  • 5. The 3V’s of Big Data
  • 6. Sources of Data Social Media & Networks (All of us are generating data) Mobile Devices (Tracking all the objects all the time) Sensor Technology & Networks (Measuring all kinds of data) Scientific Instruments (Collecting all sorts of data)
  • 7. Where Big Data is used ?
  • 8. Facebook Scenario Facebook on an average generates 70 thousand MB in 1 minute. 1 hour = 70,000 MB *60 = 4.2 Million MB 1 Day = 4.2 Million *24 MB = 10.8 Billion MB = 98438 GB 1 week = 6.9 thousand GB = 690 TB 4 weeks = 690 TB * 4 = 2756 TB = 2.7 PB 52 weeks = 2.7 PB * 52 = 143.3 PB And that’s aloooooooooot of data !
  • 9. Various Bigdata Technologies
  • 10. Big Data Global Market Big Data Implementation Implemented Big Data Yet to Implement Big Data DATA SCIENTIST BIG DATA VISUAL IZER BIG DATA RESEARCH ANALYST Sources : Dice, LinkedIn. 60 50 40 30 20 10 0 2012 2013 2014 2015 2016 2017 Big Data Growth (in USD Billions) BIG DATA ENGINEER BIG DATA ARCHITECT BIG DATA ANALYST 50 44 43 31 23 18 50 56 57 69 77 82 Filled Unfilled FILLED/VACANCY(%)
  • 11. Hadoop Global Job Trends Top Hadoop Technology Companies Sources : Dice, LinkedIn. More than 17,000 employees with Hadoop skill across these companies
  • 12. DEMAND FOR BIG DATA IN CITIES 2% 2% 3% 4% 8% 8% 10% 11% 14% 38% As of February 2014 Hadoop Global Job Trends 120 100 80 60 40 20 0 SALARY (USD P.A. IN THOUSANDS) Sources : Dice, LinkedIn.
  • 13. What is Hadoop ? Hadoop was created by Doug Cutting and Mike Cafarella. Hadoop provides the reliable shared storage and analysis system. It is designed to scale up from a single server to thousand of machines, with a high degree of fault tolerance.
  • 14. Hadoop History
  • 15. Hadoop Core Components Core Hadoop has two main systems: • Hadoop Distributed File System: The Hadoop file system is a Distributed file system which holds the large amount of data across multiple nodes in a cluster. • MapReduce: MapReduce is a distributed programming paradigm used to analyze the data in the HDFS.
  • 16. Hadoop Distributed File System (HDFS) A given file is broken down into blocks (default=64MB), then blocks are replicated across cluster (default=3). Optimized for throughput. HDFS allows you to put/get/delete files. Follows the philosophy “Write Once and Read Multiple times” Block Replication for: - Durability, High Availability and Throughput.
  • 17. MapReduce Flow
  • 18. MapReduce Framework Map Reduce works by breaking the processing into two phases : Map Phase and Reduce Phase.
  • 19.
  • 20. What we offer…
  • 21.
  • 22. Syllabus Introduction a)Big Data b)Hadoop Hadoop a)HDFS b)MapReduce PIG a)Pig 1 b)Pig 2 Hive a)Hive 1 b)Hive 2 Hbase Zookeeper Sqoop Yarn Project Class
  • 23. Thank you for watching the Live Demo for Hadoop. You can always contact us on: Phone : +91 124 4763660 (India) Email : Skype Id : Website : Your queries are always welcome.
  • We Need Your Support
    Thank you for visiting our website and your interest in our free products and services. We are nonprofit website to share and download documents. To the running of this website, we need your help to support us.

    Thanks to everyone for your continued support.

    No, Thanks

    We need your sign to support Project to invent "SMART AND CONTROLLABLE REFLECTIVE BALLOONS" to cover the Sun and Save Our Earth.

    More details...

    Sign Now!

    We are very appreciated for your Prompt Action!