Intro to Hadoop and Big Data: Part 1 of 10, Introduction transcript

hi I'm Frank Payne I'll be your instructor so I'm sure you have a lot of friends out there who toss around the buzzwords big data and cloud computing all the time but if you watch this course you'll be one of the few people who actually use those terms in an intelligent manner this course will go over Apaches Hadoop architecture and how to use MapReduce and hive and pig and and spark to actually extract meaning from large data sets in a scalable manner now I spent about nine years at amazon.com and at imdb.com extracting information out of their massive data sets on a continual basis and if you go through this course with me you'll understand some of the tools and techniques that are available that let you do that even from the comfort of your own home from your own desktop we'll talk about Amazon's elastic MapReduce service and how you can use that to actually analyze massive data sets right from your own home by leveraging the power of cloud computing now we're going to go through some actual real examples here we've got some movie ratings data that we're going to look at so we're not just gonna be all conceptual and hand-wavy here we're gonna actually look at some real data we're gonna actually look at some real MapReduce code and we're gonna understand how it works so you got to come away from this course with some real-world examples that you're going to look at and understand it's not just going to be conceptual a lot of it is conceptual just sit back watch the videos you don't really need any programming experience to get through it we're going to look at some actual code but it's very simple code if you've seen code before it's a good thing it'll help but you know a lot of these are just concepts are going to go over so again the point is just to make you understand these techniques and understand the terminology and I think you'll achieve that so come along dry with me let's get started