subject

Coursera: Big Data Analysis: Hive, Spark SQL, DataFrames and GraphFrames

 with  Natalia Pritykovskaya, Pavel Klemenkov, Pavel Mezentsev and Alexey A. Dral
Sponsored
Complexity Tutorials
Santa Fe University via Complexity Explorer
Sponsored
Project Management Certificate
Cornell University via eCornell
No doubt working with huge data volumes is hard, but to move a mountain, you have to deal with a lot of small stones. But why strain yourself? Using Mapreduce and Spark you tackle the issue partially, thus leaving some space for high-level tools. Stop struggling to make your big data workflow productive and efficient, make use of the tools we are offering you.

This course will teach you how to:
- Warehouse your data efficiently using Hive, Spark SQL and Spark DataFframes.
- Work with large graphs, such as social graphs or networks.
- Optimize your Spark applications for maximum performance.

Precisely, you will master your knowledge in:
- Writing and executing Hive & Spark SQL queries;
- Reasoning how the queries are translated into actual execution primitives (be it MapReduce jobs or Spark transformations);
- Organizing your data in Hive to optimize disk space usage and execution times;
- Constructing Spark DataFrames and using them to write ad-hoc analytical jobs easily;
- Processing large graphs with Spark GraphFrames;
- Debugging, profiling and optimizing Spark application performance.

Still in doubt? Check this out. Become a data ninja by taking this course!

Special thanks to:
- Prof. Mikhail Roytberg, APT dept., MIPT, who was the initial reviewer of the project, the supervisor and mentor of half of the BigData team. He was the one, who helped to get this show on the road.
- Oleg Sukhoroslov (PhD, Senior Researcher at IITP RAS), who has been teaching MapReduce, Hadoop and friends since 2008. Now he is leading the infrastructure team.
- Oleg Ivchenko (PhD student APT dept., MIPT), Pavel Akhtyamov (MSc. student at APT dept., MIPT) and Vladimir Kuznetsov (Assistant at P.G. Demidov Yaroslavl State University), superbrains who have developed and now maintain the infrastructure used for practical assignments in this course.
- Asya Roitberg, Eugene Baulin, Marina Sudarikova. These people never sleep to babysit this course day and night, to make your learning experience productive, smooth and exciting.

Syllabus

Welcome to the Second Course: Big Data Analysis


Big Data SQL: Hive


Big Data SQL: Hive (practice week)


Spark SQL and Spark Dataframe


Graph Analysis from Big Data Perspective


PageRank and Recent Advances


Spark Internals and Optimization


0 Student
reviews
Cost Free Online Course (Audit)
Pace Upcoming
Subject Big Data
Institution Yandex
Provider Coursera
Language English
Certificates Paid Certificate Available
Calendar 6 weeks long
Sign up for free? Learn how

Disclosure: To support our site, Class Central may be compensated by some course providers.

+ Add to My Courses
FAQ View All
What are MOOCs?
MOOCs stand for Massive Open Online Courses. These are free online courses from universities around the world (eg. Stanford Harvard MIT) offered to anyone with an internet connection.
How do I register?
To register for a course, click on "Go to Class" button on the course page. This will take you to the providers website where you can register for the course.
How do these MOOCs or free online courses work?
MOOCs are designed for an online audience, teaching primarily through short (5-20 min.) pre recorded video lectures, that you watch on weekly schedule when convenient for you.  They also have student discussion forums, homework/assignments, and online quizzes or exams.

0 reviews for Coursera's Big Data Analysis: Hive, Spark SQL, DataFrames and GraphFrames

Write a review

Class Central

Get personalized course recommendations, track subjects and courses with reminders, and more.

Sign up for free