Writing a Good Performance Spark Application

講者:Wisely Chen,Yahoo

講題:Writing a Good Performance Spark Application

摘要:

We all know spark is good and it is most great of cloud computing system today and we all know how to write a spark word count example. But what is next? It is time to fine tune your spark application. 

In one year's spark development experience, I often write slow spark application. After performance tuning, my application usually can be 10 times faster than before. Tips is understand the spark's internal operation and find the right way to do that. 

In this topic, I will show some tip to find your performance problem, some way to fine tune your application, and some study case about spark application. This topic will also include some spark internal operation introduction.
Tagged on: