Writing a Good Performance Spark Application
講者:Wisely Chen,Yahoo
講題:Writing a Good Performance Spark Application
摘要:
We all know spark is good and it is most great of cloud computing system today and we all know how to write a spark word count example. But what is next? It is time to fine tune your spark application. In one year's spark development experience, I often write slow spark application. After performance tuning, my application usually can be 10 times faster than before. Tips is understand the spark's internal operation and find the right way to do that. In this topic, I will show some tip to find your performance problem, some way to fine tune your application, and some study case about spark application. This topic will also include some spark internal operation introduction.
- SQL on Hadoop: a Perspective of a Cloud-based, Managed Service Provider
- 半導體製造業的 Big Data 應用