Following a short introduction to Storage System and BlockManager, this AMA session shows when and how Spark saves data to disk using the storage system. While being fairly low-level, there is still enough high-level info that any Spark user could benefit from.
In this session we begin with a very short introduction to Storage System and BlockManager. During this session we are going to show you when and how Spark saves data to disk using the storage system. It's going to be fairly low-level, but there will be enough high-level info that anybody should benefit. This session can get interactive so expect questions to drive how low / high we end up discussing.


This session was recorded live as part of our weekly Ask Me Anything sessions, live every Wednesday.

Join us for future Ask Me Anything sessions! More details on our website.