This site uses cookies to provide you with a great user experience. By using it, you accept our use of cookies.

Ask me anything

Monthly virtual office hours on BigData technologies and architecture

We know how challenging the BigData landscape can be and now, when we are all working remotely because of Covid19, we believe it's the perfect time to move our office hours to a monthly virtual event.

View other AMA sessions
Past Event

Monthly event

calendar Add to calendar >
08:00 PST 11:00 EST 16:00 GMT 16:00 CET
January 6th, 2021

Spark on Kubernetes: why and how to migrate your Spark pipelines to Cloud-Native Apache Spark

In the upcoming version of Spark (3.1), the Spark on Kubernetes integration will officially be declared production ready. A lot of companies have already adopted Spark on Kubernetes to benefit from containerization, reduce their costs, and make their architecture more portable and flexible. In this talk we'll go over the main pros & cons of running Spark on Kubernetes (as opposed to Hadoop YARN or proprietary platforms). The speaker, an ex-Databricks engineer now co-founder of Data Mechanics, a commercial Spark platform deployed on Kubernetes, will give practical tips to make this migration successful.

chat

Monthly on a Wednesday

08:00 PST 11:00 EST 16:00 GMT 16:00 CET

Our team of experts will be here to answer all your BigData questions, live. Once every month we will host a live event, beginning with a short presentation on a bleeding edge topic, and then follow up with a Q&A session that is open for all.

Propose a topic for a future session

Contact Us