[Data Study — 01] Spark Setup

Ryan Kim
Nov 3, 2024

--

Setup Spark Study based on Docker

I have set up Apache Spark based on Docker (docker-compose).

It can be possible to install spark on bare metal but spark 3.x supports k8s native environment and latency & overhead are not high so much.

Therefore, studying Spark with Docker is easy to install and manage, and it allows you to practice case studies, performance tests, and many references.

I omit the strengths and weaknesses of Spark because there are enough posts of it.

If you want to leave feedback, let you comment on anything in this post.

Ryan

--

--

Ryan Kim
Ryan Kim

No responses yet