Docker jupyter/pyspark-notebook 사용하는 방법(for. Mac M1)

Run jupyter/pyspark-notebook container

$ docker run \
  -p 8888:8888 \
  -e JUPYTER_ENABLE_LAB=yes \
  -e GRANT_SUDO=yes \
  -e SPARK_OPTS="--packages org.apache.hadoop:hadoop-aws:3.3.4,com.amazonaws:aws-java-sdk-bundle:1.11.901" \
  -v /Users/gimjaemin/Downloads/pyspark_local:/home/jovyan \
  --name pyspark-notebook \
  --restart always \
  jupyter/pyspark-notebook:aarch64-java-11.0.15