M1 Docker image build & push

• build할 DockerFile 준비
• docker-hadoop-spark Dockerfile
• spark 환경 : jupyterlab, spark-master, spark-worker, mongodb, mysql
• hadoop 환경 : namenode, datanode, resourcemanager, nodemanager, historyserver

---

1. docker image build

• Build an image from a Dockerfile
• docker image build 공식문서

Usage

docker build [OPTIONS] PATH | URL | -

Options

Name, shorthand	Description
--no-cache	Do not use cache when building the image
--platform	Set platform if server is multi-platform capable
--tag , -t	Name and optionally a tag in the 'name:tag' format
-f	Specify a Dockerfile path inside

Examples

• Build with PATH

# hadoop-base
$docker build --platform linux/amd64 --no-cache -t imok2/hadoop-base:hadoop3.2.2-java8 ./base
# hadoop-datanode
$docker build --platform linux/amd64 --no-cache -t imok2/hadoop-datanode:hadoop3.2.2-java8 ./datanode
# hadoop-historyserver
$docker build --platform linux/amd64 --no-cache -t imok2/hadoop-historyserver:hadoop3.2.2-java8 ./historyserver
# hadoop-namenode
$docker build --platform linux/amd64 --no-cache -t imok2/hadoop-namenode:hadoop3.2.2-java8 ./namenode
# hadoop-namenode-sqoop
$docker build --platform linux/amd64 --no-cache -t imok2/hadoop-namenode-sqoop:hadoop3.2.2-sqoop1.4.7 ./namenode-sqoop
# hadoop-nodemanager
$docker build --platform linux/amd64 --no-cache -t imok2/hadoop-nodemanager:hadoop3.2.2-java8 ./nodemanager
# hadoop-resourcemanager
$docker build --platform linux/amd64 --no-cache -t imok2/hadoop-resourcemanager:hadoop3.2.2-java8 ./resourcemanager

• Build Image List

---

2. docker push

• Push an image or a repository to a registry
• docker push 공식문서
• docker Hub 에 가입

Usage

docker push [OPTIONS] NAME[:TAG]

Examples

• Push a new image to a registry

$docker login
$docker push imok2/hadoop-base:hadoop3.2.2-java8

• docker Hub에 올린 image list 확인 : docker Hub /imok2

---

3. docker commit

• Create a new image from a container’s changes
• docker commit 공식문서

Usage

docker commit [OPTIONS] CONTAINER [REPOSITORY[:TAG]]

Examples

$docker commit -m "hadoop-base" hadoop-base imok2/hadoop-base:hadoop3.2.2-java8

---

4. docker pull

• Pull an image or a repository from a registry
• docker pull 공식문서

Usage

docker pull [OPTIONS] NAME[:TAG|@DIGEST]

Options

Name, shorthand	Description
--all-tags , -a	Download all tagged images in the repository
--platform	Set platform if server is multi-platform capable

Examples

$docker pull debian