docker airflow

이상민·2023년 4월 24일
0

docker

목록 보기
16/19

설치

docker

$ sudo apt-get update
$ sudo apt-get install \
    ca-certificates \
    curl \
    gnupg
    
$ sudo install -m 0755 -d /etc/apt/keyrings
$ curl -fsSL https://download.docker.com/linux/ubuntu/gpg | sudo gpg --dearmor -o /etc/apt/keyrings/docker.gpg
$ sudo chmod a+r /etc/apt/keyrings/docker.gpg    

$ echo \
  "deb [arch="$(dpkg --print-architecture)" signed-by=/etc/apt/keyrings/docker.gpg] https://download.docker.com/linux/ubuntu \
  "$(. /etc/os-release && echo "$VERSION_CODENAME")" stable" | \
  sudo tee /etc/apt/sources.list.d/docker.list > /dev/null
  
$ sudo apt-get update
$ sudo apt-get install docker-ce docker-ce-cli containerd.io docker-buildx-plugin docker-compose-plugin
$ sudo chmod 666 /var/run/docker.sock

airflow

$ curl -LfO 'https://airflow.apache.org/docs/apache-airflow/2.5.3/docker-compose.yaml'
$ mkdir -p ./dags ./logs ./plugins
$ echo -e "AIRFLOW_UID=$(id -u)" > .env
$ AIRFLOW_UID=50000
$ vi docker-compose.yaml

...
AIRFLOW__CORE__LOAD_EXAMPLES: 'false'
...

default는 true인데 example을 없애기 위해 false로 변경

$ docker compose up airflow-init
$ docker compose up -d

0개의 댓글