EC2 Airflow 설치하기(3)

록스블로그·2023년 11월 5일
0

이어서 airflow webserver/scheduler/flower실행을 해보자

airflow webserver -D
airflow scheduler -D
airflow celery flower -D
airflow celery worker -H custom_worker -q default,custom -D

FLOWER 실행 중 ERROR 발생

ERROR^[[0m - Future exception was never retrieved
future: <Future finished exception=OperationalError('Timeout connecting to server')>^[[0m
Traceback (most recent call last):
  File "/home/ubuntu/airflow/env/lib/python3.10/site-packages/kombu/transport/virtual/base.py", line 925, in create_channel
    return self._avail_channels.pop()
IndexError: pop from empty list

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/ubuntu/airflow/env/lib/python3.10/site-packages/redis/connection.py", line 559, in connect
    sock = self._connect()
  File "/home/ubuntu/airflow/env/lib/python3.10/site-packages/redis/connection.py", line 615, in _connect
    raise err
  File "/home/ubuntu/airflow/env/lib/python3.10/site-packages/redis/connection.py", line 603, in _connect
    sock.connect(socket_address)
TimeoutError: [Errno 110] Connection timed out

airflow.conf 파일에서 정보를 잘못 부여해준 것같다

INFO^[[0m - Connected to redis://:**@localhost:6379/0^[[0m

수정후 정상 connection 확인


그리고 후에 모두 system ctl 로 등록을 해주면 된다.

profile
어려움에 성장하는 데이터 엔지니어

0개의 댓글