Kubeflow

JeongChaeJin·2022년 11월 18일
0

설치 파일 준비

  • kubeflow v1.4.0 설치에 필요한 manifests 파일 준비
git clone -b v1.4.0 https://github.com/kubeflow/manifests.git
cd manifests

구성 요소별 설치

  • 해당 튜토리얼에서는 KFserving, MPI Operato, Knative 설치는 리소스 효율로 배제하고 설치

1. Cert-manager

kustomize build common/cert-manager/cert-manager/base | kubectl apply -f -
kubectl get pod -n cert-manager

  • 3개 pod 모두 Running 될 때까지 대기
kustomize build common/cert-manager/kubeflow-issuer/base | kubectl apply -f -
  • kubeflow-issuer 설치

2. Istio

kustomize build common/istio-1-9/istio-crds/base | kubectl apply -f -
  • istio 관련 Custom Resource Definition(CRD) 설치
kustomize build common/istio-1-9/istio-namespace/base | kubectl apply -f -
  • istio namespace 설치
kustomize build common/istio-1-9/istio-install/base | kubectl apply -f -
  • istio 설치
kubectl get po -n istio-system

  • istio-system namspace의 2개 pod 모두 Running 될 때까지 대기

3. Dex

kustomize build common/dex/overlays/istio | kubectl apply -f -
kubectl get po -n auth

4. OIDC AuthService

kustomize build common/oidc-authservice/base | kubectl apply -f -
kubectl get po -n istio-system -w

5. Kubeflow Namespace

kustomize build common/kubeflow-namespace/base | kubectl apply -f -
kubectl get ns kubeflow
  • namespace 조회

6. Kubeflow Roles

kustomize build common/kubeflow-roles/base | kubectl apply -f -
kubectl get clusterrole | grep kubeflow

7. Kubeflow Istio Resources

kustomize build common/istio-1-9/kubeflow-istio-resources/base | kubectl apply -f -
kubectl get clusterrole | grep kubeflow-istio
kubectl get gateway -n kubeflow

8. Kubeflow Pipelines

kustomize build apps/pipeline/upstream/env/platform-agnostic-multi-user | kubectl apply -f -
  • error 나면 10초 뒤 재실행
kubectl get po -n kubeflow
  • 16개 pod 모두 Running 될 때까지 기다려야된다.
kubectl port-forward svc/ml-pipeline-ui -n kubeflow 8888:80

kubectl port-forward --address 0.0.0.0 svc/ml-pipeline-ui -n kubeflow 8888:80
  • 보안상 문제가 되지 않을 시 --address를 0.0.0.0 을 해줄 수 있다.

9. Katib

kustomize build apps/katib/upstream/installs/katib-with-kubeflow | kubectl apply -f -
kubectl get po -n kubeflow | grep katib
kubectl port-forward svc/katib-ui -n kubeflow 8081:80

10. Central Dashboard

kustomize build apps/centraldashboard/upstream/overlays/istio | kubectl apply -f -
kubectl get po -n kubeflow | grep centraldashboard
kubectl port-forward svc/centraldashboard -n kubeflow 8082:80

11. Admission Webhook

kustomize build apps/admission-webhook/upstream/overlays/cert-manager | kubectl apply -f -
kubectl get po -n kubeflow | grep admission-webhook

12. Notebooks & Jupyter Web App

kustomize build apps/jupyter/notebook-controller/upstream/overlays/kubeflow | kubectl apply -f -
  • Notebook controller 설치
kubectl get po -n kubeflow | grep notebook-controller
kustomize build apps/jupyter/jupyter-web-app/upstream/overlays/istio | kubectl apply -f -
kubectl get po -n kubeflow | grep jupyter-web-app

13. Profiles + KFAM

kustomize build apps/profiles/upstream/overlays/kubeflow | kubectl apply -f -
  • Profile Controller 설치
kubectl get po -n kubeflow | grep profiles-deployment

14. Volumes Web App

kustomize build apps/volumes-web-app/upstream/overlays/istio | kubectl apply -f -
kubectl get po -n kubeflow | grep volumes-web-app

15. Tensorboard & Tensorboard Web App

kustomize build apps/tensorboard/tensorboards-web-app/upstream/overlays/istio | kubectl apply -f -
  • Tensorboard Web APP 설치
kubectl get po -n kubeflow | grep tensorboards-web-app
kustomize build apps/tensorboard/tensorboard-controller/upstream/overlays/kubeflow | kubectl apply -f -
  • Tensorboard Controller 설치
kubectl get po -n kubeflow | grep tensorboard-controller

16. Training Operator

kustomize build apps/training-operator/upstream/overlays/kubeflow | kubectl apply -f -
kubectl get po -n kubeflow | grep training-operator

17. User Namespace

kustomize build common/user-namespace/base | kubectl apply -f -
  • User의 kubeflo Profile 생성
kubectl get profile

18. 정상 설치 확인

kubectl port-forward svc/istio-ingressgateway -n istio-system 8080:80

  • 위와 같은 화면 출력
profile
OnePunchLotto

0개의 댓글