!vsphere

luna·2022년 12월 14일
Task 41 | 00:38:52 | Preparing deployment: Preparing deployment (00:03:22)
                   L Error: Net::ReadTimeout
Task 41 | 00:42:14 | Error: Net::ReadTimeout with #<Socket:(closed)>

Task 41 Started  Tue Nov 29 00:38:52 UTC 2022
Task 41 Finished Tue Nov 29 00:42:14 UTC 2022
Task 41 Duration 00:03:22
Task 41 error

Updating deployment:
  Expected task '41' to succeed but state is 'error'

Exit code 1

→ server error

⇒ 재배포

uaac 설치 시

ubuntu@ubuntu:~/workspace/paasta-deployment/paasta$ sudo gem install cf-uaac
Fetching: multi_json-1.15.0.gem (100%)
Successfully installed multi_json-1.15.0
Fetching: httpclient-2.8.3.gem (100%)
Successfully installed httpclient-2.8.3
Fetching: public_suffix-5.0.0.gem (100%)
ERROR:  Error installing cf-uaac:
	The last version of public_suffix (< 6.0, >= 2.0.2) to support your Ruby & RubyGems was 4.0.7. Try installing it with `gem install public_suffix -v 4.0.7` and then running the current command again
	public_suffix requires Ruby version >= 2.6. The current ruby version is 2.5.0.
ubuntu@ubuntu:~/workspace/paasta-deployment/paasta$ uaac -v

Command 'uaac' not found, did you mean:

  command 'faac' from deb faac

Try: sudo apt install <deb name>

⇒ # gem install public_suffix -v 4.0.7

⇒ sudo gem install cf-uaac

⇒ uaac 설치 성공

delete vm, deploy vm

Task 1427 | 01:15:44 | Deleting orphaned disks: disk-199800b7-deb0-4409-844c-9e9c7670141d
Task 1427 | 01:15:44 | Deleting orphaned disks: disk-1a3824bf-0834-413a-9396-d2313efa557c (00:02:14)
                     L Error: Unknown CPI error 'Unknown' with message 'Cannot complete login due to an incorrect user name or password.' in 'delete_disk' CPI method (CPI request ID: 'cpi-906043')
Task 1427 | 01:18:02 | Deleting orphaned disks: disk-199800b7-deb0-4409-844c-9e9c7670141d (00:02:18)
                     L Error: Unknown CPI error 'Unknown' with message 'Cannot complete login due to an incorrect user name or password.' in 'delete_disk' CPI method (CPI request ID: 'cpi-611053')
Task 1427 | 01:18:02 | Error: Unknown CPI error 'Unknown' with message 'Cannot complete login due to an incorrect user name or password.' in 'delete_disk' CPI method (CPI request ID: 'cpi-906043')

Task 1427 Started  Mon Dec 12 01:15:44 UTC 2022
Task 1427 Finished Mon Dec 12 01:18:02 UTC 2022
Task 1427 Duration 00:02:18
Task 1427 error
Task 1433 | 01:43:57 | Compiling packages: paas-ta-portal-webadmin/1a10a9ba30991e8b9fa7958be2c01a312bba420d9365ef3f1028c3344855bf7e (00:02:30)
                     L Error: Unknown CPI error 'Unknown' with message 'Cannot complete login due to an incorrect user name or password.' in 'create_vm' CPI method (CPI request ID: 'cpi-981841')
Task 1433 | 01:43:57 | Compiling packages: paas-ta-portal-webuser/d508f816655464e78d1c8972219885d25c2c6a0ec615745996d4d6376b0f33d1 (00:02:30)
                     L Error: Unknown CPI error 'Unknown' with message 'Cannot complete login due to an incorrect user name or password.' in 'create_vm' CPI method (CPI request ID: 'cpi-342049')
Task 1433 | 01:43:58 | Compiling packages: haproxy/bb90d8f2bd0b933565b1a5e19a7be768202a96888e37ffa496aca32601914e27 (00:02:31)
                     L Error: Unknown CPI error 'Unknown' with message 'Cannot complete login due to an incorrect user name or password.' in 'create_vm' CPI method (CPI request ID: 'cpi-551008')
Task 1433 | 01:43:58 | Compiling packages: java/3a86c4255298566216c2ffe755c72f4d9149ec407af4da5ece2c36aaa68d700c (00:02:31)
                     L Error: Unknown CPI error 'Unknown' with message 'Cannot complete login due to an incorrect user name or password.' in 'create_vm' CPI method (CPI request ID: 'cpi-848152')
Task 1433 | 01:43:58 | Compiling packages: apache2/8e92c90d7de648316b4b6b9bcdbb187884fcfbb0a7011ed0fd37779d36740179 (00:02:31)
                     L Error: Unknown CPI error 'Unknown' with message 'Cannot complete login due to an incorrect user name or password.' in 'create_vm' CPI method (CPI request ID: 'cpi-563819')
Task 1433 | 01:43:58 | Error: Unknown CPI error 'Unknown' with message 'Cannot complete login due to an incorrect user name or password.' in 'create_vm' CPI method (CPI request ID: 'cpi-981841')

Task 1433 Started  Mon Dec 12 01:41:15 UTC 2022
Task 1433 Finished Mon Dec 12 01:43:58 UTC 2022
Task 1433 Duration 00:02:43
Task 1433 error

Updating deployment:
  Expected task '1433' to succeed but state is 'error'

Exit code 1

code debug

$ bosh tasks --recent

ubuntu@ubuntu:~/workspace/portal-deployment/portal-ui$ bosh tasks --recent
Using environment '10.0.31.6' as client 'admin'

ID    State  Started At                    Finished At                   User       Deployment              Description                        Result  
1433  error  Mon Dec 12 01:41:12 UTC 2022  Mon Dec 12 01:43:58 UTC 2022  admin      portal-ui               create deployment                  Unknown CPI error 'Unknown' with message 'Cannot complete login due to an incorrect user name or password.' in 'create_vm' CPI...  
1431  error  Mon Dec 12 01:20:42 UTC 2022  Mon Dec 12 01:29:15 UTC 2022  admin      portal-api              create deployment                  Unknown CPI error 'Unknown' with message 'Cannot complete login due to an incorrect user name or password.' in 'create_vm' CPI...  
1430  error  Mon Dec 12 01:19:11 UTC 2022  Mon Dec 12 01:23:04 UTC 2022  admin      portal-ui               create deployment                  Net::ReadTimeout  
1429  done   Mon Dec 12 01:17:14 UTC 2022  Mon Dec 12 01:20:33 UTC 2022  admin      -                       create release                     Created release 'paasta-portal-api-release/2.5.10'  
1428  done   Mon Dec 12 01:16:32 UTC 2022  Mon Dec 12 01:19:07 UTC 2022  admin      -                       create release                     Created release 'paasta-portal-ui-release/2.5.9'  
1414  done   Mon Dec 12 01:03:11 UTC 2022  Mon Dec 12 01:05:45 UTC 2022  admin      logging-service         delete deployment logging-service  /deployments/logging-service  
1413  error  Mon Dec 12 01:00:27 UTC 2022  Mon Dec 12 01:02:57 UTC 2022  admin      logging-service         delete deployment logging-service  Unknown CPI error 'Unknown' with message 'Cannot complete login due to an incorrect user name or password.' in 'delete_vm' CPI...  
1411  error  Mon Dec 12 00:56:30 UTC 2022  Mon Dec 12 00:58:57 UTC 2022  admin      logging-service         delete deployment logging-service  Unknown CPI error 'Unknown' with message 'Cannot complete login due to an incorrect user name or password.' in 'delete_vm' CPI...  
1398  error  Mon Dec 12 00:50:45 UTC 2022  Mon Dec 12 00:53:24 UTC 2022  admin      logging-service         delete deployment logging-service  Unknown CPI error 'Unknown' with message 'Cannot complete login due to an incorrect user name or password.' in 'delete_vm' CPI...  
1384  error  Mon Dec 12 00:41:03 UTC 2022  Mon Dec 12 00:43:55 UTC 2022  admin      logging-service         delete deployment logging-service  Action Failed get_task: Task 5d6fc06b-9568-4225-4ea6-0c873a1d33c8 result: Stopping Monitored Services: Stopping services...  
1340  done   Sun Dec 11 07:00:06 UTC 2022  Sun Dec 11 07:00:06 UTC 2022  scheduler  web-ide                 snapshot deployment                snapshots of deployment 'web-ide' created  
1339  done   Sun Dec 11 07:00:06 UTC 2022  Sun Dec 11 07:00:06 UTC 2022  scheduler  logging-service         snapshot deployment                snapshots of deployment 'logging-service' created  
1338  done   Sun Dec 11 07:00:05 UTC 2022  Sun Dec 11 07:00:05 UTC 2022  scheduler  rabbitmq                snapshot deployment                snapshots of deployment 'rabbitmq' created  
1337  done   Sun Dec 11 07:00:05 UTC 2022  Sun Dec 11 07:00:05 UTC 2022  scheduler  source-control-service  snapshot deployment                snapshots of deployment 'source-control-service' created  
1336  done   Sun Dec 11 07:00:05 UTC 2022  Sun Dec 11 07:00:05 UTC 2022  scheduler  lifecycle-service       snapshot deployment                snapshots of deployment 'lifecycle-service' created  
1335  done   Sun Dec 11 07:00:05 UTC 2022  Sun Dec 11 07:00:05 UTC 2022  scheduler  redis                   snapshot deployment                snapshots of deployment 'redis' created  
1334  done   Sun Dec 11 07:00:05 UTC 2022  Sun Dec 11 07:00:05 UTC 2022  scheduler  glusterfs               snapshot deployment                snapshots of deployment 'glusterfs' created  
1333  done   Sun Dec 11 07:00:02 UTC 2022  Sun Dec 11 07:00:03 UTC 2022  scheduler  mysql                   snapshot deployment                snapshots of deployment 'mysql' created  
1332  done   Sun Dec 11 07:00:01 UTC 2022  Sun Dec 11 07:00:01 UTC 2022  scheduler  gateway-service         snapshot deployment                snapshots of deployment 'gateway-service' created  
1331  done   Sun Dec 11 07:00:01 UTC 2022  Sun Dec 11 07:00:01 UTC 2022  scheduler  pinpoint                snapshot deployment                snapshots of deployment 'pinpoint' created  
1330  done   Sun Dec 11 07:00:01 UTC 2022  Sun Dec 11 07:00:01 UTC 2022  scheduler  mongodb                 snapshot deployment                snapshots of deployment 'mongodb' created  
1329  done   Sun Dec 11 07:00:00 UTC 2022  Sun Dec 11 07:00:00 UTC 2022  scheduler  paasta                  snapshot deployment                snapshots of deployment 'paasta' created  
1326  done   Sat Dec 10 07:00:02 UTC 2022  Sat Dec 10 07:00:02 UTC 2022  scheduler  web-ide                 snapshot deployment                snapshots of deployment 'web-ide' created  
1325  done   Sat Dec 10 07:00:02 UTC 2022  Sat Dec 10 07:00:02 UTC 2022  scheduler  logging-service         snapshot deployment                snapshots of deployment 'logging-service' created  
1324  done   Sat Dec 10 07:00:02 UTC 2022  Sat Dec 10 07:00:02 UTC 2022  scheduler  rabbitmq                snapshot deployment                snapshots of deployment 'rabbitmq' created  
1323  done   Sat Dec 10 07:00:01 UTC 2022  Sat Dec 10 07:00:02 UTC 2022  scheduler  source-control-service  snapshot deployment                snapshots of deployment 'source-control-service' created  
1322  done   Sat Dec 10 07:00:01 UTC 2022  Sat Dec 10 07:00:01 UTC 2022  scheduler  lifecycle-service       snapshot deployment                snapshots of deployment 'lifecycle-service' created  
1321  done   Sat Dec 10 07:00:01 UTC 2022  Sat Dec 10 07:00:01 UTC 2022  scheduler  redis                   snapshot deployment                snapshots of deployment 'redis' created  
1320  done   Sat Dec 10 07:00:01 UTC 2022  Sat Dec 10 07:00:01 UTC 2022  scheduler  glusterfs               snapshot deployment                snapshots of deployment 'glusterfs' created  
1319  done   Sat Dec 10 07:00:01 UTC 2022  Sat Dec 10 07:00:01 UTC 2022  scheduler  mysql                   snapshot deployment                snapshots of deployment 'mysql' created

$ bosh task 1413
ubuntu@ubuntu:~/workspace/portal-deployment/portal-ui$ bosh task 1413
Using environment '10.0.31.6' as client 'admin'

Task 1413

Task 1413 | 01:00:28 | Deleting instances: influxdb/07f2c28c-61f0-41a5-b456-11d42b4227d7 (0)
Task 1413 | 01:00:28 | Deleting instances: fluentd/93d1cfb0-9bef-4f30-90b8-bd703c11f9ac (0)
Task 1413 | 01:00:28 | Deleting instances: log-api/23f92f64-a2a2-4e6b-80d7-225059a21827 (0)
Task 1413 | 01:00:28 | Deleting instances: collector/45e3b754-edf5-4296-9791-ead0c55f28da (0)
Task 1413 | 01:02:52 | Deleting instances: fluentd/93d1cfb0-9bef-4f30-90b8-bd703c11f9ac (0) (00:02:24)
                     L Error: Unknown CPI error 'Unknown' with message 'Cannot complete login due to an incorrect user name or password.' in 'delete_vm' CPI method (CPI request ID: 'cpi-508504')
Task 1413 | 01:02:54 | Deleting instances: influxdb/07f2c28c-61f0-41a5-b456-11d42b4227d7 (0) (00:02:26)
                     L Error: Unknown CPI error 'Unknown' with message 'Cannot complete login due to an incorrect user name or password.' in 'delete_vm' CPI method (CPI request ID: 'cpi-761102')
Task 1413 | 01:02:55 | Deleting instances: collector/45e3b754-edf5-4296-9791-ead0c55f28da (0) (00:02:27)
                     L Error: Unknown CPI error 'Unknown' with message 'Cannot complete login due to an incorrect user name or password.' in 'delete_vm' CPI method (CPI request ID: 'cpi-834453')
Task 1413 | 01:02:57 | Deleting instances: log-api/23f92f64-a2a2-4e6b-80d7-225059a21827 (0) (00:02:29)
                     L Error: Unknown CPI error 'Unknown' with message 'Cannot complete login due to an incorrect user name or password.' in 'delete_vm' CPI method (CPI request ID: 'cpi-375986')
Task 1413 | 01:02:57 | Error: Unknown CPI error 'Unknown' with message 'Cannot complete login due to an incorrect user name or password.' in 'delete_vm' CPI method (CPI request ID: 'cpi-508504')

Task 1413 Started  Mon Dec 12 01:00:28 UTC 2022
Task 1413 Finished Mon Dec 12 01:02:57 UTC 2022
Task 1413 Duration 00:02:29
Task 1413 error

Capturing task '1413' output:
  Expected task '1413' to succeed but state is 'error'

Exit code 1

$ bosh task 1413 --debug
...
/var/vcap/data/packages/director/29c6d3c11e82720ae0294b1f1cacedc20590012e/gem_home/ruby/3.1.0/gems/bosh_common-0.0.0/lib/common/thread_pool.rb:77:in `block (2 levels) in create_thread'
/var/vcap/data/packages/director/29c6d3c11e82720ae0294b1f1cacedc20590012e/gem_home/ruby/3.1.0/gems/bosh_common-0.0.0/lib/common/thread_pool.rb:63:in `loop'
/var/vcap/data/packages/director/29c6d3c11e82720ae0294b1f1cacedc20590012e/gem_home/ruby/3.1.0/gems/bosh_common-0.0.0/lib/common/thread_pool.rb:63:in `block in create_thread'
/var/vcap/data/packages/director/29c6d3c11e82720ae0294b1f1cacedc20590012e/gem_home/ruby/3.1.0/gems/logging-2.2.2/lib/logging/diagnostic_context.rb:474:in `block in create_with_logging_context'
D, [2022-12-12T10:02:57.258272 #499017] [task:1413] DEBUG -- DirectorJobRunner: (0.000177s) (conn: 15460) SELECT * FROM "tasks" WHERE "id" = 1413
D, [2022-12-12T10:02:57.259449 #499017] [task:1413] DEBUG -- DirectorJobRunner: (0.000074s) (conn: 15440) BEGIN
D, [2022-12-12T10:02:57.260494 #499017] [task:1413] DEBUG -- DirectorJobRunner: (0.000438s) (conn: 15440) UPDATE "tasks" SET "state" = 'error', "timestamp" = '2022-12-12 01:02:57.259017+0000', "description" = 'delete deployment logging-service', "result" = 'Unknown CPI error ''Unknown'' with message ''Cannot complete login due to an incorrect user name or password.'' in ''delete_vm'' CPI...', "output" = '/var/vcap/store/director/tasks/1413', "checkpoint_time" = '2022-12-12 01:02:27.837931+0000', "type" = 'delete_deployment', "username" = 'admin', "deployment_name" = 'logging-service', "started_at" = '2022-12-12 01:00:27.829137+0000', "event_output" = '{"time":1670806828,"stage":"Deleting instances","tags":[],"total":4,"task":"influxdb/07f2c28c-61f0-41a5-b456-11d42b4227d7 (0)","index":1,"state":"started","progress":0}
{"time":1670806828,"stage":"Deleting instances","tags":[],"total":4,"task":"fluentd/93d1cfb0-9bef-4f30-90b8-bd703c11f9ac (0)","index":2,"state":"started","progress":0}
{"time":1670806828,"stage":"Deleting instances","tags":[],"total":4,"task":"log-api/23f92f64-a2a2-4e6b-80d7-225059a21827 (0)","index":3,"state":"started","progress":0}
{"time":1670806828,"stage":"Deleting instances","tags":[],"total":4,"task":"collector/45e3b754-edf5-4296-9791-ead0c55f28da (0)","index":4,"state":"started","progress":0}
{"time":1670806972,"stage":"Deleting instances","tags":[],"total":4,"task":"fluentd/93d1cfb0-9bef-4f30-90b8-bd703c11f9ac (0)","index":2,"state":"failed","progress":100,"data":{"error":"Unknown CPI error ''Unknown'' with message ''Cannot complete login due to an incorrect user name or password.'' in ''delete_vm'' CPI method (CPI request ID: ''cpi-508504'')"}}
{"time":1670806974,"stage":"Deleting instances","tags":[],"total":4,"task":"influxdb/07f2c28c-61f0-41a5-b456-11d42b4227d7 (0)","index":1,"state":"failed","progress":100,"data":{"error":"Unknown CPI error ''Unknown'' with message ''Cannot complete login due to an incorrect user name or password.'' in ''delete_vm'' CPI method (CPI request ID: ''cpi-761102'')"}}
{"time":1670806975,"stage":"Deleting instances","tags":[],"total":4,"task":"collector/45e3b754-edf5-4296-9791-ead0c55f28da (0)","index":4,"state":"failed","progress":100,"data":{"error":"Unknown CPI error ''Unknown'' with message ''Cannot complete login due to an incorrect user name or password.'' in ''delete_vm'' CPI method (CPI request ID: ''cpi-834453'')"}}
{"time":1670806977,"stage":"Deleting instances","tags":[],"total":4,"task":"log-api/23f92f64-a2a2-4e6b-80d7-225059a21827 (0)","index":3,"state":"failed","progress":100,"data":{"error":"Unknown CPI error ''Unknown'' with message ''Cannot complete login due to an incorrect user name or password.'' in ''delete_vm'' CPI method (CPI request ID: ''cpi-375986'')"}}
{"time":1670806977,"error":{"code":100,"message":"Unknown CPI error ''Unknown'' with message ''Cannot complete login due to an incorrect user name or password.'' in ''delete_vm'' CPI method (CPI request ID: ''cpi-508504'')"}}
', "result_output" = '', "context_id" = '' WHERE ("id" = 1413)
D, [2022-12-12T10:02:57.262731 #499017] [task:1413] DEBUG -- DirectorJobRunner: (0.000394s) (conn: 15440) COMMIT
I, [2022-12-12T10:02:57.262952 #499017] []  INFO -- DirectorJobRunner: Task took 2 minutes 29.569363691999996 seconds to process.

Task 1413 error

Capturing task '1413' output:
  Expected task '1413' to succeed but state is 'error'

Exit code 1

$ nslookup 61.252.53.230
** server can't find 230.53.252.61.in-addr.arpa: NXDOMAIN

→ cpi 에 등록한 id, pw 통신 에러로 예상

~ …/bosh/vsphere-vars.yml

# BOSH VARIABLE
bosh_client_admin_id: "admin"                   # Bosh Client Admin ID
director_name: "micro-bosh"                     # BOSH Director Name
private_cidr: "10.0.31.0/24"                    # Private IP Range
private_gw: "10.0.31.1"                         # Private IP Gateway
bosh_ip: "10.0.31.6"                           # Private IP 
network_name: "TA_LUNA_31"                              # Private Network Name (vCenter)        
vcenter_dc: "NIA_DataCenter"                    # vCenter Data Center Name
vcenter_ds: "SCV3000_datastore1"                        # vCenter Data Storage Name
vcenter_ip: "61.252.53.230"                     # vCenter Private IP
vcenter_user: "Administrator@VSPHERE.LOCAL"                             # vCenter User Name
vcenter_password: "Admin123!@#"                 # vCenter User Password
vcenter_templates: "TA_Templates"               # vCenter Templates Name
vcenter_vms: "TA_Vms"                   # vCenter VMS Name
vcenter_disks: "TA_Disks"                       # vCenter Disk Name
vcenter_cluster: "NIA_CLUSTER"                  # vCenter Cluster Name
vcenter_rp: "PaaS-TA_Pool"                      # vCenter Resource Pool Name

# MONITORING VARIABLE(PaaS-TA Monitoring뼾]~D 뼾D¤츾X켾U|  경뼾Z° 뼾H~X빼 ~U)
metric_url: "10.0.161.101"          # influxdb IP
syslog_address: "10.0.121.100"      # td-agent IP
syslog_port: "2514"                 # td-agent Port
syslog_transport: "udp"             # td-agent Logging Protocol

→ 현재 "61.252.53.230" 대시보드 접속 불가

접속 시 no healthy upstream

0개의 댓글