drop tablespace, create tablespace 작업 수행 중 갑자기 instance가 중지되는 상황발생.
재기동 수행하였으나 pfile을 읽어올 수 없다는 오류와 이후 controlfile을 읽어 올 수 없다는 오류 확인.
==> instance에서 grid의 ASM에 접근하지 못해 문제가 발생한다는 것을 유추
[oracle@oel19c1 db_1]$ srvctl start instance -d ORADB -i ORADB1
PRCR-1013 : Failed to start resource ora.oradb.db
PRCR-1064 : Failed to start resource ora.oradb.db on node oel19c1
CRS-5017: The resource action "ora.oradb.db start" encountered the following error:
ORA-01078: failure in processing system parameters
LRM-00109: could not open parameter file '/u01/app/oracle/product/19c/db_1/dbs/initORADB1.ora'
. For details refer to "(:CLSN00107:)" in "/u01/app/grid/base/diag/crs/oel19c1/crs/trace/crsd_oraagent_oracle.trc".
파라미터 파일을 못 찾고 있어 해당 트레이스 파일 분석
2025-06-30 16:56:59.046 : CLSDADR:2251872000: [ ERROR] (:CLSD0023:)dynamic component [R2080545] mapped to [CLSDYNAM]
2025-06-30 16:56:59.046 : AGFW:2251872000: [ INFO] {0:8:2} ID = [ora.oradb.db 1 1] Intermediate Timeout = [0]
2025-06-30 16:56:59.046 : AGFW:2251872000: [ INFO] {0:8:2} Added new resource: ora.oradb.db 1 1 to the agfw
발생한 에러 내용 분석, 비슷한 사례를 찾을 수 있었다.
$GRID_HOME/bin/oracle의 권한이 잘못 설정되어 있어 발생한 문제임
기존의 775로 설정되어 있던 것을 6751로 스티키 비트를 추가하여 문제를 해결할 수 있었다.
[grid@oel19c1 bin]$ ls -altr oracle
-rwxrwxr-x 1 grid dba 438006280 Jan 26 23:01 oracle
[grid@oel19c1 bin]$ chmod 6751 ./oracle
[grid@oel19c1 bin]$ ls -altr oracle
-rwsr-s--x 1 grid dba 438006280 Jan 26 23:01 oracle
[oracle@oel19c1 db_1]$ srvctl start instance -d ORADB -i ORADB1
[grid@oel19c1 ~]$ crsctl stat res -t
--------------------------------------------------------------------------------
Name Target State Server State details
--------------------------------------------------------------------------------
Local Resources
--------------------------------------------------------------------------------
ora.LISTENER.lsnr
ONLINE ONLINE oel19c1 STABLE
ONLINE ONLINE oel19c2 STABLE
ora.SPLEX.SPLEX.advm
ONLINE ONLINE oel19c1 STABLE
ONLINE ONLINE oel19c2 STABLE
ora.chad
ONLINE ONLINE oel19c1 STABLE
ONLINE ONLINE oel19c2 STABLE
ora.net1.network
ONLINE ONLINE oel19c1 STABLE
ONLINE ONLINE oel19c2 STABLE
ora.ons
ONLINE ONLINE oel19c1 STABLE
ONLINE ONLINE oel19c2 STABLE
ora.proxy_advm
ONLINE ONLINE oel19c1 STABLE
ONLINE ONLINE oel19c2 STABLE
ora.splex.splex.acfs
ONLINE ONLINE oel19c1 mounted on /splex,ST
ABLE
ONLINE ONLINE oel19c2 mounted on /splex,ST
ABLE
--------------------------------------------------------------------------------
Cluster Resources
--------------------------------------------------------------------------------
ora.ASMNET1LSNR_ASM.lsnr(ora.asmgroup)
1 ONLINE ONLINE oel19c1 STABLE
2 ONLINE ONLINE oel19c2 STABLE
ora.DATA.dg(ora.asmgroup)
1 ONLINE ONLINE oel19c1 STABLE
2 ONLINE ONLINE oel19c2 STABLE
ora.LISTENER_SCAN1.lsnr
1 ONLINE ONLINE oel19c2 STABLE
ora.OCR_VOTE.dg(ora.asmgroup)
1 ONLINE ONLINE oel19c1 STABLE
2 ONLINE ONLINE oel19c2 STABLE
ora.SPLEX.dg(ora.asmgroup)
1 ONLINE ONLINE oel19c1 STABLE
2 ONLINE ONLINE oel19c2 STABLE
ora.asm(ora.asmgroup)
1 ONLINE ONLINE oel19c1 Started,STABLE
2 ONLINE ONLINE oel19c2 Started,STABLE
ora.asmnet1.asmnetwork(ora.asmgroup)
1 ONLINE ONLINE oel19c1 STABLE
2 ONLINE ONLINE oel19c2 STABLE
ora.cvu
1 ONLINE ONLINE oel19c2 STABLE
ora.oel19c1.vip
1 ONLINE ONLINE oel19c1 STABLE
ora.oel19c2.vip
1 ONLINE ONLINE oel19c2 STABLE
ora.oradb.db
1 ONLINE ONLINE oel19c1 Open,HOME=/u01/app/o
racle/product/19c/db
_1,STABLE
2 ONLINE ONLINE oel19c2 Open,HOME=/u01/app/o
racle/product/19c/db
_1,STABLE
ora.qosmserver
1 ONLINE ONLINE oel19c2 STABLE
ora.scan1.vip
1 ONLINE ONLINE oel19c2 STABLE
--------------------------------------------------------------------------------
정상적으로 open 상태로 올라온 것을 확인 하고 문제를 해결하였다.
SQL> select instance_name, status from gv$instance;
INSTANCE_NAME STATUS
---------------- ------------
ORADB1 OPEN
ORADB2 OPEN
SQL> select * from v$tablespace;
TS# NAME INC BIG FLA ENC CON_ID
---------- ------------------------------ --- --- --- --- ----------
0 SYSTEM YES NO YES 0
1 SYSAUX YES NO YES 0
2 UNDOTBS1 YES NO YES 0
3 TEMP NO NO YES 0
4 UNDOTBS2 YES NO YES 0
5 USERS YES NO YES 0
6 SPLEX YES NO YES 0
9 TEST YES NO YES 0