OEL6.5_X86平台部署oracle11gR2RAC配置ACFS
ACFS, oracle官方定义: Oracle AutomaticStorage Management Cluster File System (Oracle ACFS) is a multi-platform,scalable file system,and storage management technology that extends OracleAutomatic Storage Management (Oracle ASM) functionality to support customerfiles maintained outside of Oracle Database. Oracle ACFS supports many databaseand application files,including executables,database trace files,databasealert logs,application reports,BFILEs,and configuration files. Othersupported files are video,audio,text,images,engineering drawings,and othergeneral-purpose application file data. 下面来介绍下11G RAC环境下ACFS的使用,当前系统环境操作系统版本为OEL6.5,数据库版本为ORACLE11204。 1. 查看ACFS相关的服务查看acfs/advm驱动是否加载 [root@jxcw1 bin]#lsmod |grep oracle [root@jxcw1 bin]# [root@jxcw2 bin]#lsmod |grep oracle [root@jxcw2 bin]# 查看集群资源 [root@jxcw1 ~]# su- grid -c crs_stat|grep acfs [root@jxcw1 ~]# [root@jxcw2 ~]# su- grid -c crs_stat|grep acfs [root@jxcw2 ~]# 使用acfsload加载驱动 [root@jxcw1 bin]#./acfsload start -s ACFS-9459:ADVM/ACFS is not supported on this OS version: '3.8.13-16.2.1.el6uek.x86_64' [root@jxcw1 bin]#uname -a Linux jxcw13.8.13-16.2.1.el6uek.x86_64 #1 SMP Thu Nov 7 17:01:44 PST 2013 x86_64 x86_64x86_64 GNU/Linux [root@jxcw1 bin]# 从报错信息中可以看出,OEL6.5操作系统11204数据库并未被支持。升级数据库版本,打补丁11204.7后驱动可以被加载,但不能被系统自动加载。处理如下: [root@jxcw1 ~]# cat/etc/init.d/acfsload #!/bin/sh # chkconfig: 234530 21 # description: LoadOracle ASM volume driver on system startup ORACLE_HOME=/u01/app/11.2.0/grid export ORACLE_HOME $ORACLE_HOME/bin/acfsloadstart -s [root@jxcw1 ~]# chkconfigadd acfsload [root@jxcw1 ~]#chkconfig --list|grep acfsload acfsload 0:off1:off 2:on 3:on4:on 5:on 6:off [root@jxcw1 ~]# [root@jxcw1 bin]#./acfsload start -s [root@jxcw1 bin]#lsmod |grep oracle oracleacfs 877320 0 oracleadvm 221760 0 oracleoks 276880 2 oracleacfs,oracleadvm [root@jxcw2bin]# lsmod |grep oracle oracleacfs 877192 0 oracleadvm 221504 0 oracleoks 277008 2 oracleacfs,oracleadvm [root@jxcw2 bin]# 添加资源ora.registry.acfs [root@jxcw1 ~]#/u01/app/11.2.0/grid/bin/crsctl add type ora.registry.acfs.type -basetypeora.local_resource.type -file/u01/app/11.2.0/grid/crs/template/registry.acfs.type [root@jxcw1 ~]# /u01/app/11.2.0/grid/bin/crsctladd resource ora.registry.acfs -attrACL='owner:root:rwx,pgrp:oinstall:r-x,other::r--' -typeora.registry.acfs.type -f [root@jxcw1 ~]# 查看是否添加成功 [root@jxcw1 ~]# su- grid -c crs_stat | grep acfs NAME=ora.registry.acfs TYPE=ora.registry.acfs.type [root@jxcw1 ~]# [root@jxcw2 ~]# su- grid -c crs_stat | grep acfs NAME=ora.registry.acfs TYPE=ora.registry.acfs.type [root@jxcw2 ~]# 查看添加的资源状态。 [grid@jxcw1 ~]$crsctl stat res -t --------------------------------------------------------------------- NAMETARGET STATE SERVER STATE_DETAILS Local Resources --------------------------------------------------------------------- ora.ARCH.dg ONLINEONLINE jxcw1 ONLINE ONLINEjxcw2 ora.CRS.dg ONLINE ONLINEjxcw1 ONLINE ONLINEjxcw2 ora.DATA.dg ONLINE ONLINEjxcw1 ONLINE ONLINEjxcw2 ora.LISTENER.lsnr ONLINE ONLINEjxcw1 ONLINE ONLINEjxcw2 ora.asm ONLINE ONLINEjxcw1Started ONLINE ONLINEjxcw2Started ora.gsd OFFLINE OFFLINE jxcw1 OFFLINE OFFLINE jxcw2 ora.net1.network ONLINE ONLINEjxcw1 ONLINE ONLINEjxcw2 ora.ons ONLINE ONLINEjxcw1 ONLINE ONLINEjxcw2 ora.registry.acfs OFFLINE OFFLINE jxcw1 OFFLINE OFFLINE jxcw2 Cluster Resources --------------------------------------------------------------------- ora.LISTENER_SCAN1.lsnr 1ONLINE ONLINE jxcw2 ora.cvu 1ONLINE ONLINE jxcw2 ora.jxcw.db 1ONLINE ONLINE jxcw1 Open 2ONLINE ONLINE jxcw2 Open ora.jxcw1.vip 1ONLINE ONLINE jxcw1 ora.jxcw2.vip 1ONLINE ONLINE jxcw2 ora.oc4j 1ONLINE ONLINE jxcw2 ora.scan1.vip 1ONLINE ONLINE jxcw2 [grid@jxcw1 ~]$ 添加的ora.registry.acfs资源默认offline,需手工启动。 [grid@jxcw1 ~]$crsctl start resource ora.registry.acfs -n jxcw1 CRS-2672:Attempting to start 'ora.registry.acfs' on 'jxcw1' CRS-2676: Start of'ora.registry.acfs' on 'jxcw1' succeeded [grid@jxcw1 ~]$crsctl start resource ora.registry.acfs -n jxcw2 CRS-2672:Attempting to start 'ora.registry.acfs' on 'jxcw2' CRS-2676: Start of'ora.registry.acfs' on 'jxcw2' succeeded 启动后查看状态如下,已为online状态。 [grid@jxcw1 ~]$crsctl stat res -t --------------------------------------------------------------------- NAME TARGET STATESERVERSTATE_DETAILS --------------------------------------------------------------------- Local Resources ora.ARCH.dg ONLINE ONLINEjxcw1 ONLINE ONLINEjxcw2 ora.CRS.dg ONLINE ONLINEjxcw1 ONLINE ONLINEjxcw2 ora.DATA.dg ONLINE ONLINEjxcw1 ONLINE ONLINEjxcw2 ora.LISTENER.lsnr ONLINE ONLINEjxcw1 ONLINE ONLINEjxcw2 ora.asm ONLINE ONLINEjxcw1Started ONLINE ONLINEjxcw2Started ora.gsd OFFLINE OFFLINE jxcw1 OFFLINE OFFLINE jxcw2 ora.net1.network ONLINE ONLINEjxcw1 ONLINEONLINE jxcw2 ora.ons ONLINE ONLINEjxcw1 ONLINE ONLINEjxcw2 ora.registry.acfs ONLINE ONLINEjxcw1 ONLINE ONLINEjxcw2 ---------------------------------------------------------------------ClusterResources --------------------------------------------------------------------- ora.LISTENER_SCAN1.lsnr 1ONLINE ONLINE jxcw2 ora.cvu 1ONLINE ONLINE jxcw2 ora.jxcw.db 1ONLINE ONLINE jxcw1 Open 2ONLINE ONLINE jxcw2 Open ora.jxcw1.vip 1ONLINE ONLINEjxcw1 ora.jxcw2.vip 1ONLINE ONLINE jxcw2 ora.oc4j 1ONLINE ONLINE jxcw2 ora.scan1.vip 1ONLINE ONLINE jxcw2 [grid@jxcw1 ~]$ 2. 使用ASMCMD命令创建ACFS(1)、使用volcreate命令创建vol01,大小为30G; ASMCMD>volcreate -G data -s 30G testvol (2)、使用volinfo查看vol01的相关信息 ASMCMD> volinfo-G data testvol Diskgroup Name:DATA Volume Name: TESTVOL Volume Device: /dev/asm/testvol-347 State: ENABLED Size (MB): 30720 Resize Unit (MB): 32 Redundancy: UNPROT Stripe Columns: 4 Stripe Width (K): 128 Usage: Mountpath: ASMCMD> (2)、使用操作系统命令查看设备名,这里的/dev/asm/ testvol-347相当于裸设备。 [grid@jxcw1 ~]$ cd/dev/asm/ [grid@jxcw1 asm]$ls -l total 0 brwxrwx--- 1 rootasmadmin 251,177665 Oct 28 13:20 testvol-347 [grid@jxcw1 asm]$ (3)、在v$asm_volume视图中使用sql查看volume相关信息 [grid@jxcw1 asm]$sqlplus / as sysasm SQL*Plus: Release11.2.0.4.0 Production on Fri Oct 28 13:22:33 2016 Copyright (c) 1982,2013,Oracle. All rights reserved. Connected to: Oracle Database 11gEnterprise Edition Release 11.2.0.4.0 - 64bit Production With the RealApplication Clusters and Automatic Storage Management options SQL> selectvolume_name,volume_device,size_mb from v$asm_volume; VOLUME_NAME VOLUME_DEVICE SIZE_MB --------------------------------------------------------- TESTVOL /dev/asm/testvol-347 30720 SQL> (4)、格式化卷,创建文件系统 [root@jxcw1 ~]#mkfs.acfs /dev/asm/testvol-347 mkfs.acfs:version = 11.2.0.4.0 mkfs.acfs: on-diskversion = 39.0 mkfs.acfs:volume =/dev/asm/testvol-347 mkfs.acfs: volumesize = 32212254720 mkfs.acfs: Formatcomplete. [root@jxcw1 ~]# (5)、注册ACFS文件系统,相当于定义挂载点,仅在节点1注册一次即可 [root@jxcw1~]#acfsutil registry -a /dev/asm/testvol-347/u01/app/grid/acfsmounts/data_testvol/ acfsutil registry:mount point /u01/app/grid/acfsmounts/data_testvol successfully added to OracleRegistry 查看文件系统信息 [root@jxcw1 ~]#acfsutil info fs /u01/app/grid/acfsmounts/data_testvol ACFS Version: 11.2.0.4.0 flags: MountPoint,Available mount time: Fri Oct 28 13:37:27 2016 volumes: 1 total size: 32212254720 total free: 32068386816 primary volume: /dev/asm/testvol-347 label: flags: Primary,Available,ADVM on-disk version: 39.0 allocation unit: 4096 major,minor: 251,177665 size: 32212254720 free: 32068386816 ADVM diskgroup DATA ADVM resize increment: 33554432 ADVM redundancy: unprotected ADVM stripe columns: 4 ADVM stripe width: 131072 number of snapshots: 0 snapshot space usage: 0 replication status: DISABLED [root@jxcw1 ~]# (6)、注册成功后自动挂载文件系统,两节点查看如下: [root@jxcw1 ~]# df-h Filesystem Size Used Avail Use% Mounted on /dev/mapper/VolGroup-lv_root 532G34G 476G 7% / tmpfs 16G 255M16G 2% /dev/shm /dev/sda1 477M 55M397M 13% /boot /dev/asm/testvol-347 30G138M 30G 1% /u01/app/grid/acfsmounts/data_testvol [root@jxcw1 ~]# [root@jxcw2 ~]# df-h Filesystem Size Used Avail Use% Mounted on /dev/mapper/VolGroup-lv_root 533G24G 487G 5% / tmpfs 16G 254M16G 2% /dev/shm /dev/sda1 477M 55M397M 13% /boot /dev/asm/testvol-347 30G 138M30G 1%/u01/app/grid/acfsmounts/data_testvol [root@jxcw2 ~]# 图形界面查看状态如下 再次查看集群资源状态 [grid@jxcw1 ~]$crsctl stat res -t --------------------------------------------------------------------- NAME TARGET STATESERVERSTATE_DETAILS --------------------------------------------------------------------- Local Resources ---------------------------------------------------------------------ora.ARCH.dg ONLINE ONLINEjxcw1 ONLINE ONLINEjxcw2 ora.CRS.dg ONLINE ONLINEjxcw1 ONLINE ONLINEjxcw2 ora.DATA.dg ONLINE ONLINEjxcw1 ONLINE ONLINEjxcw2 ora.LISTENER.lsnr ONLINEONLINE jxcw1 ONLINE ONLINEjxcw2 ora.asm ONLINE ONLINEjxcw1Started ONLINE ONLINEjxcw2Started ora.gsd OFFLINE OFFLINE jxcw1 OFFLINE OFFLINE jxcw2 ora.net1.network ONLINE ONLINE jxcw1 ONLINE ONLINEjxcw2 ora.ons ONLINE ONLINEjxcw1 ONLINE ONLINEjxcw2 ora.registry.acfs ONLINE ONLINEjxcw1 ONLINE ONLINEjxcw2 --------------------------------------------------------------------- Cluster Resources ---------------------------------------------------------------------ora.LISTENER_SCAN1.lsnr 1ONLINE ONLINE jxcw2 ora.cvu 1ONLINE ONLINE jxcw2 ora.jxcw.db 1ONLINE ONLINE jxcw1 Open 2ONLINE ONLINE jxcw2 Open ora.jxcw1.vip 1ONLINE ONLINE jxcw1 ora.jxcw2.vip 1ONLINE ONLINE jxcw2 ora.oc4j 1ONLINE ONLINE jxcw2 ora.scan1.vip 1ONLINE ONLINE jxcw2 [grid@jxcw1 ~]$ 3. asmca图形界面创建切换到grid用户下,执行asmca启动图形界面进行配置 启动图形界面后,点击asm instance可以看到advm driver状态为loaded。若acfs与advm驱动未加载时,状态为installed,volumes与asmcluster file systems标签栏为灰色无法点击。点击volumes标签,创建卷。 图中为使用命令创建成功的卷。再次点击create 指定卷名为jxcwvol,大小为25G,点击OK。 创建成功,点击ok退出,显示如下: 点击asm clusterfile systems标签 点击create,选择刚才创建的卷,选择database home file system选项,并指定图中所示挂载点。选择该选项该文件系统将作为集群资源被注册在集群中,由集群进行管理。 点击ok,创建ACFS文件系统。点击ok执行的命令如下 Create ACFSCommand: /sbin/mkfs -t acfs/dev/asm/jxcw-347 Following commandsshould be run as privileged user : /u01/app/11.2.0/grid/bin/srvctladd filesystem -d /dev/asm/jxcw-347 -g 'DATA' -v jxcwvol -m/u01/app/grid/acfsmounts/data_jxcwvol -u grid /u01/app/11.2.0/grid/bin/srvctlstart filesystem -d /dev/asm/jxcw-347 chown grid:oinstall/u01/app/grid/acfsmounts/ data_jxcwvol chmod 775/u01/app/grid/acfsmounts/data_jxcwvol 根据提示使用root账户在ASMCA图形界面启动的节点上执行途中所示命令,如下: [root@jxcw1 ~]#/u01/app/grid/cfgtoollogs/asmca/scripts/acfs_script.sh ACFS file system isrunning on jxcw1,jxcw2 [root@jxcw1 ~]# 备注:途中所执行脚本内容如下: [root@jxcw1 ~]# vi/u01/app/grid/cfgtoollogs/asmca/scripts/acfs_script.sh #!/bin/sh /u01/app/11.2.0/grid/bin/srvctlstop filesystem -d /dev/asm/jxcwvol-347 /u01/app/11.2.0/grid/bin/srvctlremove filesystem -d /dev/asm/jxcwvol-347 /u01/app/11.2.0/grid/bin/srvctladd filesystem -d /dev/asm/jxcwvol-347 -g 'DATA' -v JXCWVOL -m/u01/app/grid/acfsmounts/data_jxcwvol -u grid if [ $? ="0" -o $? = "2" ]; then /u01/app/11.2.0/grid/bin/srvctl startfilesystem -d /dev/asm/jxcwvol-347 if [ $? = "0" ]; then chown grid:oinstall/u01/app/grid/acfsmounts/data_jxcwvol chmod 775/u01/app/grid/acfsmounts/data_jxcwvol /u01/app/11.2.0/grid/bin/srvctl statusfilesystem -d /dev/asm/jxcwvol-347 exit 0 fi /u01/app/11.2.0/grid/bin/srvctl statusfilesystem -d /dev/asm/jxcwvol-347 fi 执行成功在两节点分别查看,新加ACFS文件系统已被挂载。 [root@jxcw1 ~]# df-h Filesystem Size Used Avail Use% Mounted on /dev/mapper/VolGroup-lv_root 532G34G 476G 7% / tmpfs 16G 258M16G 2% /dev/shm /dev/sda1 477M 55M397M 13% /boot /dev/asm/testvol-347 30G138M 30G 1% /u01/app/grid/acfsmounts/data_testvol /dev/asm/jxcwvol-347 25G128M 25G 1% /u01/app/grid/acfsmounts/data_jxcwvol [root@jxcw1 ~]# [root@jxcw2 ~]# df-h Filesystem Size Used Avail Use% Mounted on /dev/mapper/VolGroup-lv_root 533G24G 487G 5% / tmpfs 16G 255M16G 2% /dev/shm /dev/sda1 477M 55M397M 13% /boot /dev/asm/testvol-347 30G138M 30G 1% /u01/app/grid/acfsmounts/data_testvol /dev/asm/jxcwvol-347 25G128M 25G 1% /u01/app/grid/acfsmounts/data_jxcwvol [root@jxcw2 ~]# 再次看集群资源状态,新创建的ACFS文件系统被作为资源加入集群。 [grid@jxcw1 ~]$crsctl stat res -t --------------------------------------------------------------------- NAME TARGET STATESERVERSTATE_DETAILS --------------------------------------------------------------------- Local Resources --------------------------------------------------------------------- ora.ARCH.dg ONLINE ONLINEjxcw1 ONLINE ONLINEjxcw2 ora.CRS.dg ONLINEONLINE jxcw1 ONLINE ONLINEjxcw2 ora.DATA.dg ONLINE ONLINEjxcw1 ONLINE ONLINEjxcw2 ora.LISTENER.lsnr ONLINE ONLINEjxcw1 ONLINE ONLINEjxcw2 ora.asm ONLINE ONLINEjxcw1Started ONLINE ONLINEjxcw2Started ora.data.jxcwvol.acfs ONLINE ONLINEjxcw1 mountedon /u01/app /grid/acfsmounts/dat a_jxcwvol ONLINE ONLINEjxcw2 mountedon /u01/app /grid/acfsmounts/dat a_jxcwvol ora.gsd OFFLINE OFFLINE jxcw1 OFFLINE OFFLINE jxcw2 ora.net1.network ONLINE ONLINEjxcw1 ONLINE ONLINEjxcw2 ora.ons ONLINE ONLINEjxcw1 ONLINE ONLINEjxcw2 ora.registry.acfs ONLINE ONLINEjxcw1 ONLINE ONLINEjxcw2 ---------------------------------------------------------------------ClusterResources ---------------------------------------------------------------------ora.LISTENER_SCAN1.lsnr 1ONLINE ONLINE jxcw2 ora.cvu 1ONLINE ONLINE jxcw2 ora.jxcw.db 1ONLINE ONLINE jxcw1 Open 2ONLINE ONLINE jxcw2 Open ora.jxcw1.vip 1ONLINE ONLINE jxcw1 ora.jxcw2.vip 1ONLINE ONLINE jxcw2 ora.oc4j 1ONLINE ONLINE jxcw2 ora.scan1.vip 1ONLINE ONLINE jxcw2 [grid@jxcw1 ~]$ 再次查看注册信息如下: [root@jxcw1 ~]#acfsutil info fs /u01/app/grid/acfsmounts/data_testvol ACFS Version: 11.2.0.4.0 flags: MountPoint,177665 size: 32212254720 free: 32068386816 ADVM diskgroup DATA ADVM resize increment: 33554432 ADVM redundancy: unprotected ADVM stripe columns: 4 ADVM stripe width: 131072 number of snapshots: 0 snapshot space usage: 0 replication status: DISABLED /u01/app/grid/acfsmounts/data_jxcwvol ACFS Version: 11.2.0.4.0 flags: MountPoint,Available mount time: Fri Oct 28 13:45:44 2016 volumes: 1 total size: 26843545600 total free: 26710327296 primary volume: /dev/asm/jxcwvol-347 label: flags: Primary,177666 size: 26843545600 free: 26710327296 ADVM diskgroup DATA ADVM resize increment: 33554432 ADVM redundancy: unprotected ADVM stripe columns: 4 ADVM stripe width: 131072 number of snapshots: 0 snapshot space usage: 0 replication status: DISABLED [root@jxcw1 ~]# 4. 删除ACFS文件系统(1)、当前状态查看 [root@jxcw1 ~]# df-h Filesystem Size Used Avail Use% Mounted on /dev/mapper/VolGroup-lv_root 532G34G 476G 7% / tmpfs 16G256M 16G 2% /dev/shm /dev/sda1 477M 55M397M 13% /boot /dev/asm/jxcwvol-347 30G138M 30G 1% /u01/app/grid/acfsmounts/data_jxcwvol /dev/asm/testvol-347 15G107M 15G 1% /u01/app/grid/acfsmounts/data_testvol [root@jxcw1 ~]# [root@jxcw2 ~]# df-h Filesystem Size Used Avail Use% Mounted on /dev/mapper/VolGroup-lv_root 533G24G 487G 5% / tmpfs 16G 254M16G 2% /dev/shm /dev/sda1 477M 55M397M 13% /boot /dev/asm/jxcwvol-347 30G138M 30G 1% /u01/app/grid/acfsmounts/data_jxcwvol /dev/asm/testvol-347 15G107M 15G 1% /u01/app/grid/acfsmounts/data_testvol [root@jxcw2 ~]# [root@jxcw1 ~]# su -grid [grid@jxcw1 ~]$crsctl stat res -t -------------------------------------------------------------------------------- NAME TARGET STATESERVERSTATE_DETAILS -------------------------------------------------------------------------------- Local Resources -------------------------------------------------------------------------------- ora.ARCH.dg ONLINE ONLINEjxcw1 ONLINE ONLINEjxcw2 ora.CRS.dg ONLINE ONLINEjxcw1 ONLINE ONLINEjxcw2 ora.DATA.dg ONLINE ONLINEjxcw1 ONLINE ONLINEjxcw2 ora.LISTENER.lsnr ONLINE ONLINEjxcw1 ONLINE ONLINEjxcw2 ora.asm ONLINE ONLINEjxcw1Started ONLINE ONLINEjxcw2 Started ora.data.jxcwvol.acfs ONLINE ONLINEjxcw1 mountedon /u01/app /grid/acfsmounts/dat a_jxcwvol ONLINE ONLINEjxcw2 mountedon /u01/app /grid/acfsmounts/dat a_jxcwvol ora.gsd OFFLINE OFFLINE jxcw1 OFFLINE OFFLINE jxcw2 ora.net1.network ONLINE ONLINEjxcw1 ONLINE ONLINEjxcw2 ora.ons ONLINE ONLINEjxcw1 ONLINE ONLINEjxcw2 ora.registry.acfs ONLINE ONLINEjxcw1 ONLINE ONLINEjxcw2 -------------------------------------------------------------------------------- Cluster Resources -------------------------------------------------------------------------------- ora.LISTENER_SCAN1.lsnr 1ONLINE ONLINE jxcw1 ora.cvu 1ONLINE ONLINE jxcw2 ora.jxcw.db 1ONLINE ONLINE jxcw1 Open 2ONLINE ONLINE jxcw2 Open ora.jxcw1.vip 1ONLINE ONLINE jxcw1 ora.jxcw2.vip 1ONLINE ONLINE jxcw2 ora.oc4j 1ONLINE ONLINE jxcw2 ora.scan1.vip 1ONLINE ONLINE jxcw1 [grid@jxcw1 ~]$ (2)、卸载磁盘 节点1 [root@jxcw1 ~]#umount /dev/asm/testvol-347 [root@jxcw1 ~]#umount /dev/asm/jxcwvol-347 [root@jxcw1 ~]# df-h Filesystem Size Used Avail Use% Mounted on /dev/mapper/VolGroup-lv_root 532G34G 476G 7% / tmpfs 16G 257M16G 2% /dev/shm /dev/sda1 477M 55M 397M 13% /boot [root@jxcw1 ~]# 节点2 [root@jxcw2 ~]#umount /dev/asm/testvol-347 [root@jxcw2 ~]#umount /dev/asm/jxcwvol-347 [root@jxcw2 ~]# df-h Filesystem Size Used Avail Use% Mounted on /dev/mapper/VolGroup-lv_root 533G24G 487G 5% / tmpfs 16G 254M16G 2% /dev/shm /dev/sda1 477M 55M397M 13% /boot [root@jxcw2 ~]# 再次查看资源状态 [grid@jxcw1 ~]$crsctl stat res -t ------------------------------------------------------------------------------- NAME TARGET STATESERVERSTATE_DETAILS ------------------------------------------------------------------------------- Local Resources ------------------------------------------------------------------------------- ora.ARCH.dg ONLINE ONLINEjxcw1 ONLINE ONLINEjxcw2 ora.CRS.dg ONLINE ONLINEjxcw1 ONLINE ONLINEjxcw2 ora.DATA.dg ONLINE ONLINEjxcw1 ONLINE ONLINEjxcw2 ora.LISTENER.lsnr ONLINE ONLINEjxcw1 ONLINE ONLINEjxcw2 ora.asm ONLINEONLINE jxcw1 Started ONLINE ONLINEjxcw2Started ora.data.jxcwvol.acfs OFFLINE OFFLINE jxcw1 admin unmounted /u0 1/app/grid/acfsmount s/data_jxcwvol OFFLINE OFFLINE jxcw2 admin unmounted /u0 1/app/grid/acfsmount s/data_jxcwvol ora.gsd OFFLINE OFFLINE jxcw1 OFFLINE OFFLINE jxcw2 ora.net1.network ONLINE ONLINEjxcw1 ONLINE ONLINEjxcw2 ora.ons ONLINE ONLINEjxcw1 ONLINE ONLINEjxcw2 ora.registry.acfs ONLINE ONLINEjxcw1 ONLINE ONLINEjxcw2 ------------------------------------------------------------------------------- Cluster Resources ------------------------------------------------------------------------------- ora.LISTENER_SCAN1.lsnr 1ONLINE ONLINE jxcw2 ora.cvu 1ONLINE ONLINE jxcw1 ora.jxcw.db 1ONLINE ONLINE jxcw1 Open 2ONLINE ONLINE jxcw2 Open ora.jxcw1.vip 1ONLINE ONLINE jxcw1 ora.jxcw2.vip 1ONLINE ONLINE jxcw2 ora.oc4j 1ONLINE ONLINE jxcw1 ora.scan1.vip 1ONLINE ONLINE jxcw2 [grid@jxcw1 ~]$ 可以看出图形界面创建的jxcwvol卷,卸载文件系统后,ora.data.jxcwvol.acfs 资源自动offline,卷为umounted状态;testvol关联与ora.registry.acfs资源,该资源状态正常。 (3)、停止ora.registry.acfs资源 [grid@jxcw1 ~]$crsctl stop resource ora.registry.acfs -n jxcw1 CRS-2673: Attemptingto stop 'ora.registry.acfs' on 'jxcw1' CRS-2677: Stop of'ora.registry.acfs' on 'jxcw1' succeeded [grid@jxcw1 ~]$crsctl stop resource ora.registry.acfs -n jxcw2 CRS-2673: Attemptingto stop 'ora.registry.acfs' on 'jxcw2' CRS-2677: Stop of'ora.registry.acfs' on 'jxcw2' succeeded [grid@jxcw1 ~]$crsctl stat res -t ------------------------------------------------------------------------------- NAME TARGET STATESERVERSTATE_DETAILS ------------------------------------------------------------------------------- Local Resources ------------------------------------------------------------------------------- ora.ARCH.dg ONLINE ONLINEjxcw1 ONLINE ONLINEjxcw2 ora.CRS.dg ONLINE ONLINEjxcw1 ONLINE ONLINEjxcw2 ora.DATA.dg ONLINE ONLINEjxcw1 ONLINE ONLINEjxcw2 ora.LISTENER.lsnr ONLINE ONLINEjxcw1 ONLINE ONLINEjxcw2 ora.asm ONLINE ONLINEjxcw1Started ONLINE ONLINEjxcw2 Started ora.data.jxcwvol.acfs OFFLINE OFFLINE jxcw1 admin unmounted /u0 1/app/grid/acfsmount s/data_jxcwvol OFFLINE OFFLINE jxcw2 admin unmounted /u0 1/app/grid/acfsmount s/data_jxcwvol ora.gsd OFFLINE OFFLINE jxcw1 OFFLINE OFFLINE jxcw2 ora.net1.network ONLINE ONLINEjxcw1 ONLINE ONLINEjxcw2 ora.ons ONLINE ONLINEjxcw1 ONLINE ONLINEjxcw2 ora.registry.acfs OFFLINE OFFLINE jxcw1 OFFLINE OFFLINE jxcw2 ------------------------------------------------------------------------------- Cluster Resources ------------------------------------------------------------------------------- ora.LISTENER_SCAN1.lsnr 1ONLINE ONLINE jxcw2 ora.cvu 1ONLINE ONLINE jxcw1 ora.jxcw.db 1ONLINE ONLINE jxcw1 Open 2ONLINE ONLINE jxcw2 Open ora.jxcw1.vip 1ONLINE ONLINE jxcw1 ora.jxcw2.vip 1ONLINE ONLINE jxcw2 ora.oc4j 1ONLINE ONLINE jxcw1 ora.scan1.vip 1ONLINE ONLINE jxcw2 [grid@jxcw1 ~]$ (4)、删除注册信息 仅在一个节点执行 [root@jxcw1 ~]#acfsutil registry -d /u01/app/grid/acfsmounts/data_testvol/ acfsutil registry: successfully removed ACFS mount point/u01/app/grid/acfsmounts/data_testvol from Oracle Registry [root@jxcw1 ~]# 上一步中已ora.data.jxcwvol.acfs资源offline,移除注册信息报错正常。 [root@jxcw1 ~]#acfsutil registry -d /u01/app/grid/acfsmounts/data_jxcwvol/ acfsutil registry:ACFS-03143: The specified mount point does not exist and therefore cannot bedeleted. [root@jxcw1 ~]# (5)、删除ACFS文件系统 仅在一个节点执行删除 [root@jxcw1 ~]#acfsutil rmfs /dev/asm/testvol-347 [root@jxcw1 ~]#acfsutil rmfs /dev/asm/jxcwvol-347 (6)、禁用volume 需要在两节点执行 节点1禁止 [grid@jxcw1 ~]$asmcmd ASMCMD>voldisable -G data testvol ASMCMD>voldisable -G data jxcwvol ASMCMD> 节点2禁止 [grid@jxcw2 ~]$asmcmd ASMCMD>voldisable -G data testvol ASMCMD> voldisable-G data jxcwvol ASMCMD> exit [grid@jxcw2 ~]$ (7)、删除卷 仅在一个节点执行。 [grid@jxcw1 ~]$asmcmd ASMCMD> ls ASMCMD> voldelete-G data testvol ASMCMD> voldelete-G data jxcwvol (8)、删除资源对象 [root@jxcw1~]#/u01/app/11.2.0/grid/bin/srvctl remove filesystem-d /dev/asm/jxcwvol-347 [grid@jxcw1 ~]$ crsctl stat res -t --------------------------------------------------------------------- NAMETARGET STATE SERVER STATE_DETAILS --------------------------------------------------------------------- Local Resources ora.ARCH.dg ONLINE ONLINE jxcw1 ONLINE ONLINE jxcw2 ora.CRS.dg ONLINE ONLINEjxcw1 ONLINE ONLINE jxcw2 ora.DATA.dg ONLINE ONLINE jxcw1 ONLINE ONLINEjxcw2 ora.LISTENER.lsnr ONLINE ONLINE jxcw1 ONLINE ONLINE jxcw2 ora.asm ONLINE ONLINE jxcw1 Started ONLINE ONLINE jxcw2 Started ora.gsd OFFLINE OFFLINE jxcw1 OFFLINE OFFLINE jxcw2 ora.net1.network ONLINE ONLINE jxcw1 ONLINE ONLINE jxcw2 ora.ons ONLINE ONLINE jxcw1 ONLINE ONLINE jxcw2 ora.registry.acfs ONLINE ONLINE jxcw1 ONLINE ONLINE jxcw2 ---------------------------------------------------------------------ClusterResources --------------------------------------------------------------------- ora.LISTENER_SCAN1.lsnr 1 ONLINEONLINE jxcw2 ora.cvu 1 ONLINEONLINE jxcw2 ora.jxcw.db 1 ONLINEONLINE jxcw1 Open 2 ONLINEONLINE jxcw2 Open ora.jxcw1.vip 1 ONLINEONLINE jxcw1 ora.jxcw2.vip 1 ONLINEONLINE jxcw2 ora.oc4j 1 ONLINEONLINE jxcw2 ora.scan1.vip 1 ONLINEONLINE jxcw2 [grid@jxcw1 ~]$ (编辑:莱芜站长网) 【声明】本站内容均来自网络,其相关言论仅代表作者个人观点,不代表本站立场。若无意侵犯到您的权利,请及时与联系站长删除相关内容! |