合 RAC: Frequently Asked Questions (RAC FAQ) (Doc ID 220970.1)
- QUESTIONS AND ANSWERS
- RAC - Real Application Clusters
- RAC
- RAC One Node
- QoS - Quality of Servce Management
- Clusterware
- Autonomous Computing
- Rapid Home Provisioning
- Answers
- How do I measure the bandwidth utilization of my NIC or my interconnect?
- How can I validate the scalability of my shared storage? (Tightly related to RAC / Application scalability)
- Is Oracle RAC supported on logical partitions (i.e. LPARs) or other virtualization technologies?
- How should voting disks be implemented in an extended cluster environment?
- What are the cdmp directories in the background_dump_dest used for?
- How do I gather all relevant Oracle and OS log/trace files in an Oracle RAC cluster to provide to Support?
- How should one review the ability to scale out to more nodes in your cluster?
- Can I ignore 10.2 CLUVFY on Solaris warning about failed package existence checks?
- What is a CVU component?
- Why cluvfy reports "unknown" on a particular node?
- What are the requirements for CVU?
- What about discovery? Does CVU discover installed components?
- How do I check Oracle RAC certification?
- Is Veritas Storage Foundation supported with Oracle RAC?
- Can I use ASM as mechanism to mirror the data in an Extended RAC cluster?
- What are the changes in memory requirements from moving from single instance to RAC?
- What are the default values for the command line arguments?
- Do I have to be root to use CVU?
- What is nodelist?
- How do I check minimal system requirements on the nodes?
- How do I get detail output of a check?
- Why the peer comparison with -refnode says passed when the group or user does not exist?
- At what point cluvfy is usable? Can I use cluvfy before installing Oracle Clusterware?
- Is there a way to compare nodes?
- What is a stage?
- How do I know about cluvfy commands? The usage text of cluvfy does not show individual commands.
- Can I check if the storage is shared among the nodes?
- Does Database blocksize or tablespace blocksize affect how the data is passed across the interconnect?
- What is Oracle's position with respect to supporting RAC on Polyserve CFS?
- How do I check network or node connectivity related issues?
- What is CVU? What are its objectives and features?
- Is there a cluster file system (CFS) Available for Linux?
- Is OCFS2 certified with Oracle RAC 10g?
- How do I check the Oracle Clusterware stack and other sub-components of it?
- Where can I find the CVU trace files?
- Can I use Oracle Clusterware for failover of the SAP Enqueue and VIP services when running SAP in a RAC environment?
- How do I turn on tracing?
- How do I check whether OCFS is properly configured?
- My customer is about to install 10202 clusterware on new Linux machines. He is getting "No ORACM running" error when run rootpre.sh and exited? Should he worry about this message?
- Can different releases of Oracle RAC be installed and run on the same physical Linux cluster?
- Oracle Clusterware fails to start after a reboot due to permissions on raw devices reverting to default values. How do I fix this?
- Customer did not load the hangcheck-timer before installing RAC, Can the customer just load the hangcheck-timer ?
- After installing patchset 9013 and patch_2313680 on Linux, the startup was very slow
- Is there a way to verify that the Oracle Clusterware is working properly before proceeding with RAC install?
- How do I configure my RAC Cluster to use the RDS Infiniband?
- Why is validateUserEquiv failing during install (or cluvfy run)?
- What is Runtime Connection Load Balancing?
- How do I enable the load balancing advisory?
- What are the network requirements for an extended RAC cluster?
- What is the maximum distance between nodes in an extended RAC environment?
- Are crossover cables supported as an interconnect with Oracle RAC on any platform?
- What do I do if I see GC CR BLOCK LOST in my top 5 Timed Events in my AWR Report?
- Will adding a new instance to my Oracle RAC database (new node to the cluster) allow me to scale the workload?
- Are Red Hat GFS and GULM certified for DLM?
- How do I configure raw devices in order to install Oracle Clusterware 10g on RHEL5 or OEL5?
- Is Server Side Load Balancing supported/recommended/proven technology in Oracle EBusiness Suite?
- How do I change my Veritas SF RAC installation to use UDP instead of LLT?
- How to reorder or rename logical network interface (NIC) names in Linux
- How does UDP over Infiniband compare to UDP over Gigabit Ethernet when used for the RAC interconnect?
- Is the hangcheck timer still needed with Oracle RAC 10g and 11gR1?
- Can I have different servers in my Oracle RAC? Can they be from different vendors? Can they be of different sizes?
- How many nodes can one have in an HP-UX/Solaris/AIX/Windows/Linux cluster?
- Are 3rd party cluster solutions supported on Linux?
- How many nodes are supported or can be used in an Oracle RAC Database?
- What are my options for setting the Load Balancing Advisory GOAL on a Service?
- Is Oracle Database on VMware support? Is Oracle RAC on VMware supported?
- What is 'cvuqdisk' rpm? Why should I install this rpm?
- What is the Load Balancing Advisory?
- A customer installed 10g Release 2 on Linux RH4 Update 2, 2.6.9-22.ELsmp #1 SMP x86_64 GNU/Linux, and got the error Error in invoking target 'all_no_orcl'. Customer ignored the error and the install succeeded without any other errors and oracle apparently worked fine. What should they do?
- Are Oracle Applications certified with RAC?
- Do I have to type the nodelist every time for the CVU commands? Is there any shortcut?
- How do I check user accounts and administrative permissions related issues?
- How to configure bonding on Suse SLES9.
- How to configure bonding on Suse SLES8.
- How to configure concurrent manager in a RAC environment?
- What is the optimal migration path to be used while migrating the E-Business suite to Oracle RAC?
- Can I use TAF with e-Business in a RAC environment?
- Can I use Automatic Undo Management with Oracle Applications?
- Which e-Business version is prefereable?
- Should functional partitioning be used with Oracle Applications?
- Is the Oracle E-Business Suite (Oracle Applications) certified against RAC?
- I am seeing the wait events 'ges remote message', 'gcs remote message', and/or 'gcs for action'. What should I do about these?
- Do I need to relink the Oracle Clusterware / Grid Infrastructure home after an OS upgrade?
- How can I configure database instances to run on 12.1.0.1 Oracle Flex Cluster Leaf nodes?
- When configuring the NIC cards and switch for a GigE Interconnect should it be set to FULL or Half duplex in Oracle RAC?
- How can a NAS storage vendor certify their storage solution for Oracle RAC ?
- Is Infiniband supported for the Oracle RAC interconnect?
- What kind of HW components do you recommend for the interconnect?
- Where can I find a list of supported solutions to ensure NIC availability / redundancy (for the interconnect) per platform?
- What is Cache Fusion and how does this affect applications?
- Can I run more than one clustered database on a single Oracle RAC cluster?
- What are the restrictions on the SID with an Oracle RAC database? Is it limited to 5 characters?
- Is it supported to install Oracle Clusterware and Oracle RAC as different users?
- Is it difficult to transition (migrate) from Single Instance to Oracle RAC?
- Is rcp and/or rsh required for normal Oracle RAC operation ?
- Does Oracle Clusterware or Oracle Real Application Clusters support heterogeneous platforms?
- What are the dependencies between OCFS and ASM in Oracle Database 10g ?
- Why does the NOAC attribute need to be set on NFS mounted RAC Binaries?
- My customer has an XA Application with a Oracle RAC Database, can I do Load Balancing across the Oracle RAC instances?
- What would you recommend to customer, Oracle Clusterware or Vendor Clusterware (I.E. HP Service Guard, HACMP, Sun Cluster, Veritas etc.) with Oracle Real Application Clusters?
- Do we have to have Oracle Database on all nodes?
- What software is necessary for Oracle RAC? Does it have a separate installation CD to order?
- I have changed my spfile with alter system set parameter_name =.... scope=spfile. The spfile is on ASM storage and the database will not start.
- How to use VLANs for Oracle RAC and the Oracle Clusterware Interconnect?
- What storage is supported with Standard Edition Oracle RAC?
- Can I use Oracle RAC in a distributed transaction processing environment?
- Does changing uid or gid of the Oracle User affect Oracle Clusterware?
- Can I use iSCSI storage with my Oracle RAC cluster?
- Can we designate the place of archive logs on both ASM disk and regular file system, when we use SE RAC?
- Is it a good idea to add anti-virus software to my RAC cluster?
- I want to use rconfig to convert a single instance to Oracle RAC but I am using raw devices in Oracle RAC. Does rconfig support RAW ?
- What combinations of Oracle Clusterware, Oracle RAC and ASM versions can I use?
- I had a 3 node Oracle RAC. One of the nodes had to be completely rebuilt as a result of a problem. As there are no backups, What is the proper procedure to remove the 3rd node from the cluster so it can be added back in?
- Can we output the backupset onto regular file system directly (not onto flash recovery area) using RMAN command, when we use SE RAC?
- How do I check for network problems on my interconect?
- How many NICs do I need to implement Oracle RAC?
- Are there any issues for the interconnect when sharing the same switch as the public network by using VLAN to separate the network?
- I could not get the user equivalence check to work on my Solaris 10 server when trying to install 10.2.0.1 Oracle Clusterware. The install ran fine without issue. << Message: Result: User equivalence check failed for user "oracle". >>
- Why does netca always creates the listener which listens to public ip and not VIP only?
- Can my customer use Veritas Agents to manage their Oracle RAC database on Unix with SFRAC installed?
- The Veritas installation document on page 219 asks for setting LD_LIBRARY_PATH_64. Should I remove this?
- Can I run Oracle RAC 10g with Oracle RAC 11g?
- Are Sun Logical Domains (ldoms) supported with RAC?
- What Application Design considerations should I be aware of when moving to Oracle RAC?
- Should the SCSI-3 reservation bit be set for our Oracle Clusterware only installation?
- We are using Transparent Data Encryption (TDE). We create a wallet on node 1 and copy to nodes 2 & 3. Open the wallet and we are able to select encrypted data on all three nodes. Now, we want to REKEY the MASTER KEY. What do we have to do?
- I have the 11.2 Grid Infrastructure installed and now I want to install an earlier version of Oracle Database (11.1 or 10.2), is this supported ?
- I get an error with DBCA from 10.2 or 11.1 after I have installed the 11.2 Grid Infrastructure?
- What is Standard Edition Oracle RAC?
- Are jumbo frames supported for the RAC interconnect?
- What is SCAN?
- How do I determine which node in the cluster is the "Master" node?
- Can I have multiple public networks accessing my Oracle RAC?
- Where do I find Oracle Clusterware binaries and ASM binaries with Oracle Database 11g Release 2?
- Can I run Oracle 9i RAC and Oracle RAC 10g in the same cluster?
- If my OCR and Voting Disks are in ASM, can I shutdown the ASM instance?
- Does Oracle support Oracle RAC in Solaris containers (a.k.a. Solaris Zones)?
- Are block devices supported for OCR, Voting Disks, and ASM devices?
- Is there a need to renice LMS processes in Oracle RAC 10g Release 2?
- I get the following error starting my Oracle RAC database, what do I do? WARNING: No cluster interconnect has been specified.
- How is Oracle RAC One Node licensed and priced?
- How does RAC One Node compare with traditional cold fail over solutions ?
- If I add or remove nodes from the cluster, how do I inform RAC One Node?
- How do I install the command line tools for RAC One Node?
- How do I get Oracle Real Application Clusters One Node (Oracle RAC One Node)?
- Is Oracle RAC One Node supported with 3rd party clusterware and/or 3rd party CFS?
- If a current customer has an Enterprise License Agreement (ELA), are they entitled to use Oracle RAC One Node?
- Does Enterprise Manager Support RAC One Node?
- How does RAC One Node compare with a single instance Oracle Database protected with Oracle Clusterware?
- How does RAC One Node compare with database DR products like Data Guard or Golden Gate?
- Are we certifying applications specifically for RAC One Node?
- How does RAC One Node compare with virtualization solutions like VMware?
- Does Rac One Node make sense in a stretch cluster environment?
- Where do I find the documentation for RAC One Node?
- Is RAC One Node supported with database versions prior to 11.2?
- What is RAC One Node Omotion?
- Can I use Oracle RAC One Node for Standard Edition Oracle RAC?
- What is Oracle Real Application Clusters One Node (RAC One Node)?
- Does QoS Management support admin-managed databases?
- What are the different modes of QoS Management's operation?
- What is Memory Guard and how does it work?
- Does QoS Management require any specific database deployment?
- Does QoS Management Support Multitenant databases and PDBs?
- What type of applications does Oracle QoS Management manage?
- What QoS Management functionality is in Oracle Enterprise Manager?
- What are Server Pools?
- What methods does QoS Management support for classifying applications and workloads?
- What type of user interfaces does QoS Management support?
- Does QoS Management negatively affect an application’s availability?
- How does QoS Management enable the Private Database Cloud?
- Where can I find documentation for QoS Management?
- What is the overhead of using QoS Management?
- Which type of consolidation does QoS Management support?
- What types of resources does QoS Management manage?
- Is this a product to be used by an IT administrator or DBA?
- What does QoS Management manage?
- What is Oracle’s goal in developing QoS Management?
- What happens should the QoS Management Server fail?
- Which versions of Oracle databases does QoS Management support?
- What types of performance objectives can be set?
- How do I use DBCA in silent mode to set up RAC and ASM?
- Is it supported to rerun root.sh from the Oracle Clusterware installation ?
- Can I configure a firewall (iptables) on the cluster interconnect?
- Can I run the fixup script generated by the 11.2 OUI or CVU on a running system?
- How is the Oracle Cluster Registry (OCR) stored when I use ASM?
- Is it possible to use ASM for the OCR and voting disk?
- Do I need to have user equivalence (ssh, etc...) set up after GRID/RAC is already installed?
- Why does Oracle Clusterware use an additional 'heartbeat' via the voting disk, when other cluster software products do not?
- Why does Oracle still use the voting disks when other cluster software is present?
- How much I/O activity should the voting disk have?
- I am trying to move my voting disks from one diskgroup to another and getting the error "crsctl replace votedisk – not permitted between ASM Disk Groups." Why?
- I have a 2 node Oracle RAC cluster, if I pull the interconnect on node 1 to simulate a failure, why does node 2 reboot?
- OCR stored in ASM - What happens, if my ASM instance fails on a node?
- With GNS, do ALL public addresses have to be DHCP managed (public IP, public VIP, public SCAN VIP)?
- Voting Files stored in ASM - How many disks per disk group do I need?
- What happens if I lose my voting disk(s)?
- How should I test the failure of the public network (IE Oracle VIP failover) in my Oracle RAC environment?
- What do I do, I have a corrupt OCR and no valid backup?
- I am installing Oracle Clusterware with a 3rd party vendor clusterware however in the "Specify Cluster Configuration Page" , Oracle Clusterware installer doesn't show the existing nodes. Why?
- I have a 2-node RAC running. I notice that it is always node2 that is evicted when I test private network failure scenario by disconnecting the private network cable. Doesn't matter whether it is node1's or node2's private network cable that is disconnected, it is always the node2 that is evicted. What happens in a 3-nodes RAC cluster if node1's cable is disconnected?
- How do I use multiple network interfaces to provide High Availability and/or Load Balancing for my interconnect with Oracle Clusterware?
- What are the licensing rules for Oracle Clusterware? Can I run it without RAC?
- What is Flex Cluster and how can I use it?
- How do I identify the voting file location ?
- Can I use Oracle Clusterware to monitor my EM Agent?
- Does Oracle Clusterware have to be the same or higher release than all instances running on the cluster?
- My customer has noticed tons of log files generated under $CRS_HOME/log//client, is there any way automated way we can setup through Oracle Clusterware to prevent/minimize/remove those aggressively generated files?
- Customer is hitting Bug 4462367 with an error message saying low open file descriptor, how do I work around this until the fix is released with the Oracle Clusterware Bundle for 10.2.0.3 or 10.2.0.4 is released?
- What is the voting disk used for?
- I am trying to install Oracle Clusterware (10.2) and when I run the OUI, at the Specify Cluster Configuration screen, the Add, Edit and Remove buttons are grayed out. Nothing comes up in the cluster nodes either. Why?
- Can I use Oracle Clusterware to provide cold failover of my single instance Oracle Databases?
- How do I protect the OCR and Voting in case of media failure?
- How can I register the listener with Oracle Clusterware in RAC 10g Release 2?
- Why is the home for Oracle Clusterware / Oracle Grid Infrastructure not recommended to be a subdirectory of the Oracle base directory?
- In the course of failure testing in an extended RAC environment we find entries in the cssd logfile which indicate actions like 'diskShortTimeout set to (value)' and 'diskLongTimeout set to (value)'. Can anyone please explain the meaning of these two timeouts in addition to disktimeout?
- How do I put my application under the control of Oracle Clusterware to achieve higher availability?
- Is it supported to allow 3rd Party Clusterware to manage Oracle resources (instances, listeners, etc) and turn off Oracle Clusterware management of these?
- Does Oracle Clusterware support application vips?
- Can the Network Interface Card (NIC) device names be different on the nodes in a cluster, for both public and private?
- What is the High Availability API?
- What are the IP requirements for the private interconnect?
- Can I set up failover of the VIP to another card in the same machine or what do I do if I have different network interfaces on different nodes in my cluster (I.E. eth0 on node1,2 and eth1 on node 3,4)?
- How is the voting disk used by Oracle Clusterware?
- When ct run the command 'onsctl start' receives the message "Unable to open libhasgen10.so". Any idea why the message "unable to open libhasgen10.so" ?
- I made a mistake when I created the VIP during the install of Oracle Clusterware, can I change the VIP?
- Does the hostname have to match the public name or can it be anything else?
- Which processes access the OCR ?
- When does the Oracle node VIP fail over to another node and subsequently return to its home node?
- Can I change the name of my cluster after I have created it when I am using Oracle Clusterware?
- What should the permissions be set to for the voting disk and ocr when doing an Oracle RAC Install?
- How do I restore OCR from a backup? On Windows, can I use ocopy?
- With Oracle Clusterware 10g, how do you backup the OCR?
- How to Restore a Lost Voting Disk used by Oracle Clusterware 10g
- Is it a requirement to have the public interface linked to ETH0 or does it only need to be on a ETH lower than the private interface?: - public on ETH1 - private on ETH2
- How to move the OCR location ?
- Can I run a 10.1.0.x database with Oracle Clusterware 10.2 ?
- Is there any example to query mgmtdb directly to get information about performance issues on cluster?
- Is moving the GIMR to a different diskgroup a best practice?
- How to specify the new diskgroup for the MGMTDB during the installation GUI?
- If GIMR is already discovered and managed in EMCC, the recommendation is to remove that from EM Cloud Control Managed Target List?
- If GIMR is not coming up due to some problems, will cluster restart or cluster will not come up till GIMR is up and available as part of CRS restart?
- How to configure interval of data write to mgmtdb?
- What does it mean that the node listener will go away from the current GIMR topology in the upcoming releases?
- How to remove GIMR database if it needs to be replaced?
- Can the data files of GIMR database be placed in any other disk group apart from its default one?
- While using mdbutil.pl with options - add and db, it will recreate the GIMR database. So should the GIMR database be deleted before issuing this command?
- How do I cd into the GIMR's trace or log directory?
- If EMCC is not supposed to monitor it, why is it discovered as a target ?
- How much shared disk space does the GIMR installation require?
- Does the GIMR get configured in a Oracle Restart single server install?
- Do I need to regularly backup the GIMR?
- Will I lose my GIMR data when upgrading or applying a patch?
- Do I need to separately patch the GIMR?
- Why does the GIMR use hugepages?
- Will I lose my cluster or database availability should the GIMR go down?
- Can I disable the GIMR?
- Who are the clients of GIMR?
- Why was GIMR implemented ?
- What is Grid Infrastructure Management Repository (GIMR) ?
- Is RHP supported on Exadata?
- Does the RHP Server need to be running the same OS as the targets it manages?
- How is Rapid Home Provisioning licensed?
- REFERENCES
QUESTIONS AND ANSWERS
RAC - Real Application Clusters
- How do I measure the bandwidth utilization of my NIC or my interconnect?
- How can I validate the scalability of my shared storage? (Tightly related to RAC / Application scalability)
- Is Oracle RAC supported on logical partitions (i.e. LPARs) or other virtualization technologies?
- How should voting disks be implemented in an extended cluster environment?
- What are the cdmp directories in the background_dump_dest used for?
- How do I gather all relevant Oracle and OS log/trace files in an Oracle RAC cluster to provide to Support?
- How should one review the ability to scale out to more nodes in your cluster?
- Can I ignore 10.2 CLUVFY on Solaris warning about failed package existence checks?
- What is a CVU component?
- Why cluvfy reports "unknown" on a particular node?
- What are the requirements for CVU?
- What about discovery? Does CVU discover installed components?
- How do I check Oracle RAC certification?
- Is Veritas Storage Foundation supported with Oracle RAC?
- Can I use ASM as mechanism to mirror the data in an Extended RAC cluster?
- What are the changes in memory requirements from moving from single instance to RAC?
- What are the default values for the command line arguments?
- Do I have to be root to use CVU?
- What is nodelist?
- How do I check minimal system requirements on the nodes?
- How do I get detail output of a check?
- Why the peer comparison with -refnode says passed when the group or user does not exist?
- At what point cluvfy is usable? Can I use cluvfy before installing Oracle Clusterware?
- Is there a way to compare nodes?
- What is a stage?
- How do I know about cluvfy commands? The usage text of cluvfy does not show individual commands.
- Can I check if the storage is shared among the nodes?
- Does Database blocksize or tablespace blocksize affect how the data is passed across the interconnect?
- What is Oracle's position with respect to supporting RAC on Polyserve CFS?
- How do I check network or node connectivity related issues?
- What is CVU? What are its objectives and features?
- Is there a cluster file system (CFS) Available for Linux?
- Is OCFS2 certified with Oracle RAC 10g?
- How do I check the Oracle Clusterware stack and other sub-components of it?
- Where can I find the CVU trace files?
- Can I use Oracle Clusterware for failover of the SAP Enqueue and VIP services when running SAP in a RAC environment?
- How do I turn on tracing?
- How do I check whether OCFS is properly configured?
- My customer is about to install 10202 clusterwere on new Linux machinges. He is getting "No ORACM running" error when run rootpre.sh and exited? Should he worry about this message?
- Can different releases of Oracle RAC be installed and run on the same physical Linux cluster?
- Oracle Clusterware fails to start after a reboot due to permissions on raw devices reverting to default values. How do I fix this?
- Customer did not load the hangcheck-timer before installing RAC, Can the customer just load the hangcheck-timer ?
- After installing patchset 9013 and patch_2313680 on Linux, the startup was very slow
- Is there a way to verify that the Oracle Clusterware is working properly before proceeding with RAC install?
- How do I configure my RAC Cluster to use the RDS Infiniband?
- Why is validateUserEquiv failing during install (or cluvfy run)?
- What is Runtime Connection Load Balancing?
- How do I enable the load balancing advisory?
- What are the network requirements for an extended RAC cluster?
- What is the maximum distance between nodes in an extended RAC environment?
- Are crossover cables supported as an interconnect with Oracle RAC on any platform?
- What do I do if I see GC CR BLOCK LOST in my top 5 Timed Events in my AWR Report?
- Will adding a new instance to my Oracle RAC database (new node to the cluster) allow me to scale the workload?
- Are Red Hat GFS and GULM certified for DLM?
- How do I configure raw devices in order to install Oracle Clusterware 10g on RHEL5 or OEL5?
- Is Server Side Load Balancing supported/recommended/proven technology in Oracle EBusiness Suite?
- How do I change my Veritas SF RAC installation to use UDP instead of LLT?
- How to reorder or rename logical network interface (NIC) names in Linux
- How does UDP over Infiniband compare to UDP over Gigabit Ethernet when used for the RAC interconnect?
- Is the hangcheck timer still needed with Oracle RAC 10g and 11gR1?
- Can I have different servers in my Oracle RAC? Can they be from different vendors? Can they be of different sizes?
- How many nodes can one have in an HP-UX/Solaris/AIX/Windows/Linux cluster?
- Are 3rd party cluster solutions supported on Linux?
- How many nodes are supported or can be used in an Oracle RAC Database?
- What are my options for setting the Load Balancing Advisory GOAL on a Service?
- Is Oracle Database on VMware support? Is Oracle RAC on VMware supported?
- What is 'cvuqdisk' rpm? Why should I install this rpm?
- What is the Load Balancing Advisory?
- A customer installed 10g Release 2 on Linux RH4 Update 2, 2.6.9-22.ELsmp #1 SMP x86_64 GNU/Linux, and got the error Error in invoking target 'all_no_orcl'. Customer ignored the error and the install succeeded without any other errors and oracle apparently worked fine. What should they do?
- Are Oracle Applications certified with RAC?
- Do I have to type the nodelist every time for the CVU commands? Is there any shortcut?
- How do I check user accounts and administrative permissions related issues?
- How to configure bonding on Suse SLES9.
- How to configure bonding on Suse SLES8.
- How to configure concurrent manager in a RAC environment?
- What is the optimal migration path to be used while migrating the E-Business suite to Oracle RAC?
- Can I use TAF with e-Business in a RAC environment?
- Can I use Automatic Undo Management with Oracle Applications?
- Which e-Business version is prefereable?
- Should functional partitioning be used with Oracle Applications?
- Is the Oracle E-Business Suite (Oracle Applications) certified against RAC?
- I am seeing the wait events 'ges remote message', 'gcs remote message', and/or 'gcs for action'. What should I do about these?
RAC
- Do I need to relink the Oracle Clusterware / Grid Infrastructure home after an OS upgrade?
- How can I configure database instances to run on 12.1.0.1 Oracle Flex Cluster Leaf nodes?
- When configuring the NIC cards and switch for a GigE Interconnect should it be set to FULL or Half duplex in Oracle RAC?
- How can a NAS storage vendor certify their storage solution for Oracle RAC ?
- Is Infiniband supported for the Oracle RAC interconnect?
- What kind of HW components do you recommend for the interconnect?
- Where can I find a list of supported solutions to ensure NIC availability / redundancy (for the interconnect) per platform?
- What is Cache Fusion and how does this affect applications?
- Can I run more than one clustered database on a single Oracle RAC cluster?
- What are the restrictions on the SID with an Oracle RAC database? Is it limited to 5 characters?
- Is it supported to install Oracle Clusterware and Oracle RAC as different users?
- Is it difficult to transition (migrate) from Single Instance to Oracle RAC?
- Is rcp and/or rsh required for normal Oracle RAC operation ?
- Does Oracle Clusterware or Oracle Real Application Clusters support heterogeneous platforms?
- What are the dependencies between OCFS and ASM in Oracle Database 10g ?
- Why does the NOAC attribute need to be set on NFS mounted RAC Binaries?
- My customer has an XA Application with a Oracle RAC Database, can I do Load Balancing across the Oracle RAC instances?
- What would you recommend to customer, Oracle Clusterware or Vendor Clusterware (I.E. HP Service Guard, HACMP, Sun Cluster, Veritas etc.) with Oracle Real Application Clusters?
- Do we have to have Oracle Database on all nodes?
- What software is necessary for Oracle RAC? Does it have a separate installation CD to order?
- I have changed my spfile with alter system set parameter_name =.... scope=spfile. The spfile is on ASM storage and the database will not start.
- How to use VLANs for Oracle RAC and the Oracle Clusterware Interconnect?
- What storage is supported with Standard Edition Oracle RAC?
- Can I use Oracle RAC in a distributed transaction processing environment?
- Does changing uid or gid of the Oracle User affect Oracle Clusterware?
- Can I use iSCSI storage with my Oracle RAC cluster?
- Can we designate the place of archive logs on both ASM disk and regular file system, when we use SE RAC?
- Is it a good idea to add anti-virus software to my RAC cluster?
- I want to use rconfig to convert a single instance to Oracle RAC but I am using raw devices in Oracle RAC. Does rconfig support RAW ?
- What combinations of Oracle Clusterware, Oracle RAC and ASM versions can I use?
- I had a 3 node Oracle RAC. One of the nodes had to be completely rebuilt as a result of a problem. As there are no backups, What is the proper procedure to remove the 3rd node from the cluster so it can be added back in?
- Can we output the backupset onto regular file system directly (not onto flash recovery area) using RMAN command, when we use SE RAC?
- How do I check for network problems on my interconect?
- How many NICs do I need to implement Oracle RAC?
- Are there any issues for the interconnect when sharing the same switch as the public network by using VLAN to separate the network?
- I could not get the user equivalence check to work on my Solaris 10 server when trying to install 10.2.0.1 Oracle Clusterware. The install ran fine without issue. << Message: Result: User equivalence check failed for user "oracle". >>
- Why does netca always creates the listener which listens to public ip and not VIP only?
- Can my customer use Veritas Agents to manage their Oracle RAC database on Unix with SFRAC installed?
- The Veritas installation document on page 219 asks for setting LD_LIBRARY_PATH_64. Should I remove this?
- Can I run Oracle RAC 10g with Oracle RAC 11g?
- Are Sun Logical Domains (ldoms) supported with RAC?
- What Application Design considerations should I be aware of when moving to Oracle RAC?
- Should the SCSI-3 reservation bit be set for our Oracle Clusterware only installation?
- We are using Transparent Data Encryption (TDE). We create a wallet on node 1 and copy to nodes 2 & 3. Open the wallet and we are able to select encrypted data on all three nodes.
Now, we want to REKEY the MASTER KEY. What do we have to do? - I have the 11.2 Grid Infrastructure installed and now I want to install an earlier version of Oracle Database (11.1 or 10.2), is this supported ?
- I get an error with DBCA from 10.2 or 11.1 after I have installed the 11.2 Grid Infrastructure?
- What is Standard Edition Oracle RAC?
- Are jumbo frames supported for the RAC interconnect?
- What is SCAN?
- How do I determine which node in the cluster is the "Master" node?
- Can I have multiple public networks accessing my Oracle RAC?
- Where do I find Oracle Clusterware binaries and ASM binaries with Oracle Database 11g Release 2?
- Can I run Oracle 9i RAC and Oracle RAC 10g in the same cluster?
- If my OCR and Voting Disks are in ASM, can I shutdown the ASM instance?
- Does Oracle support Oracle RAC in Solaris containers (a.k.a. Solaris Zones)?
- Are block devices supported for OCR, Voting Disks, and ASM devices?
- Is there a need to renice LMS processes in Oracle RAC 10g Release 2?
- I get the following error starting my Oracle RAC database, what do I do?
WARNING: No cluster interconnect has been specified.
RAC One Node
- How is Oracle RAC One Node licensed and priced?
- How does RAC One Node compare with traditional cold fail over solutions ?
- If I add or remove nodes from the cluster, how do I inform RAC One Node?
- How do I install the command line tools for RAC One Node?
- How do I get Oracle Real Application Clusters One Node (Oracle RAC One Node)?
- Is Oracle RAC One Node supported with 3rd party clusterware and/or 3rd party CFS?
- If a current customer has an Enterprise License Agreement (ELA), are they entitled to use Oracle RAC One Node?
- Does Enterprise Manager Support RAC One Node?
- How does RAC One Node compare with a single instance Oracle Database protected with Oracle Clusterware?
- How does RAC One Node compare with database DR products like DataGuard or Golden Gate?
- Are we certifying applications specifically for RAC One Node?
- How does RAC One Node compare with virtualization solutions like VMware?
- Does Rac One Node make sense in a stretch cluster environment?
- Where do I find the documentation for RAC One Node?
- Is RAC One Node supported with database versions prior to 11.2?
- What is RAC One Node Omotion?
- Can I use Oracle RAC One Node for Standard Edition Oracle RAC?
- What is Oracle Real Application Clusters One Node (RAC One Node)?
QoS - Quality of Servce Management
- Does QoS Management support admin-managed databases?
- What are the different modes of QoS Management's operation?
- What is Memory Guard and how does it work?
- Does QoS Management require any specific database deployment?
- Does QoS Management Support Multitenant databases and PDBs?
- What type of applications does Oracle QoS Management manage?
- What QoS Management functionality is in Oracle Enterprise Manager?
- What are Server Pools?
- What methods does QoS Management support for classifying applications and workloads?
- What type of user interfaces does QoS Management support?
- Does QoS Management negatively affect an application’s availability?
- How does QoS Management enable the Private Database Cloud?
- Where can I find documentation for QoS Management?
- What is the overhead of using QoS Management?
- Which type of consolidation does QoS Management support?
- What types of resources does QoS Management manage?
- Is this a product to be used by an IT administrator or DBA?
- What does QoS Management manage?
- What is Oracle’s goal in developing QoS Management?
- What happens should the QoS Management Server fail?
- Which versions of Oracle databases does QoS Management support?
- What types of performance objectives can be set?
- How do I use DBCA in silent mode to set up RAC and ASM?
Clusterware
- Is it supported to rerun root.sh from the Oracle Clusterware installation ?
- Can I configure a firewall (iptables) on the cluster interconnect?
- Can I run the fixup script generated by the 11.2 OUI or CVU on a running system?
- How is the Oracle Cluster Registry (OCR) stored when I use ASM?
- Is it possible to use ASM for the OCR and voting disk?
- Do I need to have user equivalence (ssh, etc...) set up after GRID/RAC is already installed?
- Why does Oracle Clusterware use an additional 'heartbeat' via the voting disk, when other cluster software products do not?
- Why does Oracle still use the voting disks when other cluster sofware is present?
- How much I/O activity should the voting disk have?
- I am trying to move my voting disks from one diskgroup to another and getting the error "crsctl replace votedisk – not permitted between ASM Disk Groups." Why?
- I have a 2 node Oracle RAC cluster, if I pull the interconnect on node 1 to simulate a failure, why does node 2 reboot?
- OCR stored in ASM - What happens, if my ASM instance fails on a node?
- With GNS, do ALL public addresses have to be DHCP managed (public IP, public VIP, public SCAN VIP)?
- Voting Files stored in ASM - How many disks per disk group do I need?
- What happens if I lose my voting disk(s)?
- How should I test the failure of the public network (IE Oracle VIP failover) in my Oracle RAC environment?
- What do I do, I have a corrupt OCR and no valid backup?
- I am installing Oracle Clusterware with a 3rd party vendor clusterware however in the "Specify Cluster Configuration Page" , Oracle Clusterware installer doesn't show the existing nodes. Why?
- I have a 2-node RAC running. I notice that it is always node2 that is evicted when I test private network failure scenario by disconnecting the private network cable. Doesn't matter whether it is node1's or node2's private network cable that is disconnected, it is always the node2 that is evicted. What happens in a 3-nodes RAC cluster if node1's cable is disconnected?
- How do I use multiple network interfaces to provide High Availability and/or Load Balancing for my interconnect with Oracle Clusterware?
- What are the licensing rules for Oracle Clusterware? Can I run it without RAC?
- What is Flex Cluster and how can I use it?
- How do I identify the voting file location ?
- Can I use Oracle Clusterware to monitor my EM Agent?
- Does Oracle Clusterware have to be the same or higher release than all instances running on the cluster?
- My customer has noticed tons of log files generated under $CRS_HOME/log//client, is there any way automated way we can setup through Oracle Clusterware to prevent/minimize/remove those aggressively generated files?
- Customer is hitting bug 4462367 with an error message saying low open file descriptor, how do I work around this until the fix is released with the Oracle Clusterware Bundle for 10.2.0.3 or 10.2.0.4 is released?
- What is the voting disk used for?
- I am trying to install Oracle Clusterware (10.2) and when I run the OUI, at the Specify Cluster Configuration screen, the Add, Edit and Remove buttons are grayed out. Nothing comes up in the cluster nodes either. Why?
- Can I use Oracle Clusterware to provide cold failover of my single instance Oracle Databases?
- How do I protect the OCR and Voting in case of media failure?
- How can I register the listener with Oracle Clusterware in RAC 10g Release 2?
- Why is the home for Oracle Clusterware / Oracle Grid Infrastructure not recommended to be a subdirectory of the Oracle base directory?
- In the course of failure testing in an extended RAC environment we find entries in the cssd logfile which indicate actions like 'diskShortTimeout set to (value)' and 'diskLongTimeout set to (value)'.
Can anyone please explain the meaning of these two timeouts in addition to disktimeout? - How do I put my application under the control of Oracle Clusterware to achieve higher availability?
- Is it supported to allow 3rd Party Clusterware to manage Oracle resources (instances, listeners, etc) and turn off Oracle Clusterware management of these?
- Does Oracle Clusterware support application vips?
- Can the Network Interface Card (NIC) device names be different on the nodes in a cluster, for both public and private?
- What is the High Availability API?
- What are the IP requirements for the private interconnect?
- Can I set up failover of the VIP to another card in the same machine or what do I do if I have different network interfaces on different nodes in my cluster (I.E. eth0 on node1,2 and eth1 on node 3,4)?
- How is the voting disk used by Oracle Clusterware?
- When ct run the command 'onsctl start' receives the message "Unable to open libhasgen10.so". Any idea why the message "unable to open libhasgen10.so" ?
- I made a mistake when I created the VIP during the install of Oracle Clusterware, can I change the VIP?
- Does the hostname have to match the public name or can it be anything else?
- Which processes access the OCR ?
- When does the Oracle node VIP fail over to another node and subsequently return to its home node?
- Can I change the name of my cluster after I have created it when I am using Oracle Clusterware?
- What should the permissions be set to for the voting disk and ocr when doing an Oracle RAC Install?
- How do I restore OCR from a backup? On Windows, can I use ocopy?
- With Oracle Clusterware 10g, how do you backup the OCR?
- How to Restore a Lost Voting Disk used by Oracle Clusterware 10g
- Is it a requirement to have the public interface linked to ETH0 or does it only need to be on a ETH lower than the private interface?: - public on ETH1 - private on ETH2
- How to move the OCR location ?
- Can I run a 10.1.0.x database with Oracle Clusterware 10.2 ?
Autonomous Computing
- Is there any example to query mgmtdb directly to get information about performance issues on cluster?
- Is moving the GIMR to a different diskgroup a best practice?
- How to specify the new diskgroup for the MGMTDB during the installation GUI?
- If GIMR is already discovered and managed in EMCC, the recommendation is to remove that from EM Cloud Control Managed Target List?
- If GIMR is not coming up due to some problems, will cluster restart or cluster will not come up till GIMR is up and available as part of CRS restart?
- How to configure interval of data write to mgmtdb?
- What does it mean that the node listener will go away from the current GIMR topology in the upcoming releases?
- How to remove GIMR database if it needs to be replaced?
- Can the data files of GIMR database be placed in any other disk group apart from its default one?
- While using mdbutil.pl with options - add and db, it will recreate the GIMR database. So should the GIMR database be deleted before issuing this command?
- How do I cd into the GIMR's trace or log directory?
- If EMCC is not supposed to monitor it, why is it discovered as a target ?
- How much shared disk space does the GIMR installation require?
- Does the GIMR get configured in a Oracle Restart single server install?
- Do I need to regularly backup the GIMR?
- Will I lose my GIMR data when upgrading or applying a patch?
- Do I need to separately patch the GIMR?
- Why does the GIMR use hugepages?
- Will I lose my cluster or database availability should the GIMR go down?
- Can I disable the GIMR?
- Who are the clients of GIMR?
- Why was GIMR implemented ?
- What is Grid Infrastructure Management Repository (GIMR) ?
Rapid Home Provisioning
- Is RHP supported on Exadata?
- Does the RHP Server need to be running the same OS as the targets it manages?
- How is Rapid Home Provisioning licensed?
Answers
How do I measure the bandwidth utilization of my NIC or my interconnect?
Oracle RAC depends on both (a) Latency and (b) Bandwidth
(a) Latency can be best measured by running a AWR or statspack report and reviewing the cluster section
(b) Bandwidth can be measured using OS provided utilities like iptraf, Netperf, topaz (AIX). ** Some of these utilities may not be available on All platforms.
Keep in mind that, if the network is utilized at 50% bandwidth, this means that 50% of the time it is busy and not available to potential users. In this case delays (due to Network collisions) will increase the latency even though the bandwidth might look "reasonable". So always keep an eye on both "Latency and Bandwidth"
RAC scalability is dependent at the storage unit's ability to process I/O's per second (throughput) in a scalable fashion, specifically from multiple sources (nodes).
Oracle recommends using ORION (Oracle I/O test tool) which simulates Oracle I/O. Note: Starting with 11.2 the orion tool is included with the RDBMS/RAC software, see ORACLE_HOME/bin. On other Unix platforms (as well as Linux) one can use IOzone, if prebuilt binary not available you should build from source, make sure to use version 3.271 or later and if testing raw/block devices add the "-I" flag.
In a basic read test you will try to demonstrate that a certain IO throughput can be maintained as nodes are added. Try to simulate your database io patterns as much as possible, i.e. blocksize, number of simultaneous readers, rates, etc. For example, on a 4 node cluster, from node 1 you measure 20MB/sec, then you start a read stream on node 2 and see another 20MB/sec while the first node shows no decrease. You then run another stream on node 3 and get another 20MB/sec, in the end you run 4 streams on 4 nodes, and get an aggregated 80MB/sec or close to that. This will prove that the shared storage is scalable. Obviously if you see poor scalability in this phase, that will be carried over and be observed or interpreted as poor RAC / Application scalability.
Is Oracle RAC supported on logical partitions (i.e. LPARs) or other virtualization technologies?
Check http://www.oracle.com/technetwork/database/virtualizationmatrix-172995.html for more details on supported virtualization and partitioning technologies.
How should voting disks be implemented in an extended cluster environment?
How should voting disks be implemented in an extended cluster environment?
Can I use standard NFS for the third site voting disk?
Standard NFS is only supported for the tie-breaking voting disk in an extended cluster environment. See platform and mount option restrictions here .Otherwise just as with database files, we only support voting files on certified NAS devices, with the appropriate mount options. Please refer to My Oracle Support Document 359515.1 for a full description of the required mount options.
What are the cdmp directories in the background_dump_dest used for?
These directories are produced by the diagnosibility daemon process (DIAG). DIAG is a database process which as one of its tasks, performs cache dumping. The DIAG process dumps out tracing to file when it discovers the death of an essential process (foreground or background) in the local instance. A dump directory named something like cdmp_ is created in the bdump or background_dump_dest directory, and all the trace dump files DIAG creates are placed in this directory.
How do I gather all relevant Oracle and OS log/trace files in an Oracle RAC cluster to provide to Support?
We recommend to install TFA in every cluster.
This is a great tool to collect the different logs across the cluster for database and cluster diagnostics. It can be run manually, automatically or at any given interval. It is included in 12.1.0.2.
If you are in 12.1.0.1 you need to download it, you can do so by going to myoracle support note 1513912.1
11.2.03 Grid Infrastructure deployments do not include TFA, but 11.2.04 deployments do include it.
TFA narrows the data for only what is relevant to the range of time you are analyzing, creates a zip file and uploads it to support.
The TFA analyzer get’s this zip file and provides an easy way to navigate the data, show relations between logs across nodes making it easier to analyze the data.
How should one review the ability to scale out to more nodes in your cluster?
Once a customer is using RAC on a two node cluster and want to see how far they can actually scale it, the following are some handy tips to follow:
\1. Ensure they are using a real enough workload that it does not have false bottlenecks.
\2. Have tuned the application so it is reasonable scalable on their current RAC environment.
\3. Make sure you are measuring a valid scalability measure. This should either be doing very large batch jobs quicker (via parallelism) or being able to support a greater number of short transactions in a shorter time.
\4. Actual scalability will vary for each application and its bottlenecks. Thus the request to do the above items. You would see similar scalability if scaling up on a SMP.
\5. For failover, you should see what happens if you lose a node. If you have 2 nodes, you lose half your power and really get into trouble or have lots of extra capacity.
\6. Measuring that load balancing is working properly. Make sure you are using RCLB and a FAN aware connection pool.
\7. Your customer should also testing using DB Services.
\8. Get familiar w/ EM GC to manage a cluster and help eliminate a lot of the complexity of many of the nodes.
\9. Why stop at 6 nodes? A maximum of 3 way messaging ensure RAC can scale much, much further.
Can I ignore 10.2 CLUVFY on Solaris warning about failed package existence checks?
Complete error is
Package existence check failed for "SUNWscucm:3.1".
Package existence check failed for "SUNWudlmr:3.1".
Package existence check failed for "SUNWudlm:3.1".
Package existence check failed for "ORCLudlm:Dev_Release_06/11/04,_64bit_3.3.4.8_reentrant".
Package existence check failed for "SUNWscr:3.1".
Package existence check failed for "SUNWscu:3.1".
Cluvfy checks all possible prerequisites and reports whether your system passed the checks or not. You should then cross reference with the install guide to see if the checks that failed are required for your type of installation. In the above case, if you are not planning on using Sun Cluster, then you can continue the install.
What is a CVU component?
CVU (Cluster Verification Utility) supports the notion of Component verification. The verifications in this category are not associated with any specific stage. The user can verify the correctness of a specific cluster component. A component can range from a basic one, like free disk space to a complex one like CRS Stack. The integrity check for CRS stack will transparently span over verification of multiple sub-components associated with CRS stack. This encapsulation of a set of tasks within specific component verification should be of a great ease to the user.
Why cluvfy reports "unknown" on a particular node?
According to the Cluster Verification Utility Reference from the Clusterware Administration and Deployment Guide from the 12c Documentation:
If a cluvfy
command responds with UNKNOWN
for a particular node, then this is because CVU cannot determine whether a check passed or failed. The cause could be a loss of reachability or the failure of user equivalence to that node. The cause could also be any system problem that was occurring on that node when CVU was performing a check.
The following is a list of possible causes for an UNKNOWN
response:
- The node is down
- Executables that CVU requires are missing in
Grid_home
/bin
or theOracle home
directory - The user account that ran CVU does not have privileges to run common operating system executables on the node
- The node is missing an operating system patch or a required package
- The node has exceeded the maximum number of processes or maximum number of open files, or there is a problem with IPC segments, such as shared memory or semaphores
What are the requirements for CVU?
According to the Cluster Verification Utility Reference from the Clusterware Administration and Deployment Guide from the 12c Documentation, CVU requirements are:
At least 30 MB free space for the CVU software on the node from which you run CVU
A work directory with at least 25 MB free space on each node. The default location of the work directory is
/tmp
on Linux and UNIX systems, and the value specified in theTEMP
environment variable on Windows systems. You can specify a different location by setting theCV_DESTLOC
environment variable.When using CVU, the utility attempts to copy any needed information to the CVU work directory. It checks for the existence of the work directory on each node. If it does not find one, then it attempts to create one. Make sure that the CVU work directory either exists on all nodes in your cluster or proper permissions are established on each node for the user running CVU to create that directory.
Java 1.4.1 on the local node
What about discovery? Does CVU discover installed components?
CVU performs system checks in preparation for installation, patch updates and/or other system changes. Checks performed by CVU can be:
- Free disk space
- Clusterware Integrity
- Memory
- Processes
- Other important cluster components
- All available network interfaces
- Shared Storage
- Clusterware home
For more information please check the Cluster Verification Utility Reference from the Clusterware Administration and Deployment Guide from the 12c Documentation.
How do I check Oracle RAC certification?
Please refer to my oracle support https://support.oracle.com/ for information regarding Certification of Oracle RAC and all other products from the stack,
Is Veritas Storage Foundation supported with Oracle RAC?
Veritas certifies Veritas Storage Foundation for Oracle RAC with each release. Check Veritas Support Matrix for the latest details. Also visit My Oracle Support for a list of certified 3rd party products with Oracle RAC.
Can I use ASM as mechanism to mirror the data in an Extended RAC cluster?
Yes, please refer to the Extended Clusters Technical Brief for more information on Extended Clusters and the RAC Stack.
What are the changes in memory requirements from moving from single instance to RAC?
If you are keeping the workload requirements per instance the same, then about 10% more buffer cache and 15% more shared pool is needed. The additional memory requirement is due to data structures for coherency management. The values are heuristic and are mostly upper bounds. Actual resource usage can be monitored by querying current and maximum columns for the gcs resource/locks and ges resource/locks entries in V$RESOURCE_LIMIT.
But in general, please take into consideration that memory requirements per instance are reduced when the same user population is distributed over multiple nodes. In this case:
Assuming the same user population N number of nodes M buffer cache for a single system then
(M / N) + ((M / N )*0.10) [ + extra memory to compensate for failed-over users ]
Thus for example with a M=2G & N=2 & no extra memory for failed-over users
=( 2G / 2 ) + (( 2G / 2 )) *0.10
=1G + 100M
What are the default values for the command line arguments?
Here are the default values and behavior for different stage and component commands:
For component nodecon:
If no -i or -a arguments is provided, then cluvfy will get into the discovery mode.
For component nodereach:
If no -srcnode is provided, then the local(node of invocation) will be used as the source node.
For components cfs, ocr, crs, space, clumgr:
If no -n argument is provided, then the local node will be used.
For components sys and admprv:
If no -n argument is provided, then the local node will be used.
If no -osdba argument is provided, then 'dba' will be used. If no -orainv argument is provided, then 'oinstall' will be used.
For component peer:
If no -osdba argument is provided, then 'dba' will be used.
If no -orainv argument is provided, then 'oinstall' will be used.
For stage -post hwos:
If no -s argument is provided, then cluvfy will get into the discovery mode.
For stage -pre clusvc:
If no -c argument is provided, then cluvfy will skip OCR related checks.
If no -q argument is provided, then cluvfy will skip voting disk related checks.
If no -osdba argument is provided, then 'dba' will be used.
If no -orainv argument is provided, then 'oinstall' will be used.
For stage -pre dbinst:
If -cfs_oh flag is not specified, then cluvfy will assume Oracle home is not on a shared file system.
If no -osdba argument is provided, then 'dba' will be used.
If no -orainv argument is provided, then 'oinstall' will be used.
Do I have to be root to use CVU?
No. CVU is intended for database and system administrators. CVU assumes the current user as Grid/Database user.
What is nodelist?
Nodelist is a comma separated list of hostnames without domain. Cluvfy will ignore any domain while processing the nodelist. If duplicate entities after removing the domain exist, cluvfy will eliminate the duplicate names while processing. Wherever supported, you can use '-n all' to check on all the cluster nodes.
How do I check minimal system requirements on the nodes?
The component verification command sys is meant for that. To check the system requirement for RAC, use '-p database' argument. To check the system requirement for CRS, use '-p crs' argument.
How do I get detail output of a check?
Cluvfy supports a verbose feature. By default, cluvfy reports in non-verbose mode and just reports the summary of a test. To get detailed output of a check, use the flag '-verbose' in the command line. This will produce detail output of individual checks and where applicable will show per-node result in a tabular fashion.
Why the peer comparison with -refnode says passed when the group or user does not exist?
Peer comparison with the -refnode feature acts like a baseline feature. It compares the system properties of other nodes against the reference node. If the value does not match( not equal to reference node value ), then it flags that as a deviation from the reference node. If a group or user does not exist on reference node as well as on the other node, it will report this as 'matched' since there is no deviation from the reference node. Similarly, it will report as 'mismatched' for a node with higher total memory than the reference node for the above reason.
At what point cluvfy is usable? Can I use cluvfy before installing Oracle Clusterware?
You can run cluvfy at any time, even before CRS installation. In fact, cluvfy is designed to assist the user as soon as the hardware and OS is up. If you invoke a command which requires CRS or RAC on local node, cluvfy will report an error if those required products are not yet installed.
Cluvfy can also be invoked after install to check if any new hardware component added after the install (like more shared disks etc) are accessible from all the nodes.
Is there a way to compare nodes?
You can use the peer comparison feature of cluvfy for this purpose. The command 'comp peer' will list the values of different nodes for several pre-selected properties. You can use the peer command with -refnode argument to compare those properties of other nodes against the reference node.
What is a stage?
CVU supports the notion of Stage verification. It identifies all the important stages in RAC deployment and provides each stage with its own entry and exit criteria. The entry criteria for a stage define a specific set of verification tasks to be performed before initiating that stage. This pre-check saves the user from entering into a stage unless its pre-requisite conditions are met. The exit criteria for a stage define another specific set of verification tasks to be performed after completion of the stage. The post-check ensures that the activities for that stage have been completed successfully. It identifies any stage specific problem before it propagates to subsequent stages; thus making it difficult to find its root cause. An example of a stage is "pre-check of database installation", which checks whether the system meets the criteria for RAC install.
How do I know about cluvfy commands? The usage text of cluvfy does not show individual commands.
Cluvfy has context sensitive help built into it. Cluvfy shows the most appropriate usage text based on the cluvfy command line arguments. If you type 'cluvfy' on the command prompt, cluvfy displays the high level generic usage text, which talks about valid stage and component syntax. If you type 'cluvfy comp -list', cluvfy will show valid components with brief description on each of them. If you type 'cluvfy comp -help', cluvfy will show detail syntax for each of the valid components. Similarly, 'cluvfy stage -list' and 'cluvfy stage -help' will list valid stages and their syntax respectively. If you type an invalid command, cluvfy will show the appropriate usage for that particular command. For example, if you type 'cluvfy stage -pre dbinst', cluvfy will show the syntax for pre-check of dbinst stage.
Yes, you can use 'comp ssa' command to check the sharedness of the storage. Please refer to the known issues section for the type of storage supported by cluvfy in the cluvfy help command output.
Does Database blocksize or tablespace blocksize affect how the data is passed across the interconnect?
Oracle ships database block buffers, i.e. blocks in a tablespace configured for 16K will result in a 16K data buffer shipped, blocks residing in a tablespace with base block size (8K) will be shipped as base blocks and so on; the data buffers are broken down to packets of MTU sizes.
There are optimizations in newer releases like compressing etc that are beyond the scope of this FAQ
What is Oracle's position with respect to supporting RAC on Polyserve CFS?
Please check the certification matrix available through My Oracle Support for your specific release.
Use component verifications commands like 'nodereach' or 'nodecon' for this purpose. For detail syntax of these commands, type cluvfy comp -help on the command prompt. If the 'cluvfy comp nodecon' command is invoked without -i, cluvfy will attempt to discover all the available interfaces and the corresponding IP address & subnet. Then cluvfy will try to verify the node connectivity per subnet. You can run this command in verbose mode to find out the mappings between the interfaces, IP addresses and subnets. You can check the connectivity among the nodes by specifying the interface name(s) through -i argument.
What is CVU? What are its objectives and features?
CVU brings ease to RAC users by verifying all the important components that need to be verified at different stages in a RAC environment. The wide domain of deployment of CVU ranges from initial hardware setup through fully operational cluster for RAC deployment and covers all the intermediate stages of installation and configuration of various components. The command line tool is cluvfy. Cluvfy is a non-intrusive utility and will not adversely affect the system or operations stack.
Is there a cluster file system (CFS) Available for Linux?
Yes, ACFS (ASM Cluster File System with Oracle Database 11g Release 2) and OCFS (Oracle Cluster Filesystem) are available for Linux. The following My Oracle Support document has information for obtaining the latest version of OCFS:
Document 238278.1 - How to find the current OCFS version for Linux
Is OCFS2 certified with Oracle RAC 10g?
Yes. See Certify to find out which platforms are currently certified.
How do I check the Oracle Clusterware stack and other sub-components of it?
Cluvfy provides commands to check a particular sub-component of the CRS stack as well as the whole CRS stack. You can use the 'comp ocr' command to check the integrity of OCR. Similarly, you can use 'comp crs' and 'comp clumgr' commands to check integrity of crs and cluster manager sub-components. To check the entire CRS stack, run the stage command 'clucvy stage -post crsinst'.
Where can I find the CVU trace files?
CVU log files can be found under $CV_HOME/cv/log directory. The log files are automatically rotated and the latest log file has the name cvutrace.log.0. It is a good idea to clean up unwanted log files or archive them to reclaim disk place.
In recent releases, CVU trace files are generated by default. Setting SRVM_TRACE=false before invoking cluvfy disables the trace generation for that invocation.
Can I use Oracle Clusterware for failover of the SAP Enqueue and VIP services when running SAP in a RAC environment?
Oracle has created sapctl to do this and it is available for certain platforms. SAPCTL will be available for download on SAP Services Marketplace on AIX and Linux. Please check the market place for other platforms
How do I turn on tracing?
Set the environmental variable SRVM_TRACE to true. For example, in tcsh "setenv SRVM_TRACE true" will turn on tracing. Also it may help to run cluvfy with -verbose attribute
$script run.log
$export SRVM_TRACE=TRUE
$cluvfy -blah -verbose
$exit
How do I check whether OCFS is properly configured?
You can use the cluvfy component command 'cfs' to check this. Provide the OCFS file system you want to check through the -f argument. Note that, the sharedness check for the file system is supported for OCFS version 1.0.14 or higher.
My customer is about to install 10202 clusterware on new Linux machines. He is getting "No ORACM running" error when run rootpre.sh and exited? Should he worry about this message?
It is an informational message. Generally for such scripts, you can issue echo “$?” to ensure that it returns a zero value. The message is basically saying, it did not find an oracm. If Customer were installing 10g on an existing 9i cluster (which will have oracm) then this message would have been serious. But since customer is installing this on a fresh new box, They can continue the install.
Can different releases of Oracle RAC be installed and run on the same physical Linux cluster?
Yes!!!
The details answer is broken into three categories
- Oracle Version 10g and above only
We only require that Oracle Clusterware version be higher than or equal to the Database release. Customer can run multiple releases on the same cluster. - Oracle Version 10g and higher alongside Oracle Version less than 10g
Oracle Clusterware (CRS) will not support a Oracle 9i RAC database so you will have to leave the current configuration in place. You can install Oracle Clusterware and Oracle RAC 10g or 11g into the same cluster. On Windows and Linux, you must run the 9i Cluster Manager for the 9i Database and the Oracle Clusterware for the 10g Database. When you install Oracle Clusterware, your 9i srvconfig file will be converted to the OCR. Oracle 9i RAC, Oracle RAC 10g, and Oracle RAC 11g will use the OCR. Do not restart the 9i gsd after you have installed Oracle Clusterware. Remember to check certify for details of what vendor clusterware can be run with Oracle Clusterware. Oracle Clusterware must be the highest level (down to the patchset). IE Oracle Clusterware 11g Release 2 will support Oracle RAC 10g and Oracle RAC 11g databases. Oracle Clusterware 10g can only support Oracle RAC 10g databases.
Oracle Clusterware fails to start after a reboot due to permissions on raw devices reverting to default values. How do I fix this?
After a successful installation of Oracle Clusterware a simple reboot and Oracle Clusterware fails to start. This is because the permissions on the raw devices for the OCR and voting disks e.g. /dev/raw/raw{x} revert to their default values (root:disk) and are inaccessible to Oracle. This change of behavior started with the 2.6 kernel; in RHEL4, OEL4, RHEL5, OEL5, SLES9 and SLES10. In RHEL3 the raw devices maintained their permissions across reboots so this symptom was not seen.
The way to fix this is on RHEL4, OEL4 and SLES9 is to create /etc/udev/permission.d/40-udev.permissions (you must choose a number that's lower than 50). You can do this by copying /etc/udev/permission.d/50-udev.permissions, and removing the lines that are not needed (50-udev.permissions gets replaced with upgrades so you do not want to edit it directly, also a typo in the 50-udev.permissions can render the system non-usable). Example permissions file:# raw devicesraw/raw[1-2]:root:oinstall:0640raw/raw[3-5]:oracle:oinstall:0660
Note that this applied to all raw device files, here just the voting and OCR devices were specified.
On RHEL5, OEL5 and SLES10 a different file is used /etc/udev/rules.d/99-raw.rules, notice that now the number must be (any number) higher than 50. Also the syntax of the rules is different than the permissions file, here's an example:
1 | KERNEL=="raw[1-2]*", GROUP="oinstall", MODE="640"KERNEL=="raw[3-5]*", OWNER="oracle", GROUP="oinstall", MODE="660" |
This is explained in detail in Document 414897.1 .
Customer did not load the hangcheck-timer before installing RAC, Can the customer just load the hangcheck-timer ?
YES. hangcheck timer is a kernel module that is shipped with the Linux kernel, all you have to do is load it as follows:
1 2 3 4 5 | 9i: /sbin/insmod hangcheck-timer hangcheck_tick=30 hangcheck_margin=180 hangcheck_reboot=1 10g & 11g: /sbin/insmod hangcheck-timer hangcheck_tick=1 hangcheck_margin=10 hangcheck_reboot=1 No need to reboot the nodes. |
For more details see Document 726833.1
After installing patchset 9013 and patch_2313680 on Linux, the startup was very slow
Please carefully read the following new information about configuring Oracle Cluster Management on Linux, provided as part of the patch README:
Three parameters affect the startup time:
soft_margin (defined at watchdog module load)
-m (watchdogd startup option)
WatchdogMarginWait (defined in nmcfg.ora).
WatchdogMarginWait is calculated using the formula:
WatchdogMarginWait = soft_margin(msec) + -m + 5000(msec).
[5000(msec) is hardcoded]
Note that the soft_margin is measured in seconds, -m and WatchMarginWait are measured in milliseconds.
Based on benchmarking, it is recommended to set soft_margin between 10 and 20 seconds. Use the same value for -m (converted to milliseconds) as used for soft_margin. Here is an example:
soft_margin=10 -m=10000 WatchdogMarginWait = 10000+10000+5000=25000
If CPU utilization in your system is high and you experience unexpected node reboots, check the wdd.log file. If there are any 'ping came too late' messages, increase the value of the above parameters.
Is there a way to verify that the Oracle Clusterware is working properly before proceeding with RAC install?
Yes. You can use the post-check command for cluster services setup(-post clusvc) to verify CRS status. A more appropriate test would be to use the pre-check command for database installation(-pre dbinst). This will check whether the current state of the system is suitable for RAC install.
How do I configure my RAC Cluster to use the RDS Infiniband?
Ensure that the IB (Infiniband) Card is certified for the OS, Driver, Oracle version etc.
You may need to relink Oracle using the command
$ cd $ORACLE_HOME/rdbms/lib
$ make -f ins_rdbms.mk ipc_rds ioracle
You can check your interconnect through the alert log at startup. Check for the string “cluster interconnect IPC version:Oracle RDS/IP (generic)” in the alert.log file.
See Document 751343.1 for more details.
Why is validateUserEquiv failing during install (or cluvfy run)?
SSH must be set up as per the pre-installation tasks. It is also necessary to have file permissions set as described below for features such as Public Key Authorization to work. If your permissions are not correct, public key authentication will fail, and will fallback to password authentication with no helpful message as to why. The following server configuration files and/or directories must be owned by the account owner or by root and GROUP and WORLD WRITE permission must be disabled.
$HOME
$HOME/.rhosts
$HOME/.shosts
$HOME/.ssh
$HOME/.ssh.authorized-keys
$HOME/.ssh/authorized-keys2 #Openssh specific for ssh2 protocol.
SSH (from OUI) will also fail if you have not connected to each machine in your cluster as per the note in the installation guide:
The first time you use SSH to connect to a node from a particular system, you may see a message similar to the following:
The authenticity of host 'node1 (140.87.152.153)' can't be established. RSA key fingerprint is 7z:ez:e7:f6:f4:f2:4f:8f:9z:79:85:62:20:90:92:z9.
Are you sure you want to continue connecting (yes/no)?
Enter |yes| at the prompt to continue. You should not see this message again when you connect from this system to that node. Answering yes to this question causes an entry to be added to a "known-hosts" file in the .ssh directory which is why subsequent connection requests do not re-ask.
This is known to work on Solaris and Linux but may work on other platforms as well.
What is Runtime Connection Load Balancing?
Runtime connection Load balancing enables the connection pool to route incoming work requests to the available database connection that will provide it with the best service. This will provide the best service times globally, and routing responds fast to changing conditions in the system. Oracle has implemented runtime connection load balancing with ODP.NET and JDBC connection pools. Runtime Connection Load Balancing is tightly integrated with the automatic workload balancing features introduced with Oracle Database 10g I.E. Services, Automatic Workload Repository, and the new Load Balancing Advisory.
How do I enable the load balancing advisory?
Load balancing advisory requires the use of services and Oracle Net connection load balancing.
To enable it, on the server: set a goal (service_time or throughput, and set CLB_GOAL=SHORT ) for the service.
For client, you must be using the connection pool.
For JDBC, enable the datasource parameter FastConnectionFailoverEnabled.
For ODP.NET enable the datasource parameter Load Balancing=true.
What are the network requirements for an extended RAC cluster?
Necessary Connections
Interconnect, SAN, and IP Networking need to be kept on separate channels, each with required redundancy. Redundant connections must not share the same Dark Fiber (if used), switch, path, or even building entrances. Keep in mind that cables can be cut.
The SAN and Interconnect connections need to be on dedicated point-to-point connections. No WAN or Shared connection allowed. Traditional cables are limited to about 10 km if you are to avoid using repeaters. Dark Fiber networks allow the communication to occur without repeaters. Since latency is limited, Dark Fiber networks allow for a greater distance in separation between the nodes. The disadvantage of Dark Fiber networks are they can cost hundreds of thousands of dollars, so generally they are only an option if they already exist between the two sites.
If direct connections are used (for short distances) this is generally done by just stringing long cables from a switch. If a DWDM or CWDM is used then then these are directly connected via a dedicated switch on either side.
Note of caution: Do not do RAC Interconnect over a WAN. This is a the same as doing it over the public network which is not supported and other uses of the network (i.e. large FTPs) can cause performance degradations or even node evictions.
For SAN networks make sure you are using SAN buffer credits if the distance is over 10km.
If Oracle Clusterware is being used, we also require that a single subnet be setup for the public connections so we can fail over VIPs from one side to another.
What is the maximum distance between nodes in an extended RAC environment?
The high impact of latency create practical limitations as to where this architecture can be deployed. While there is not fixed distance limitation, the additional latency on round trip on I/O and a one way cache fusion will have an affect on performance as distance increases. For example tests at 100km showed a 3-4 ms impact on I/O and 1 ms impact on cache fusion, thus the farther distance is the greater the impact on performance. This architecture fits best where the 2 datacenters are relatively close (<~25km) and the impact is negligible. Most customers implement under this distance w/ only a handful above and the farthest known example is at 100km. Largest distances than the commonly implemented may want to estimate or measure the performance hit on their application before implementing. Due ensure a proper setup of SAN buffer credits to limit the impact of distance at the I/O layer.
Are crossover cables supported as an interconnect with Oracle RAC on any platform?
NO. CROSS OVER CABLES ARE GENERALLY NOT SUPPORTED. The requirement is to use a switch.
The only exception is the Oracle Database Appliance (ODA), for which crossover cables are used.
Detailed Reasons:
\1) cross-cabling limits the expansion of Oracle RAC to two nodes.