Category Archives: Oracle

Oracle CPU Kills Esri

Just applied the October 2014 Oracle Critical Patch Update (CPU) to some Esri geodatabases and the results were not good.

After applying patch 19618575 patch 34 to several ArcGIS 10.0 geodatabases (11.2.0.3) all Esri products ceased to function properly. You may receive an error message stating “ArcMap has encountered a problem and needs to close.” In addition, ArcGIS for Server map services will stop and return the error “Unable to Start service Server Object instance… creation failed on machine” if you attempt to start them.

The only way we found to fix this issue is to perform a rollback of the patch, taking the databases back to their default state, then apply the Oracle CPU released in July 2014. The instructions for performing the rollback can be found in the patch’s readme file.

UPDATE #1: It took them over a week to respond, but Esri has finally acknowledged there is a problem with the latest Oracle patch. The details can be found in Knowledge Base Article ID 43293.

Update #2: Instead of granting the select privilege on v_$parameter to each database user we created a new default role, granted the select privilege on v_$parameter to the role, and assigned the default role to each user via Oracle Enterprise Manager. This provides admins with a quick method for adding other privileges in the future.

Advertisements

Oracle Enterprise Manager Backup Failure

Following a server reboot, Oracle Enterprise Manager Cloud Control 12c automated backups fail with the message:

ERROR: Failed to create command process Error while streaming JobReader:java.io.IOException: The pipe is being closed

C:oracleproduct12.1.0agentcore12.1.0.2.0perlbin/perl execution failed: The system cannot find the file specified.

For an unknown reason, the backslashes in the agent monitoring configuration are being removed. To correct the problem in the short-term navigate to the agent’s home page, select Agent > Target Setup > Monitoring Configuration, and reinsert the backslashes. I am still searching for a permanent solution to this problem.

While your paths may differ slightly, they should resemble the following:

ADRBase
C:\oracle\product\12.1.0\agent\agent_inst

ADRHome
C:\oracle\product\12.1.0\agent\agent_inst\diag\ofm\emagent\emagent

Agent EMDRoot
C:\oracle\product\12.1.0\agent\core\12.1.0.2.0

Agent Oracle Home
C:\oracle\product\12.1.0\agent\core\12.1.0.2.0

Oracle Home
C:\oracle\product\12.1.0\agent\core\12.1.0.2.0

Perl bin directory
C:\oracle\product\12.1.0\agent\core\12.1.0.2.0\perl\bin

Oracle Software Targets Without Inventory

Quick links

Problem

  • Software Targets Without Inventory
  • OCM is not installed or configured – executeCommand(): failed to verify harvester jar
  • No Oracle Homes found under Net Services Administration

After deploying several Oracle Enterprise Manager Agents on various hosts, Grid Control was returning several error messages. These errors include software targets without inventory messages, GC Harvester and OCM issues, and Net Services Administration errors. In my case the errors were confined to one host, but only a portion of the databases on that host were returning errors. Several websites suggested stopping, un-securing and securing the management agent. Other sites suggested installing Oracle Configuration Manager (OCM). These actions did not rectify the problems. I eventually determined that a lowercase drive letter was the culprit and was able to quickly fix the issue by removing the databases in Grid Control, manually re-adding each database, and changing the Oracle home path from c:\oracle to C:\oracle.

Platform

OS Microsoft Windows Server 2003 SP2 (32-bit)
Database Oracle 10g 10.2.0.4.0
Oracle 11g 11.1.0.7.0
Grid Control Oracle Enterprise Manager 11g Release 1 Grid Control 11.1.0.1.0

Symptoms

In the lower right of the home page, selecting Database Installations from the Deployments Summary drop-down returns the following error.

Deployments Summary
View Database Installations
Software Targets Without Inventory: 3 of 12
Database Installations Targets Installations Patches Applied
Oracle Database 10g 10.2.0.4.0 6 3 Yes
Oracle Database 11g 11.1.0.7.0 1 2 No

Clicking the link on the front page or selecting the “Deployments” tab, clicking “Host Configuration Collection Problems” and selecting the “Software Targets Without Inventory” sub-tab displays the following table.

Host Configuration Collection Problems

Target Name Target Type Host Oracle Home
MyDatabase3 Database Instance ServerName c:\oracle\product\10.2.0\db
MyDatabase4 Database Instance ServerName c:\oracle\product\10.2.0\db
MyDatabase5 Database Instance ServerName c:\oracle\product\10.2.0\db

This problem is further detailed by following the “System Errors” link at the bottom of the page.

Management Services and Repository

Component Type Agent Timestamp Level Error Text
GC Harvester n/a Feb 28, 2012 2:00:00 AM Error OCM is not installed or configured – executeCommand(): failed to verify harvester jar
GC Harvester n/a Feb 27, 2012 2:00:00 AM Error OCM is not installed or configured – executeCommand(): failed to verify harvester jar

Navigating to the host page and clicking the “Net Services Administration” link returns the following error.

Net Services Administration

Select Configuration File Location Oracle Home
No Oracle Homes found

Cause

Selecting the targets page for a particular host lists the agents, listeners, and databases on that host. The difference between the databases is the drive letter of the installed location. Note that MyDatabase3 has a lowercase “c” while the other databases have an uppercase “C”.

Host: ServerName

Name Installed location Availability Type
Agent:3872 C:\oracle\product\11.1.0\agent11g Agent
MyDatabase1 C:\oracle\product\11.1.0\agent11g Database Instance
MyDatabase2 C:\oracle\product\11.1.0\agent11g Database Instance
MyDatabase3 c:\oracle\product\11.1.0\agent11g Database Instance
MyDatabase4 c:\oracle\product\11.1.0\agent11g Database Instance
MyDatabase5 c:\oracle\product\11.1.0\agent11g Database Instance

Solution

From the databases tab, click the radio button next to the problematic database and click the “Remove” button. Once removed, click the “Add” button, select the Host and click the “Continue” button. Select the checkbox next to the database and click the configure icon.

Targets Discovered on Host: ServerName

Select Name Group Configure Metrics
MyDatabase3
MyDatabase4
MyDatabase5

When adding a target, you must change the lowercase drive letter to an upper case drive letter.

Configure Database Instance: Properties

Name Value
Oracle home path c:\oracle\product\10.2.0\db
Monitor Username dbsnmp
Monitor Password ******
Role Normal
Listener Machine Name ServerName
Port 1521
Database SID MyDatabase3