Hi Friends, today i face some problem with EM dbconsole in one of my databases are here is the way how i resolved it

Database version : 10.2.0.4 standard edition
OS version : windows 2003 server with service pack 2

Problem : Sys admin performed firm upgrade on my database server and rebooted it. From that moment EM dbconsole is not working

1) i checked the status of dbconsole as follows

C:\Documents and Settings\oracms>emctl status dbconsole
Oracle Enterprise Manager 10g Database Control Release 10.2.0.4.0
Copyright (c) 1996, 2007 Oracle Corporation.  All rights reserved.
https://cmsp-database.klpcph.local:5500/em/console/aboutApplication
Oracle Enterprise Manager 10g is not running.
——————————————————————
Logs are generated in directory N:\oracle\product\10.2.0\db/cmsp-database.klpcph.local_KLPPROD01/sys
man/log

2) then i tried starting dbconsole and got following error

C:\Documents and Settings\oracms>emctl start dbconsole
Oracle Enterprise Manager 10g Database Control Release 10.2.0.4.0
Copyright (c) 1996, 2007 Oracle Corporation.  All rights reserved.
https://cmsp-database.klpcph.local:5500/em/console/aboutApplication
Starting Oracle Enterprise Manager 10g Database Control …The OracleDBConsoleKLPPROD01 service is s
tarting…………………………………………………………………………………
……………………………………………………………………………………….
……………………
The OracleDBConsoleKLPPROD01 service could not be started.

A service specific error occurred: 1.

More help is available by typing NET HELPMSG 3547.

3) then i tried to find out what this message is

C:\Documents and Settings\oracms>NET HELPMSG 3547

A service specific error occurred: ***.
EXPLANATION

A service-specific error occurred.

ACTION

Refer to the Help or documentation for that service to determine the problem.

as you can see we cannot understand what is the exact problem here…

4) sometimes this problem may occur because SYSMAN and DBSNMP users got locked. so i checked their account status

C:\Documents and Settings\oracms>sqlplus “/ as sysdba”

SQL*Plus: Release 10.2.0.4.0 – Production on Tue May 18 08:26:24 2010

Copyright (c) 1982, 2007, Oracle.  All Rights Reserved.
Connected to:
Oracle Database 10g Release 10.2.0.4.0 – 64bit Production

SQL> select username,account_status from dba_users;

USERNAME                       ACCOUNT_STATUS
—————————— ——————————–
MGMT_VIEW                      OPEN
SYS                            OPEN
SYSTEM                         OPEN
DBSNMP                         OPEN
SYSMAN                         OPEN

so from above, its clear that both the user accounts are open

5) then i checked if agent is running or not

C:\Documents and Settings\oracms>emctl status agent
Oracle Enterprise Manager 10g Database Control Release 10.2.0.4.0
Copyright (c) 1996, 2007 Oracle Corporation.  All rights reserved.
—————————————————————
Agent is Not Running

6) because agent is not running, i tried to start it

C:\Documents and Settings\oracms>emctl start agent
Oracle Enterprise Manager 10g Database Control Release 10.2.0.4.0
Copyright (c) 1996, 2007 Oracle Corporation.  All rights reserved.
The service name is invalid.

More help is available by typing NET HELPMSG 2185.

as mentioned i tried to check what this message is…

C:\Documents and Settings\oracms>NET HELPMSG 2185

The service name is invalid.
EXPLANATION

You tried to start a service that is not configured on this system.

ACTION

Check the spelling of the service name or check the configuration information for the service using
the Services option from Server Manager.

7) restarting the server could be a solution, but we cannot do that if it is a production database. so i recreated repository
Do remember, recreating enterprise manager repository will not have any impact on database functionality

before recreating, take out the info like
Database hostname
Database SID
Listener port number
password for SYS user
password for DBSNMP user
password for SYSMAN user
also, it is important that DBSNMP and SYSMAN user’s account should be opened

use the following command to recreate repository

C:\Documents and Settings\oracms>emca -config dbcontrol db -repos recreate

STARTED EMCA at May 18, 2010 8:28:24 AM
EM Configuration Assistant, Version 10.2.0.1.0 Production
Copyright (c) 2003, 2005, Oracle.  All rights reserved.

Enter the following information:
Database SID: KLPSTAGE01
Database Control is already configured for the database KLPSTAGE01
You have chosen to configure Database Control for managing the database KLPSTAGE01
This will remove the existing configuration and the default settings and perform a fresh configurati
on
Do you wish to continue? [yes(Y)/no(N)]: y
Listener port number: 1521
Password for SYS user:
Password for DBSNMP user:
Password for SYSMAN user:
Email address for notifications (optional):
Outgoing Mail (SMTP) server for notifications (optional):
—————————————————————–

You have specified the following settings

Database ORACLE_HOME ……………. N:\oracle\product\10.2.0\db

Database hostname ……………. klpdbscph601.klpcph.local
Listener port number ……………. 1521
Database SID ……………. KLPSTAGE01
Email address for notifications ……………
Outgoing Mail (SMTP) server for notifications ……………

—————————————————————–
Do you wish to continue? [yes(Y)/no(N)]: y

this successfully created repository and started my dbconsole

8) so i am happy that my problem solved. but when i checked the EM dbconsole status….it gave me another shock

C:\Documents and Settings\oracms>emctl status dbconsole
Oracle Enterprise Manager 10g Database Control Release 10.2.0.4.0
Copyright (c) 1996, 2007 Oracle Corporation.  All rights reserved.
https://klpdbscph601.klpcph.local:5500/em/console/aboutApplication
EM Daemon is not running.
——————————————————————
Logs are generated in directory N:\oracle\product\10.2.0\db/klpdbscph601.klpcph.local_KLPSTAGE01/sys
man/log

then i started looking at log and found following warning

May 18, 2010 8:33:00 AM oracle.sysman.emcp.ParamsManager getLocalListener
WARNING: Error retrieving listener for klpdbscph601.klpcph.local

so finally, i reloaded listener and you know it started working… 🙂

C:\Documents and Settings\oracms>lsnrctl reload LISTENER_STAGE01

LSNRCTL for 64-bit Windows: Version 10.2.0.4.0 – Production on 18-MAY-2010 08:37:26

Copyright (c) 1991, 2007, Oracle.  All rights reserved.

Connecting to (DESCRIPTION=(ADDRESS=(PROTOCOL=TCP)(HOST=klpdbscph601.klpcph.local)(PORT=1523)))
The command completed successfully

C:\Documents and Settings\oracms>emctl status dbconsole
Oracle Enterprise Manager 10g Database Control Release 10.2.0.4.0
Copyright (c) 1996, 2007 Oracle Corporation.  All rights reserved.
https://klpdbscph601.klpcph.local:5500/em/console/aboutApplication
Oracle Enterprise Manager 10g is running.
——————————————————————
Logs are generated in directory N:\oracle\product\10.2.0\db/klpdbscph601.klpcph.local_KLPSTAGE01/sys
man/log

Note : we are not using grid control, so this is only for 10g EM dbconsole problem. Don’t apply it for grid control and also test it before use