You are here

Mwa not working, scopeux process dies

Hpux 11.23
Server rx7640
Software:
B3693AA C.04.60.000 HP GlancePlus/UX For HP-UX 11.23
B4967AA C.04.60.000 HP OpenView Performance Agent For HP-UX 11.23

Scopeux daemon is crashing all the time with errors:

**** 01/10/13 12:30:00 ****
Server collector startup completed, beginning data collection.
Collection intervals: Process = 60 Global = 300

== Fatal Nums Error == C.04.62.500 06/11/08 ==
User: root Date: Thu Jan 10 12:30:04
File: /crm/numsVob/hp/11.0/db.C Line: 2736 Product id: MWA
System: flightpig B.11.23 ia64
Errno: 0 (Error 0)

UnInitialized Metric(583) requested from nums

== End of Error Msg =============================

mwa status is reporting scopeux crashing every 2/3 minutes

root@flightpig:/opt/perf/bin> mwa status
OVPA status:
WARNING: scopeux is not active (OVPA data collector)
Running midaemon (Measurement Interface daemon) pid 12061
Running ttd (ARM registration daemon) pid 7512

OVPA Server status:

Running ovcd (OV control component) pid 6723
Running ovbbccb (BBC5 communication broker) pid 6729
Running coda (perf component) pid(s) 5414
Configured DataSources(1) CODA

After starting/stoping all the daemons:

->Stopping
midaemon -T
ttd -k
/opt/OV/bin/ovcd -kill
ovpa stop coda
ovpa stop scope

->Starting
ovpa start

The problem was the same scopeux died. So next I checked the software patch levels between the midaemon and the scopeux software, with:

root@flightpig:/opt/perf/bin> for i in $(ls -1)^Jdo^Jfile $i | grep executable > /dev/null ^Jif [ $? = 0 ] ; then what $i ; fi^Jdone
midaemon:
midaemon C.04.62.500 06/11/08 HP-UX 11 =*=
extract:
extract C.04.60.000 01/05/07 HP-UX 11 =*=
glance:
glance C.04.60.000 01/05/07 HP-UX 11 =*=
.........
scopeux:
scopeux C.04.60.000 01/05/07 HP-UX 11 =*=
root@flightpig:/opt/perf/bin>

As you can see the midaemon has a different patch version than scopeux and the rest of the software, so we check to see what patch contains the new midaemon version:

root@flightpig:/opt/perf/bin> swlist -l file | grep -i midaemon
MeasurementInt.MI: /opt/perf/bin/midaemon
MeasurementInt.MI: /opt/perf/man/man1/midaemon.1
MeasurementInt.MI-JPN: /opt/perf/man/ja_JP.SJIS/man1/midaemon.1
PHSS_37409.MI: /opt/perf/bin/midaemon

And we also check if we have a roleout of the patch:

root@flightpig:/var/adm/sw/save> find . -name "midaemon"
./PHSS_37409/MI/opt/perf/bin/midaemon
root@flightpig:/var/adm/sw/save> what ./PHSS_37409/MI/opt/perf/bin/midaemon
./PHSS_37409/MI/opt/perf/bin/midaemon:
midaemon C.04.60.000 01/05/07 HP-UX 11 =*=

So we now know that if we remove the patch we will have our C.04.60.000 version back. So we stop the software:

midaemon -T
ttd -k
/opt/OV/bin/ovcd -kill
ovpa stop coda
ovpa stop scope

And then swremove the patch:

#swremove PHSS_37409

Once it has finished, we chexk the versions:

root@flightpig:/opt/perf/bin> for i in $(ls -1)^Jdo^Jfile $i | grep executable > /dev/null ^Jif [ $? = 0 ] ; then what $i ; fi^Jdone
#midaemon:
midaemon C.04.62.500 06/11/08 HP-UX 11 =*=
midaemon:
midaemon C.04.60.000 01/05/07 HP-UX 11 =*=
.........
scopeux:
scopeux C.04.60.000 01/05/07 HP-UX 11 =*=

No we have version 4.60 of all the software, and the 04.62.500 backup with the # in front.
So we start the software:

root@flightpig:/var/opt/perf/datafiles> ovpa start

The OVPA scope collector is being started.
The ARM registration daemon
/opt/perf/bin/ttd has been started.

The Performance collection daemon
/opt/perf/bin/scopeux has been started.

The coda daemon /opt/OV/lbin/perf/coda has been started.
It will be fully operational in a few minutes.

The OVPA alarm generator is being started.
The alarm generator /opt/perf/bin/perfalarm
has been started.
root@flightpig:/var/opt/perf/datafiles> mwa status
OVPA status:
Running scopeux (OVPA data collector) pid 3293
Running midaemon (Measurement Interface daemon) pid 3152
Running ttd (ARM registration daemon) pid 3128

OVPA Server status:

Running ovcd (OV control component) pid 26706
Running ovbbccb (BBC5 communication broker) pid 26723
Running coda (perf component) pid(s) 3344
Running perfalarm (alarm generator) pid(s) 3349

Unix Systems: 

Add new comment

Filtered HTML

  • Web page addresses and e-mail addresses turn into links automatically.
  • Allowed HTML tags: <a> <em> <strong> <cite> <blockquote> <code> <ul> <ol> <li> <dl> <dt> <dd>
  • Lines and paragraphs break automatically.

Plain text

  • No HTML tags allowed.
  • Web page addresses and e-mail addresses turn into links automatically.
  • Lines and paragraphs break automatically.
By submitting this form, you accept the Mollom privacy policy.
Error | HP-UX Tips & Tricks Site

Error

Error message

  • Warning: Cannot modify header information - headers already sent by (output started at /homepages/37/d228974590/htdocs/includes/common.inc:2567) in drupal_send_headers() (line 1207 of /homepages/37/d228974590/htdocs/includes/bootstrap.inc).
  • PDOException: SQLSTATE[42000]: Syntax error or access violation: 1142 INSERT command denied to user 'dbo229817041'@'217.160.155.192' for table 'watchdog': INSERT INTO {watchdog} (uid, type, message, variables, severity, link, location, referer, hostname, timestamp) VALUES (:db_insert_placeholder_0, :db_insert_placeholder_1, :db_insert_placeholder_2, :db_insert_placeholder_3, :db_insert_placeholder_4, :db_insert_placeholder_5, :db_insert_placeholder_6, :db_insert_placeholder_7, :db_insert_placeholder_8, :db_insert_placeholder_9); Array ( [:db_insert_placeholder_0] => 0 [:db_insert_placeholder_1] => cron [:db_insert_placeholder_2] => Attempting to re-run cron while it is already running. [:db_insert_placeholder_3] => a:0:{} [:db_insert_placeholder_4] => 4 [:db_insert_placeholder_5] => [:db_insert_placeholder_6] => http://hpuxtips.es/?q=content/mwa-not-working-scopeux-process-dies [:db_insert_placeholder_7] => [:db_insert_placeholder_8] => 54.162.3.15 [:db_insert_placeholder_9] => 1503350758 ) in dblog_watchdog() (line 157 of /homepages/37/d228974590/htdocs/modules/dblog/dblog.module).
The website encountered an unexpected error. Please try again later.