Oct 06 03:46:07 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 06 03:46:37 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.370000
Oct 06 03:46:37 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 06 03:47:07 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 15.830000
Oct 06 03:47:37 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 16.650000
Oct 06 03:48:07 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 21.680000
Oct 06 03:48:08 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 06 03:48:08 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 06 03:48:08 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 06 03:48:08 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 06 03:48:08 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 06 03:48:08 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 06 03:48:08 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 06 03:48:08 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 06 03:48:08 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 06 03:48:08 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 06 03:48:08 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 06 03:48:08 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 06 03:48:08 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 06 03:48:08 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 06 03:48:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 06 03:48:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 06 03:48:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 06 03:48:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 06 03:48:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 06 03:48:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 06 03:48:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 06 03:48:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 06 03:48:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 06 03:48:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 06 03:48:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 06 03:48:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 06 03:48:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 06 03:48:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 06 03:48:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 06 03:48:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 06 03:48:08 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2654, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 06 03:48:08 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 06 03:48:08 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 06 03:48:08 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2654 (ref=pe_calc-dc-1728157688-35406) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 06 03:48:08 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2654 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 06 03:48:08 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 06 03:48:08 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 06 03:48:37 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 14.990000
Oct 06 03:49:07 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 20.360001
Oct 06 03:49:37 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 17.980000
Oct 06 03:50:07 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 15.750000
Oct 06 03:50:37 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.630000
Oct 06 03:51:07 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.600000
Oct 06 03:51:37 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.560000
Oct 06 03:52:07 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 06 03:52:37 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 06 03:53:07 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.430000
Oct 06 03:53:07 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was negligible)
Oct 06 03:53:37 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.700000
Oct 06 03:54:07 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.620000
Oct 06 03:54:37 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.520000
Oct 06 03:54:37 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 03:55:07 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 06 03:55:37 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.090000
Oct 06 03:55:37 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 06 03:56:07 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.970000
Oct 06 03:56:37 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 12.110000
Oct 06 03:57:07 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 13.680000
Oct 06 03:57:37 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.410000
Oct 06 03:58:07 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.620000
Oct 06 03:58:37 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.390000
Oct 06 03:59:07 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.850000
Oct 06 03:59:37 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.930000
Oct 06 04:00:07 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.040000
Oct 06 04:00:07 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 04:00:37 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.920000
Oct 06 04:00:37 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 04:01:07 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.250000
Oct 06 04:01:37 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.890000
Oct 06 04:02:07 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.320000
Oct 06 04:02:07 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 04:02:37 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 06 04:03:08 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 06 04:03:08 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 06 04:03:08 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 06 04:03:08 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 06 04:03:08 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 06 04:03:08 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 06 04:03:08 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 06 04:03:08 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 06 04:03:08 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 06 04:03:08 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 06 04:03:08 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 06 04:03:08 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 06 04:03:08 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 06 04:03:08 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 06 04:03:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 06 04:03:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 06 04:03:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 06 04:03:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 06 04:03:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 06 04:03:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 06 04:03:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 06 04:03:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 06 04:03:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 06 04:03:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 06 04:03:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 06 04:03:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 06 04:03:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 06 04:03:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 06 04:03:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 06 04:03:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 06 04:03:08 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2655, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 06 04:03:08 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 06 04:03:08 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 06 04:03:08 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2655 (ref=pe_calc-dc-1728158588-35417) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 06 04:03:08 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2655 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 06 04:03:08 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 06 04:03:08 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 06 04:04:07 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 06 04:04:37 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.650000
Oct 06 04:04:37 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was negligible)
Oct 06 04:05:07 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 06 04:05:37 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 06 04:06:07 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.120000
Oct 06 04:06:07 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was negligible)
Oct 06 04:06:37 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.060000
Oct 06 04:06:37 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 04:07:07 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.390000
Oct 06 04:07:37 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.310000
Oct 06 04:08:07 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.360000
Oct 06 04:08:07 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 04:08:37 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.690000
Oct 06 04:08:37 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 04:09:07 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.900000
Oct 06 04:09:37 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.860000
Oct 06 04:10:07 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.800000
Oct 06 04:10:37 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.980000
Oct 06 04:10:37 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 04:11:07 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.520000
Oct 06 04:11:07 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 04:11:37 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.260000
Oct 06 04:12:07 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 15.150000
Oct 06 04:12:37 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.120000
Oct 06 04:13:07 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.370000
Oct 06 04:13:07 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 04:13:37 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.400000
Oct 06 04:13:37 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 04:14:07 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.230000
Oct 06 04:14:37 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.770000
Oct 06 04:14:37 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 04:15:07 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.950000
Oct 06 04:15:07 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 04:15:37 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.460000
Oct 06 04:16:07 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 13.270000
Oct 06 04:16:37 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.540000
Oct 06 04:17:07 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.730000
Oct 06 04:17:37 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 06 04:18:07 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.900000
Oct 06 04:18:07 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 06 04:18:08 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 06 04:18:08 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 06 04:18:08 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 06 04:18:08 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 06 04:18:08 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 06 04:18:08 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 06 04:18:08 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 06 04:18:08 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 06 04:18:08 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 06 04:18:08 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 06 04:18:08 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 06 04:18:08 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 06 04:18:08 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 06 04:18:08 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 06 04:18:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 06 04:18:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 06 04:18:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 06 04:18:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 06 04:18:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 06 04:18:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 06 04:18:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 06 04:18:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 06 04:18:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 06 04:18:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 06 04:18:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 06 04:18:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 06 04:18:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 06 04:18:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 06 04:18:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 06 04:18:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 06 04:18:08 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2656, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 06 04:18:08 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 06 04:18:08 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 06 04:18:08 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2656 (ref=pe_calc-dc-1728159488-35434) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 06 04:18:08 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2656 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 06 04:18:08 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 06 04:18:08 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 06 04:18:37 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.690000
Oct 06 04:18:37 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 04:19:07 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.070000
Oct 06 04:19:37 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.130000
Oct 06 04:19:37 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 04:20:07 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was medium)
Oct 06 04:20:37 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.170000
Oct 06 04:20:37 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was negligible)
Oct 06 04:21:07 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.230000
Oct 06 04:21:07 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 04:21:37 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.150000
Oct 06 04:22:07 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.490000
Oct 06 04:22:37 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.490000
Oct 06 04:23:07 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 12.130000
Oct 06 04:23:37 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 12.660000
Oct 06 04:24:07 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.510000
Oct 06 04:24:37 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.090000
Oct 06 04:25:07 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.700000
Oct 06 04:25:37 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.340000
Oct 06 04:26:07 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.970000
Oct 06 04:26:37 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.480000
Oct 06 04:27:07 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.690000
Oct 06 04:27:37 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.530000
Oct 06 04:28:07 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 06 04:28:37 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.010000
Oct 06 04:28:37 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 06 04:29:07 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.000000
Oct 06 04:29:37 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.010000
Oct 06 04:30:07 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.240000
Oct 06 04:30:37 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.720000
Oct 06 04:31:07 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.180000
Oct 06 04:31:37 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.000000
Oct 06 04:31:37 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 04:32:07 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 06 04:32:37 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 06 04:33:08 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 06 04:33:08 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 06 04:33:08 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 06 04:33:08 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 06 04:33:08 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 06 04:33:08 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 06 04:33:08 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 06 04:33:08 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 06 04:33:08 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 06 04:33:08 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 06 04:33:08 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 06 04:33:08 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 06 04:33:08 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 06 04:33:08 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 06 04:33:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 06 04:33:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 06 04:33:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 06 04:33:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 06 04:33:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 06 04:33:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 06 04:33:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 06 04:33:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 06 04:33:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 06 04:33:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 06 04:33:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 06 04:33:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 06 04:33:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 06 04:33:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 06 04:33:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 06 04:33:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 06 04:33:08 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2657, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 06 04:33:08 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 06 04:33:08 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 06 04:33:08 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2657 (ref=pe_calc-dc-1728160388-35445) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 06 04:33:08 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2657 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 06 04:33:08 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 06 04:33:08 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 06 04:33:37 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was negligible)
Oct 06 04:34:07 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.720000
Oct 06 04:34:07 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 06 04:34:37 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.830000
Oct 06 04:34:37 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 04:35:07 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.540000
Oct 06 04:35:07 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 04:35:37 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.310000
Oct 06 04:35:37 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 04:36:07 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.250000
Oct 06 04:36:07 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 04:36:37 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was medium)
Oct 06 04:37:07 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was negligible)
Oct 06 04:37:37 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.570000
Oct 06 04:37:37 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 06 04:38:07 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.480000
Oct 06 04:38:37 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.800000
Oct 06 04:39:07 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.950000
Oct 06 04:39:37 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.490000
Oct 06 04:40:07 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.330000
Oct 06 04:40:37 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.260000
Oct 06 04:40:37 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 04:41:07 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.180000
Oct 06 04:41:37 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.540000
Oct 06 04:41:37 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 04:42:07 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 06 04:42:37 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.370000
Oct 06 04:42:37 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 06 04:43:07 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.650000
Oct 06 04:43:07 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 04:43:37 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.860000
Oct 06 04:44:07 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.420000
Oct 06 04:44:37 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.750000
Oct 06 04:44:37 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 04:45:07 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 06 04:45:37 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.240000
Oct 06 04:45:37 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 06 04:46:07 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.930000
Oct 06 04:46:07 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 04:46:37 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.200000
Oct 06 04:47:07 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.980000
Oct 06 04:47:37 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.340000
Oct 06 04:48:07 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.570000
Oct 06 04:48:08 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 06 04:48:08 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 06 04:48:08 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 06 04:48:08 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 06 04:48:08 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 06 04:48:08 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 06 04:48:08 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 06 04:48:08 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 06 04:48:08 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 06 04:48:08 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 06 04:48:08 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 06 04:48:08 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 06 04:48:08 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 06 04:48:08 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 06 04:48:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 06 04:48:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 06 04:48:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 06 04:48:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 06 04:48:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 06 04:48:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 06 04:48:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 06 04:48:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 06 04:48:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 06 04:48:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 06 04:48:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 06 04:48:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 06 04:48:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 06 04:48:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 06 04:48:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 06 04:48:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 06 04:48:08 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2658, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 06 04:48:08 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 06 04:48:08 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 06 04:48:08 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2658 (ref=pe_calc-dc-1728161288-35464) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 06 04:48:08 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2658 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 06 04:48:08 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 06 04:48:08 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 06 04:48:37 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.830000
Oct 06 04:48:37 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 04:49:07 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 13.170000
Oct 06 04:49:07 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 04:49:37 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.510000
Oct 06 04:50:07 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.620000
Oct 06 04:50:37 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.270000
Oct 06 04:50:37 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 04:51:07 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 06 04:52:07 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.010000
Oct 06 04:52:07 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 06 04:52:37 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.810000
Oct 06 04:52:37 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 04:53:07 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 06 04:53:37 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 06 04:54:07 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was negligible)
Oct 06 04:55:07 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.270000
Oct 06 04:55:07 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 06 04:55:37 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 06 04:56:07 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.660000
Oct 06 04:56:07 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 06 04:56:37 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.930000
Oct 06 04:56:37 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 04:57:07 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.400000
Oct 06 04:57:37 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.290000
Oct 06 04:58:07 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.240000
Oct 06 04:58:07 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 04:58:37 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 06 04:59:07 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.600000
Oct 06 04:59:07 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 06 04:59:37 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.070000
Oct 06 04:59:37 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 05:00:07 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.980000
Oct 06 05:00:37 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.540000
Oct 06 05:00:37 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 05:01:07 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.610000
Oct 06 05:01:37 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.560000
Oct 06 05:02:07 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 06 05:02:37 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.190000
Oct 06 05:02:37 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 06 05:03:07 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.570000
Oct 06 05:03:07 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 05:03:08 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 06 05:03:08 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 06 05:03:08 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 06 05:03:08 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 06 05:03:08 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 06 05:03:08 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 06 05:03:08 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 06 05:03:08 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 06 05:03:08 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 06 05:03:08 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 06 05:03:08 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 06 05:03:08 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 06 05:03:08 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 06 05:03:08 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 06 05:03:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 06 05:03:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 06 05:03:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 06 05:03:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 06 05:03:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 06 05:03:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 06 05:03:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 06 05:03:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 06 05:03:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 06 05:03:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 06 05:03:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 06 05:03:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 06 05:03:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 06 05:03:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 06 05:03:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 06 05:03:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 06 05:03:08 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2659, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 06 05:03:08 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 06 05:03:08 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 06 05:03:08 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2659 (ref=pe_calc-dc-1728162188-35486) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 06 05:03:08 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2659 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 06 05:03:08 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 06 05:03:08 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 06 05:03:37 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.200000
Oct 06 05:04:07 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 13.190000
Oct 06 05:04:37 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.840000
Oct 06 05:05:07 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.240000
Oct 06 05:05:37 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.790000
Oct 06 05:06:07 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.810000
Oct 06 05:06:37 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.060000
Oct 06 05:07:07 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.550000
Oct 06 05:07:37 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.080000
Oct 06 05:08:07 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.520000
Oct 06 05:08:37 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.590000
Oct 06 05:09:07 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 13.440000
Oct 06 05:09:37 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.060000
Oct 06 05:10:07 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.490000
Oct 06 05:10:37 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.630000
Oct 06 05:11:07 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.610000
Oct 06 05:11:37 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.090000
Oct 06 05:12:07 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.540000
Oct 06 05:12:37 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.690000
Oct 06 05:12:37 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 05:13:07 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.710000
Oct 06 05:13:07 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 05:13:37 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.260000
Oct 06 05:14:07 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.110000
Oct 06 05:14:37 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.990000
Oct 06 05:15:07 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.890000
Oct 06 05:15:37 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.940000
Oct 06 05:15:37 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 05:16:07 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 06 05:16:37 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.720000
Oct 06 05:16:37 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 06 05:17:07 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 06 05:18:07 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.310000
Oct 06 05:18:07 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 06 05:18:08 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 06 05:18:08 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 06 05:18:08 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 06 05:18:08 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 06 05:18:08 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 06 05:18:08 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 06 05:18:08 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 06 05:18:08 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 06 05:18:08 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 06 05:18:08 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 06 05:18:08 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 06 05:18:08 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 06 05:18:08 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 06 05:18:08 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 06 05:18:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 06 05:18:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 06 05:18:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 06 05:18:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 06 05:18:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 06 05:18:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 06 05:18:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 06 05:18:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 06 05:18:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 06 05:18:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 06 05:18:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 06 05:18:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 06 05:18:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 06 05:18:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 06 05:18:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 06 05:18:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 06 05:18:08 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2660, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 06 05:18:08 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 06 05:18:08 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 06 05:18:08 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2660 (ref=pe_calc-dc-1728163088-35494) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 06 05:18:08 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2660 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 06 05:18:08 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 06 05:18:08 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 06 05:18:37 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.900000
Oct 06 05:18:37 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 05:19:07 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.250000
Oct 06 05:19:37 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.090000
Oct 06 05:20:07 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.620000
Oct 06 05:20:37 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.860000
Oct 06 05:21:07 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.170000
Oct 06 05:21:37 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.200000
Oct 06 05:22:07 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 06 05:23:37 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 06 05:25:07 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was negligible)
Oct 06 05:25:37 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.520000
Oct 06 05:25:37 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 06 05:26:07 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 06 05:26:37 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.220000
Oct 06 05:26:37 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 06 05:27:07 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.160000
Oct 06 05:27:37 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.520000
Oct 06 05:28:07 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.040000
Oct 06 05:28:07 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 05:28:37 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 06 05:29:07 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.910000
Oct 06 05:29:07 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 06 05:29:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.540000
Oct 06 05:30:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.860000
Oct 06 05:30:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 06 05:31:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.770000
Oct 06 05:31:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 06 05:31:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.260000
Oct 06 05:32:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 06 05:32:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 06 05:33:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.940000
Oct 06 05:33:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was negligible)
Oct 06 05:33:08 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 06 05:33:08 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 06 05:33:08 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 06 05:33:08 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 06 05:33:08 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 06 05:33:08 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 06 05:33:08 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 06 05:33:08 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 06 05:33:08 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 06 05:33:08 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 06 05:33:08 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 06 05:33:08 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 06 05:33:08 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 06 05:33:08 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 06 05:33:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 06 05:33:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 06 05:33:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 06 05:33:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 06 05:33:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 06 05:33:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 06 05:33:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 06 05:33:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 06 05:33:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 06 05:33:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 06 05:33:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 06 05:33:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 06 05:33:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 06 05:33:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 06 05:33:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 06 05:33:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 06 05:33:08 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2661, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 06 05:33:08 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 06 05:33:08 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 06 05:33:08 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2661 (ref=pe_calc-dc-1728163988-35510) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 06 05:33:08 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2661 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 06 05:33:08 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 06 05:33:08 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 06 05:33:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.550000
Oct 06 05:33:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 05:34:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.850000
Oct 06 05:34:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 06 05:35:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 06 05:36:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.470000
Oct 06 05:36:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was negligible)
Oct 06 05:36:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.810000
Oct 06 05:36:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 05:37:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.450000
Oct 06 05:37:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.180000
Oct 06 05:37:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 05:38:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.600000
Oct 06 05:38:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 06 05:39:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.350000
Oct 06 05:39:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 06 05:39:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 06 05:40:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 06 05:40:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was negligible)
Oct 06 05:41:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 06 05:42:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.270000
Oct 06 05:42:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was negligible)
Oct 06 05:42:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 06 05:43:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.800000
Oct 06 05:43:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 06 05:43:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.960000
Oct 06 05:44:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.730000
Oct 06 05:44:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 13.600000
Oct 06 05:45:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.180000
Oct 06 05:45:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 12.890000
Oct 06 05:46:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 12.290000
Oct 06 05:46:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 12.940000
Oct 06 05:47:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.750000
Oct 06 05:47:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.630000
Oct 06 05:48:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.880000
Oct 06 05:48:08 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 06 05:48:08 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 06 05:48:08 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 06 05:48:08 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 06 05:48:08 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 06 05:48:08 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 06 05:48:08 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 06 05:48:08 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 06 05:48:08 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 06 05:48:08 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 06 05:48:08 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 06 05:48:08 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 06 05:48:08 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 06 05:48:08 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 06 05:48:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 06 05:48:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 06 05:48:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 06 05:48:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 06 05:48:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 06 05:48:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 06 05:48:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 06 05:48:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 06 05:48:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 06 05:48:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 06 05:48:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 06 05:48:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 06 05:48:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 06 05:48:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 06 05:48:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 06 05:48:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 06 05:48:08 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2662, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 06 05:48:08 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 06 05:48:08 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 06 05:48:08 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2662 (ref=pe_calc-dc-1728164888-35526) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 06 05:48:08 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2662 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 06 05:48:08 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 06 05:48:08 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 06 05:48:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.870000
Oct 06 05:49:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.050000
Oct 06 05:49:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.910000
Oct 06 05:50:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.080000
Oct 06 05:50:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 05:50:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.190000
Oct 06 05:50:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 05:51:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.620000
Oct 06 05:51:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 06 05:53:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.620000
Oct 06 05:53:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 06 05:53:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 12.820000
Oct 06 05:53:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 05:54:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.320000
Oct 06 05:54:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.030000
Oct 06 05:55:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.580000
Oct 06 05:55:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.000000
Oct 06 05:56:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.440000
Oct 06 05:56:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 05:56:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was medium)
Oct 06 05:57:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.410000
Oct 06 05:57:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was negligible)
Oct 06 05:57:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.050000
Oct 06 05:58:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 06 05:58:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.380000
Oct 06 05:58:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 06 05:59:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 06 05:59:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.120000
Oct 06 05:59:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 06 06:00:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.670000
Oct 06 06:00:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.220000
Oct 06 06:00:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 06:01:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.880000
Oct 06 06:01:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.890000
Oct 06 06:01:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 06:02:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.240000
Oct 06 06:02:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 06:02:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.710000
Oct 06 06:02:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 06:03:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.700000
Oct 06 06:03:08 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 06 06:03:08 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 06 06:03:08 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 06 06:03:08 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 06 06:03:08 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 06 06:03:08 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 06 06:03:08 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 06 06:03:08 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 06 06:03:08 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 06 06:03:08 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 06 06:03:08 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 06 06:03:08 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 06 06:03:08 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 06 06:03:08 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 06 06:03:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 06 06:03:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 06 06:03:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 06 06:03:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 06 06:03:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 06 06:03:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 06 06:03:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 06 06:03:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 06 06:03:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 06 06:03:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 06 06:03:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 06 06:03:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 06 06:03:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 06 06:03:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 06 06:03:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 06 06:03:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 06 06:03:08 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2663, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 06 06:03:08 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 06 06:03:08 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 06 06:03:08 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2663 (ref=pe_calc-dc-1728165788-35543) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 06 06:03:08 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2663 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 06 06:03:08 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 06 06:03:08 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 06 06:03:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.960000
Oct 06 06:03:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 06:04:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.880000
Oct 06 06:04:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 06:04:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.450000
Oct 06 06:05:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.320000
Oct 06 06:05:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 06:05:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 06 06:06:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 06 06:07:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was negligible)
Oct 06 06:07:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 06 06:08:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was negligible)
Oct 06 06:09:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.220000
Oct 06 06:09:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 06 06:10:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.480000
Oct 06 06:10:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 06:10:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 06 06:11:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.570000
Oct 06 06:11:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 06 06:11:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was medium)
Oct 06 06:12:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was negligible)
Oct 06 06:12:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.210000
Oct 06 06:12:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 06 06:13:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.380000
Oct 06 06:13:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 06:13:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.240000
Oct 06 06:14:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 06 06:14:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.390000
Oct 06 06:14:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 06 06:15:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.030000
Oct 06 06:15:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 06 06:16:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 06 06:16:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.570000
Oct 06 06:16:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was negligible)
Oct 06 06:17:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 06 06:17:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 06 06:18:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.970000
Oct 06 06:18:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was negligible)
Oct 06 06:18:08 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 06 06:18:08 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 06 06:18:08 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 06 06:18:08 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 06 06:18:08 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 06 06:18:08 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 06 06:18:08 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 06 06:18:08 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 06 06:18:08 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 06 06:18:08 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 06 06:18:08 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 06 06:18:08 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 06 06:18:08 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 06 06:18:08 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 06 06:18:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 06 06:18:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 06 06:18:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 06 06:18:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 06 06:18:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 06 06:18:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 06 06:18:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 06 06:18:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 06 06:18:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 06 06:18:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 06 06:18:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 06 06:18:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 06 06:18:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 06 06:18:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 06 06:18:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 06 06:18:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 06 06:18:08 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2664, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 06 06:18:08 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 06 06:18:08 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 06 06:18:08 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2664 (ref=pe_calc-dc-1728166688-35568) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 06 06:18:08 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2664 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 06 06:18:08 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 06 06:18:08 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 06 06:18:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.250000
Oct 06 06:19:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.670000
Oct 06 06:19:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 06:19:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.430000
Oct 06 06:20:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.470000
Oct 06 06:20:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.040000
Oct 06 06:20:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 06:21:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.630000
Oct 06 06:21:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.980000
Oct 06 06:22:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.950000
Oct 06 06:22:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 06:22:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.260000
Oct 06 06:23:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.890000
Oct 06 06:23:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.920000
Oct 06 06:24:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.450000
Oct 06 06:24:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.940000
Oct 06 06:24:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 06:25:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 14.380000
Oct 06 06:25:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 06:25:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 14.720000
Oct 06 06:26:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.160000
Oct 06 06:26:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 12.810000
Oct 06 06:27:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.350000
Oct 06 06:27:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.260000
Oct 06 06:28:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.810000
Oct 06 06:28:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.680000
Oct 06 06:29:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.170000
Oct 06 06:29:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.170000
Oct 06 06:29:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 06:30:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 06 06:30:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 06 06:31:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.390000
Oct 06 06:31:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was negligible)
Oct 06 06:31:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.770000
Oct 06 06:32:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.610000
Oct 06 06:32:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 06:32:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 06 06:33:08 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 06 06:33:08 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 06 06:33:08 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 06 06:33:08 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 06 06:33:08 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 06 06:33:08 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 06 06:33:08 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 06 06:33:08 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 06 06:33:08 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 06 06:33:08 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 06 06:33:08 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 06 06:33:08 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 06 06:33:08 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 06 06:33:08 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 06 06:33:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 06 06:33:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 06 06:33:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 06 06:33:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 06 06:33:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 06 06:33:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 06 06:33:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 06 06:33:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 06 06:33:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 06 06:33:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 06 06:33:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 06 06:33:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 06 06:33:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 06 06:33:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 06 06:33:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 06 06:33:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 06 06:33:08 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2665, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 06 06:33:08 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 06 06:33:08 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 06 06:33:08 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2665 (ref=pe_calc-dc-1728167588-35580) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 06 06:33:08 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2665 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 06 06:33:08 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 06 06:33:08 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 06 06:33:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 06 06:35:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was negligible)
Oct 06 06:36:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.630000
Oct 06 06:36:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 06 06:36:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.230000
Oct 06 06:37:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.270000
Oct 06 06:37:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 06:37:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.980000
Oct 06 06:37:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 06:38:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 06 06:40:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.610000
Oct 06 06:40:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 06 06:40:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.610000
Oct 06 06:41:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.750000
Oct 06 06:41:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.970000
Oct 06 06:42:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.580000
Oct 06 06:42:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 06:42:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.530000
Oct 06 06:42:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 06:43:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.950000
Oct 06 06:43:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.180000
Oct 06 06:43:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 06:44:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.670000
Oct 06 06:44:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.730000
Oct 06 06:44:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 06:45:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.240000
Oct 06 06:45:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.350000
Oct 06 06:46:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.860000
Oct 06 06:46:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 06:46:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.170000
Oct 06 06:46:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 06:47:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.310000
Oct 06 06:47:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.470000
Oct 06 06:47:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 06:48:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 06 06:48:08 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 06 06:48:08 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 06 06:48:08 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 06 06:48:08 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 06 06:48:08 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 06 06:48:08 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 06 06:48:08 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 06 06:48:08 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 06 06:48:08 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 06 06:48:08 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 06 06:48:08 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 06 06:48:08 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 06 06:48:08 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 06 06:48:08 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 06 06:48:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 06 06:48:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 06 06:48:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 06 06:48:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 06 06:48:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 06 06:48:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 06 06:48:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 06 06:48:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 06 06:48:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 06 06:48:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 06 06:48:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 06 06:48:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 06 06:48:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 06 06:48:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 06 06:48:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 06 06:48:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 06 06:48:08 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2666, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 06 06:48:08 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 06 06:48:08 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 06 06:48:08 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2666 (ref=pe_calc-dc-1728168488-35596) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 06 06:48:08 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2666 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 06 06:48:08 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 06 06:48:08 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 06 06:48:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.840000
Oct 06 06:48:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 06 06:49:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.480000
Oct 06 06:49:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 06:49:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.470000
Oct 06 06:50:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.700000
Oct 06 06:50:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 06:50:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was medium)
Oct 06 06:51:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.690000
Oct 06 06:51:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was negligible)
Oct 06 06:51:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.260000
Oct 06 06:52:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.280000
Oct 06 06:52:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 06:52:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.580000
Oct 06 06:53:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.210000
Oct 06 06:53:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.900000
Oct 06 06:53:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 06:54:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 06 06:54:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 06 06:55:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.420000
Oct 06 06:55:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was negligible)
Oct 06 06:55:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.280000
Oct 06 06:55:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 06:56:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.050000
Oct 06 06:56:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 06:56:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.490000
Oct 06 06:56:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 06:57:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.530000
Oct 06 06:57:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.220000
Oct 06 06:58:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.150000
Oct 06 06:58:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.140000
Oct 06 06:58:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 06:59:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.540000
Oct 06 06:59:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.190000
Oct 06 07:00:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.160000
Oct 06 07:00:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 06 07:01:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 06 07:01:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was negligible)
Oct 06 07:02:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 06 07:02:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.440000
Oct 06 07:02:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was negligible)
Oct 06 07:03:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.290000
Oct 06 07:03:08 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 06 07:03:08 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 06 07:03:08 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 06 07:03:08 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 06 07:03:08 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 06 07:03:08 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 06 07:03:08 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 06 07:03:08 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 06 07:03:08 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 06 07:03:08 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 06 07:03:08 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 06 07:03:08 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 06 07:03:08 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 06 07:03:08 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 06 07:03:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 06 07:03:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 06 07:03:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 06 07:03:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 06 07:03:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 06 07:03:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 06 07:03:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 06 07:03:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 06 07:03:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 06 07:03:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 06 07:03:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 06 07:03:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 06 07:03:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 06 07:03:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 06 07:03:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 06 07:03:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 06 07:03:08 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2667, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 06 07:03:08 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 06 07:03:08 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 06 07:03:08 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2667 (ref=pe_calc-dc-1728169388-35616) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 06 07:03:08 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2667 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 06 07:03:08 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 06 07:03:08 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 06 07:03:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.420000
Oct 06 07:04:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.590000
Oct 06 07:04:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 07:04:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 06 07:05:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.470000
Oct 06 07:05:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 06 07:05:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.210000
Oct 06 07:06:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.550000
Oct 06 07:06:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 06 07:07:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.300000
Oct 06 07:07:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 06 07:07:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 06 07:08:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.040000
Oct 06 07:08:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 06 07:08:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 06 07:09:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 06 07:10:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.160000
Oct 06 07:10:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was negligible)
Oct 06 07:10:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 06 07:11:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 06 07:13:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.360000
Oct 06 07:13:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was negligible)
Oct 06 07:14:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.140000
Oct 06 07:14:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.340000
Oct 06 07:15:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.890000
Oct 06 07:15:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 07:15:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 06 07:16:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.140000
Oct 06 07:16:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 06 07:16:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 06 07:17:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.870000
Oct 06 07:17:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 06 07:17:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.700000
Oct 06 07:17:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 07:18:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.600000
Oct 06 07:18:08 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 06 07:18:08 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 06 07:18:08 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 06 07:18:08 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 06 07:18:08 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 06 07:18:08 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 06 07:18:08 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 06 07:18:08 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 06 07:18:08 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 06 07:18:08 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 06 07:18:08 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 06 07:18:08 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 06 07:18:08 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 06 07:18:08 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 06 07:18:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 06 07:18:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 06 07:18:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 06 07:18:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 06 07:18:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 06 07:18:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 06 07:18:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 06 07:18:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 06 07:18:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 06 07:18:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 06 07:18:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 06 07:18:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 06 07:18:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 06 07:18:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 06 07:18:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 06 07:18:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 06 07:18:08 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2668, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 06 07:18:08 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 06 07:18:08 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 06 07:18:08 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2668 (ref=pe_calc-dc-1728170288-35636) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 06 07:18:08 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2668 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 06 07:18:08 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 06 07:18:08 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 06 07:18:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 06 07:19:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.930000
Oct 06 07:19:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 06 07:19:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.310000
Oct 06 07:19:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 07:20:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 06 07:20:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.360000
Oct 06 07:20:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 06 07:21:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.160000
Oct 06 07:21:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.430000
Oct 06 07:22:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 14.990000
Oct 06 07:22:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.430000
Oct 06 07:23:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.100000
Oct 06 07:23:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.130000
Oct 06 07:24:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.590000
Oct 06 07:24:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 07:24:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.930000
Oct 06 07:24:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 07:25:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.830000
Oct 06 07:25:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.660000
Oct 06 07:26:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 06 07:26:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.920000
Oct 06 07:26:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 06 07:27:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 06 07:27:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 06 07:28:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was negligible)
Oct 06 07:28:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.490000
Oct 06 07:28:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 06 07:29:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.060000
Oct 06 07:29:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 07:29:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.860000
Oct 06 07:29:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 07:30:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.160000
Oct 06 07:30:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.740000
Oct 06 07:30:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 07:31:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.750000
Oct 06 07:31:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.600000
Oct 06 07:32:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.570000
Oct 06 07:32:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 14.120000
Oct 06 07:33:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.180000
Oct 06 07:33:08 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 06 07:33:08 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 06 07:33:08 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 06 07:33:08 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 06 07:33:08 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 06 07:33:08 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 06 07:33:08 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 06 07:33:08 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 06 07:33:08 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 06 07:33:08 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 06 07:33:08 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 06 07:33:08 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 06 07:33:08 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 06 07:33:08 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 06 07:33:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 06 07:33:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 06 07:33:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 06 07:33:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 06 07:33:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 06 07:33:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 06 07:33:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 06 07:33:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 06 07:33:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 06 07:33:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 06 07:33:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 06 07:33:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 06 07:33:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 06 07:33:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 06 07:33:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 06 07:33:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 06 07:33:08 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2669, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 06 07:33:08 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 06 07:33:08 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 06 07:33:08 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2669 (ref=pe_calc-dc-1728171188-35653) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 06 07:33:08 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2669 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 06 07:33:08 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 06 07:33:08 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 06 07:33:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.090000
Oct 06 07:34:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 06 07:35:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.300000
Oct 06 07:35:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 06 07:35:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was medium)
Oct 06 07:36:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.040000
Oct 06 07:36:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was negligible)
Oct 06 07:36:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.390000
Oct 06 07:37:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.780000
Oct 06 07:37:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.540000
Oct 06 07:38:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.050000
Oct 06 07:38:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.240000
Oct 06 07:39:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.650000
Oct 06 07:39:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.360000
Oct 06 07:40:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.100000
Oct 06 07:40:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 07:40:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.570000
Oct 06 07:41:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.260000
Oct 06 07:41:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 07:41:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.020000
Oct 06 07:42:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.530000
Oct 06 07:42:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.360000
Oct 06 07:42:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 07:43:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 06 07:44:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 06 07:44:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was negligible)
Oct 06 07:45:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 06 07:46:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was negligible)
Oct 06 07:46:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 06 07:47:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.190000
Oct 06 07:47:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was negligible)
Oct 06 07:47:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.540000
Oct 06 07:47:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 07:48:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 06 07:48:08 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 06 07:48:08 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 06 07:48:08 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 06 07:48:08 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 06 07:48:08 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 06 07:48:08 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 06 07:48:08 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 06 07:48:08 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 06 07:48:08 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 06 07:48:08 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 06 07:48:08 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 06 07:48:08 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 06 07:48:08 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 06 07:48:08 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 06 07:48:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 06 07:48:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 06 07:48:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 06 07:48:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 06 07:48:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 06 07:48:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 06 07:48:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 06 07:48:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 06 07:48:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 06 07:48:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 06 07:48:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 06 07:48:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 06 07:48:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 06 07:48:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 06 07:48:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 06 07:48:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 06 07:48:08 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2670, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 06 07:48:08 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 06 07:48:08 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 06 07:48:08 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2670 (ref=pe_calc-dc-1728172088-35670) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 06 07:48:08 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2670 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 06 07:48:08 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 06 07:48:08 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 06 07:49:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 06 07:50:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.900000
Oct 06 07:50:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was negligible)
Oct 06 07:50:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.400000
Oct 06 07:51:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 06 07:51:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.920000
Oct 06 07:51:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 06 07:52:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 06 07:52:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.390000
Oct 06 07:52:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 06 07:53:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.740000
Oct 06 07:53:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 07:53:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was medium)
Oct 06 07:54:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.920000
Oct 06 07:54:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was negligible)
Oct 06 07:55:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.390000
Oct 06 07:55:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.690000
Oct 06 07:55:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 07:56:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.100000
Oct 06 07:56:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 07:56:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.890000
Oct 06 07:57:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.500000
Oct 06 07:57:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.410000
Oct 06 07:58:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.170000
Oct 06 07:58:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.990000
Oct 06 07:59:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.990000
Oct 06 07:59:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.880000
Oct 06 08:00:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.910000
Oct 06 08:00:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.630000
Oct 06 08:01:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 06 08:01:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 06 08:02:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was negligible)
Oct 06 08:03:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.330000
Oct 06 08:03:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 06 08:03:08 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 06 08:03:08 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 06 08:03:08 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 06 08:03:08 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 06 08:03:08 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 06 08:03:08 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 06 08:03:08 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 06 08:03:08 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 06 08:03:08 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 06 08:03:08 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 06 08:03:08 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 06 08:03:08 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 06 08:03:08 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 06 08:03:08 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 06 08:03:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 06 08:03:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 06 08:03:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 06 08:03:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 06 08:03:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 06 08:03:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 06 08:03:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 06 08:03:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 06 08:03:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 06 08:03:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 06 08:03:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 06 08:03:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 06 08:03:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 06 08:03:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 06 08:03:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 06 08:03:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 06 08:03:08 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2671, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 06 08:03:08 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 06 08:03:08 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 06 08:03:08 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2671 (ref=pe_calc-dc-1728172988-35686) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 06 08:03:08 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2671 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 06 08:03:08 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 06 08:03:08 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 06 08:03:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.180000
Oct 06 08:03:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 08:04:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 06 08:04:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.780000
Oct 06 08:04:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 06 08:05:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 06 08:05:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 06 08:06:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.270000
Oct 06 08:06:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was negligible)
Oct 06 08:06:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 06 08:07:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 06 08:08:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was negligible)
Oct 06 08:09:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 06 08:09:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.740000
Oct 06 08:09:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was negligible)
Oct 06 08:10:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.270000
Oct 06 08:10:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 06 08:11:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.290000
Oct 06 08:11:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 06 08:11:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.570000
Oct 06 08:11:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 08:12:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 06 08:12:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.230000
Oct 06 08:12:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 06 08:13:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 06 08:13:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.650000
Oct 06 08:13:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 06 08:14:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.600000
Oct 06 08:14:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.460000
Oct 06 08:15:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.910000
Oct 06 08:15:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 08:15:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 06 08:16:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.240000
Oct 06 08:16:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 06 08:17:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.610000
Oct 06 08:17:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 08:17:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.130000
Oct 06 08:18:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.210000
Oct 06 08:18:08 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 06 08:18:08 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 06 08:18:08 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 06 08:18:08 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 06 08:18:08 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 06 08:18:08 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 06 08:18:08 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 06 08:18:08 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 06 08:18:08 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 06 08:18:08 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 06 08:18:08 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 06 08:18:08 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 06 08:18:08 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 06 08:18:08 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 06 08:18:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 06 08:18:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 06 08:18:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 06 08:18:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 06 08:18:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 06 08:18:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 06 08:18:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 06 08:18:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 06 08:18:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 06 08:18:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 06 08:18:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 06 08:18:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 06 08:18:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 06 08:18:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 06 08:18:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 06 08:18:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 06 08:18:08 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2672, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 06 08:18:08 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 06 08:18:08 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 06 08:18:08 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2672 (ref=pe_calc-dc-1728173888-35709) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 06 08:18:08 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2672 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 06 08:18:08 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 06 08:18:08 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 06 08:18:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 06 08:19:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 06 08:20:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was negligible)
Oct 06 08:20:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.930000
Oct 06 08:20:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 06 08:21:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 06 08:21:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 06 08:22:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.710000
Oct 06 08:22:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was negligible)
Oct 06 08:22:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.980000
Oct 06 08:23:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.310000
Oct 06 08:23:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.970000
Oct 06 08:24:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.920000
Oct 06 08:24:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.540000
Oct 06 08:25:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 06 08:26:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 06 08:27:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 13.500000
Oct 06 08:27:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was negligible)
Oct 06 08:28:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 13.690000
Oct 06 08:28:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 21.180000
Oct 06 08:29:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 17.160000
Oct 06 08:29:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 12.960000
Oct 06 08:30:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.170000
Oct 06 08:30:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.760000
Oct 06 08:31:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.350000
Oct 06 08:31:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.760000
Oct 06 08:32:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.400000
Oct 06 08:32:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 08:32:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.910000
Oct 06 08:32:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 08:33:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.430000
Oct 06 08:33:08 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 06 08:33:08 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 06 08:33:08 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 06 08:33:08 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 06 08:33:08 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 06 08:33:08 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 06 08:33:08 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 06 08:33:08 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 06 08:33:08 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 06 08:33:08 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 06 08:33:08 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 06 08:33:08 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 06 08:33:08 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 06 08:33:08 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 06 08:33:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 06 08:33:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 06 08:33:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 06 08:33:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 06 08:33:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 06 08:33:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 06 08:33:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 06 08:33:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 06 08:33:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 06 08:33:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 06 08:33:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 06 08:33:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 06 08:33:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 06 08:33:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 06 08:33:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 06 08:33:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 06 08:33:08 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2673, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 06 08:33:08 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 06 08:33:08 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 06 08:33:08 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2673 (ref=pe_calc-dc-1728174788-35722) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 06 08:33:08 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2673 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 06 08:33:08 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 06 08:33:08 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 06 08:33:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 06 08:34:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.660000
Oct 06 08:34:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 06 08:34:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.360000
Oct 06 08:34:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 08:35:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.850000
Oct 06 08:35:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 08:35:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.490000
Oct 06 08:35:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 08:36:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was medium)
Oct 06 08:37:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was negligible)
Oct 06 08:37:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.750000
Oct 06 08:37:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 06 08:38:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.130000
Oct 06 08:38:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 06 08:39:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.780000
Oct 06 08:39:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 06 08:40:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.590000
Oct 06 08:40:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.170000
Oct 06 08:41:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.240000
Oct 06 08:41:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 08:41:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.080000
Oct 06 08:42:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 06 08:43:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.710000
Oct 06 08:43:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 06 08:43:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 06 08:44:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 06 08:44:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was negligible)
Oct 06 08:45:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 06 08:45:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.290000
Oct 06 08:45:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was negligible)
Oct 06 08:46:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.250000
Oct 06 08:46:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 08:46:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.030000
Oct 06 08:47:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.230000
Oct 06 08:47:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.450000
Oct 06 08:48:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.240000
Oct 06 08:48:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 08:48:08 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 06 08:48:08 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 06 08:48:08 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 06 08:48:08 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 06 08:48:08 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 06 08:48:08 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 06 08:48:08 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 06 08:48:08 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 06 08:48:08 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 06 08:48:08 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 06 08:48:08 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 06 08:48:08 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 06 08:48:08 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 06 08:48:08 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 06 08:48:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 06 08:48:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 06 08:48:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 06 08:48:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 06 08:48:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 06 08:48:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 06 08:48:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 06 08:48:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 06 08:48:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 06 08:48:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 06 08:48:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 06 08:48:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 06 08:48:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 06 08:48:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 06 08:48:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 06 08:48:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 06 08:48:08 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2674, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 06 08:48:08 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 06 08:48:08 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 06 08:48:08 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2674 (ref=pe_calc-dc-1728175688-35743) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 06 08:48:08 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2674 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 06 08:48:08 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 06 08:48:08 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 06 08:48:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 06 08:49:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 06 08:50:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.030000
Oct 06 08:50:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was negligible)
Oct 06 08:50:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.840000
Oct 06 08:51:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.420000
Oct 06 08:51:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 08:51:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 06 08:53:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.910000
Oct 06 08:53:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 06 08:54:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.340000
Oct 06 08:54:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.520000
Oct 06 08:55:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.470000
Oct 06 08:55:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 08:55:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 06 08:56:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 06 08:58:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.800000
Oct 06 08:58:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was negligible)
Oct 06 08:59:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.200000
Oct 06 08:59:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 08:59:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 06 09:00:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 13.650000
Oct 06 09:00:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 06 09:01:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 12.050000
Oct 06 09:01:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.730000
Oct 06 09:02:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.540000
Oct 06 09:02:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 14.790000
Oct 06 09:03:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 16.820000
Oct 06 09:03:08 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 06 09:03:08 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 06 09:03:08 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 06 09:03:08 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 06 09:03:08 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 06 09:03:08 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 06 09:03:08 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 06 09:03:08 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 06 09:03:08 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 06 09:03:08 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 06 09:03:08 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 06 09:03:08 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 06 09:03:08 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 06 09:03:08 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 06 09:03:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 06 09:03:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 06 09:03:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 06 09:03:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 06 09:03:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 06 09:03:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 06 09:03:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 06 09:03:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 06 09:03:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 06 09:03:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 06 09:03:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 06 09:03:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 06 09:03:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 06 09:03:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 06 09:03:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 06 09:03:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 06 09:03:08 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2675, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 06 09:03:08 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 06 09:03:08 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 06 09:03:08 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2675 (ref=pe_calc-dc-1728176588-35757) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 06 09:03:08 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2675 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 06 09:03:08 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 06 09:03:08 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 06 09:03:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 12.210000
Oct 06 09:04:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.210000
Oct 06 09:04:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.380000
Oct 06 09:05:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.350000
Oct 06 09:05:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.200000
Oct 06 09:05:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 09:06:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.570000
Oct 06 09:06:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 09:06:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.220000
Oct 06 09:06:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 09:07:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 06 09:08:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 06 09:09:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.760000
Oct 06 09:09:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was negligible)
Oct 06 09:10:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.150000
Oct 06 09:10:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.000000
Oct 06 09:11:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 06 09:12:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 06 09:12:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.680000
Oct 06 09:12:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was negligible)
Oct 06 09:13:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 06 09:13:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 06 09:14:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was negligible)
Oct 06 09:14:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.000000
Oct 06 09:14:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 06 09:15:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.900000
Oct 06 09:15:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 09:15:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.950000
Oct 06 09:16:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.360000
Oct 06 09:16:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 09:16:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 06 09:17:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 06 09:18:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was negligible)
Oct 06 09:18:08 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 06 09:18:08 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 06 09:18:08 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 06 09:18:08 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 06 09:18:08 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 06 09:18:08 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 06 09:18:08 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 06 09:18:08 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 06 09:18:08 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 06 09:18:08 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 06 09:18:08 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 06 09:18:08 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 06 09:18:08 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 06 09:18:08 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 06 09:18:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 06 09:18:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 06 09:18:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 06 09:18:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 06 09:18:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 06 09:18:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 06 09:18:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 06 09:18:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 06 09:18:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 06 09:18:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 06 09:18:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 06 09:18:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 06 09:18:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 06 09:18:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 06 09:18:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 06 09:18:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 06 09:18:08 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2676, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 06 09:18:08 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 06 09:18:08 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 06 09:18:08 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2676 (ref=pe_calc-dc-1728177488-35776) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 06 09:18:08 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2676 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 06 09:18:08 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 06 09:18:08 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 06 09:18:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 06 09:19:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.210000
Oct 06 09:19:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was negligible)
Oct 06 09:19:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 06 09:20:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 06 09:20:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.120000
Oct 06 09:20:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was negligible)
Oct 06 09:21:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 06 09:21:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 06 09:22:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was negligible)
Oct 06 09:23:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 06 09:23:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was negligible)
Oct 06 09:24:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 15.980000
Oct 06 09:24:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 06 09:25:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.500000
Oct 06 09:25:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.960000
Oct 06 09:26:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.380000
Oct 06 09:26:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.260000
Oct 06 09:27:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.580000
Oct 06 09:27:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.870000
Oct 06 09:28:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.140000
Oct 06 09:28:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.700000
Oct 06 09:29:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 06 09:29:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.840000
Oct 06 09:29:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 06 09:30:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.440000
Oct 06 09:30:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 09:30:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.780000
Oct 06 09:30:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 09:31:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.230000
Oct 06 09:31:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.870000
Oct 06 09:32:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.120000
Oct 06 09:32:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 09:32:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.800000
Oct 06 09:32:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 09:33:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.430000
Oct 06 09:33:08 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 06 09:33:08 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 06 09:33:08 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 06 09:33:08 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 06 09:33:08 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 06 09:33:08 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 06 09:33:08 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 06 09:33:08 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 06 09:33:08 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 06 09:33:08 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 06 09:33:08 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 06 09:33:08 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 06 09:33:08 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 06 09:33:08 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 06 09:33:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 06 09:33:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 06 09:33:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 06 09:33:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 06 09:33:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 06 09:33:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 06 09:33:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 06 09:33:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 06 09:33:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 06 09:33:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 06 09:33:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 06 09:33:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 06 09:33:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 06 09:33:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 06 09:33:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 06 09:33:08 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 06 09:33:08 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2677, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 06 09:33:08 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 06 09:33:08 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 06 09:33:08 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2677 (ref=pe_calc-dc-1728178388-35794) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 06 09:33:08 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2677 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 06 09:33:08 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 06 09:33:08 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 06 09:33:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.020000
Oct 06 09:34:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.220000
Oct 06 09:34:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.070000
Oct 06 09:34:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 09:35:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 06 09:35:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.180000
Oct 06 09:35:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 06 09:36:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was medium)
Oct 06 09:36:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.500000
Oct 06 09:36:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was negligible)
Oct 06 09:37:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.960000
Oct 06 09:37:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.320000
Oct 06 09:38:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.300000
Oct 06 09:38:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 14.030000
Oct 06 09:39:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.260000
Oct 06 09:39:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.300000
Oct 06 09:40:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.180000
Oct 06 09:40:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.180000
Oct 06 09:40:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 09:41:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 06 09:42:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 06 09:43:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.860000
Oct 06 09:43:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was negligible)
Oct 06 09:44:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 06 09:44:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.980000
Oct 06 09:44:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 06 09:45:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.780000
Oct 06 09:45:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.610000
Oct 06 09:46:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.980000
Oct 06 09:46:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.260000
Oct 06 09:47:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.380000
Oct 06 09:47:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.410000
Oct 06 09:48:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.200000
Oct 06 09:48:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 09:48:08 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 06 09:48:08 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 06 09:48:08 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 06 09:48:09 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 06 09:48:09 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 06 09:48:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 06 09:48:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 06 09:48:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 06 09:48:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 06 09:48:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 06 09:48:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 06 09:48:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 06 09:48:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 06 09:48:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 06 09:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 06 09:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 06 09:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 06 09:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 06 09:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 06 09:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 06 09:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 06 09:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 06 09:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 06 09:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 06 09:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 06 09:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 06 09:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 06 09:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 06 09:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 06 09:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 06 09:48:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2678, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 06 09:48:09 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 06 09:48:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 06 09:48:09 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2678 (ref=pe_calc-dc-1728179289-35807) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 06 09:48:09 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2678 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 06 09:48:09 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 06 09:48:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 06 09:48:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.750000
Oct 06 09:49:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.290000
Oct 06 09:49:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.650000
Oct 06 09:49:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 09:50:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.630000
Oct 06 09:50:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.430000
Oct 06 09:50:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 09:51:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.260000
Oct 06 09:51:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 09:51:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.290000
Oct 06 09:52:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.120000
Oct 06 09:52:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.730000
Oct 06 09:53:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.550000
Oct 06 09:53:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.770000
Oct 06 09:54:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.370000
Oct 06 09:54:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 09:54:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.930000
Oct 06 09:54:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 09:55:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.000000
Oct 06 09:55:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 09:55:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.130000
Oct 06 09:56:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.150000
Oct 06 09:56:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.320000
Oct 06 09:57:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.230000
Oct 06 09:57:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.010000
Oct 06 09:58:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.680000
Oct 06 09:58:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.430000
Oct 06 09:58:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 09:59:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 06 09:59:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 06 10:00:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.270000
Oct 06 10:00:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was negligible)
Oct 06 10:00:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.890000
Oct 06 10:01:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.730000
Oct 06 10:01:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 10:01:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.180000
Oct 06 10:02:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 06 10:02:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.650000
Oct 06 10:02:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 06 10:03:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.610000
Oct 06 10:03:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 10:03:09 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 06 10:03:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 06 10:03:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 06 10:03:09 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 06 10:03:09 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 06 10:03:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 06 10:03:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 06 10:03:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 06 10:03:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 06 10:03:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 06 10:03:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 06 10:03:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 06 10:03:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 06 10:03:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 06 10:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 06 10:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 06 10:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 06 10:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 06 10:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 06 10:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 06 10:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 06 10:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 06 10:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 06 10:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 06 10:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 06 10:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 06 10:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 06 10:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 06 10:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 06 10:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 06 10:03:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2679, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 06 10:03:09 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 06 10:03:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 06 10:03:09 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2679 (ref=pe_calc-dc-1728180189-35822) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 06 10:03:09 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2679 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 06 10:03:09 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 06 10:03:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 06 10:03:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.440000
Oct 06 10:03:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 10:04:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.810000
Oct 06 10:04:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 10:04:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.760000
Oct 06 10:04:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 10:05:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.020000
Oct 06 10:05:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.620000
Oct 06 10:06:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.180000
Oct 06 10:06:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.780000
Oct 06 10:07:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 06 10:07:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.090000
Oct 06 10:07:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 06 10:08:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.730000
Oct 06 10:08:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.110000
Oct 06 10:08:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 10:09:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.220000
Oct 06 10:09:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 10:09:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.710000
Oct 06 10:10:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.100000
Oct 06 10:10:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.640000
Oct 06 10:11:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.050000
Oct 06 10:11:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.980000
Oct 06 10:12:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.350000
Oct 06 10:12:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 10:12:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.140000
Oct 06 10:13:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.280000
Oct 06 10:13:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was medium)
Oct 06 10:14:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.370000
Oct 06 10:14:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was negligible)
Oct 06 10:14:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.020000
Oct 06 10:14:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 10:15:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.620000
Oct 06 10:15:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 10:15:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.240000
Oct 06 10:16:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 06 10:17:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.160000
Oct 06 10:17:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 06 10:17:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.380000
Oct 06 10:18:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.330000
Oct 06 10:18:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 10:18:09 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 06 10:18:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 06 10:18:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 06 10:18:09 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 06 10:18:09 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 06 10:18:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 06 10:18:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 06 10:18:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 06 10:18:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 06 10:18:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 06 10:18:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 06 10:18:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 06 10:18:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 06 10:18:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 06 10:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 06 10:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 06 10:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 06 10:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 06 10:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 06 10:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 06 10:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 06 10:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 06 10:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 06 10:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 06 10:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 06 10:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 06 10:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 06 10:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 06 10:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 06 10:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 06 10:18:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2680, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 06 10:18:09 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 06 10:18:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 06 10:18:09 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2680 (ref=pe_calc-dc-1728181089-35838) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 06 10:18:09 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2680 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 06 10:18:09 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 06 10:18:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 06 10:18:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.250000
Oct 06 10:18:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 10:19:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.310000
Oct 06 10:19:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 06 10:20:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.970000
Oct 06 10:20:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 06 10:20:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.430000
Oct 06 10:20:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 10:21:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.680000
Oct 06 10:21:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.530000
Oct 06 10:22:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.150000
Oct 06 10:22:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.400000
Oct 06 10:23:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.690000
Oct 06 10:23:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.700000
Oct 06 10:24:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.790000
Oct 06 10:24:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 13.880000
Oct 06 10:25:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 13.000000
Oct 06 10:25:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.250000
Oct 06 10:26:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.400000
Oct 06 10:26:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.720000
Oct 06 10:27:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.940000
Oct 06 10:27:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 16.129999
Oct 06 10:28:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.570000
Oct 06 10:28:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 12.010000
Oct 06 10:29:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.010000
Oct 06 10:29:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.880000
Oct 06 10:29:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 10:30:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.630000
Oct 06 10:30:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.620000
Oct 06 10:30:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 10:31:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 06 10:31:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 06 10:32:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was negligible)
Oct 06 10:32:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 06 10:33:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.220000
Oct 06 10:33:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was negligible)
Oct 06 10:33:09 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 06 10:33:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 06 10:33:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 06 10:33:09 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 06 10:33:09 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 06 10:33:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 06 10:33:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 06 10:33:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 06 10:33:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 06 10:33:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 06 10:33:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 06 10:33:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 06 10:33:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 06 10:33:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 06 10:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 06 10:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 06 10:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 06 10:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 06 10:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 06 10:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 06 10:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 06 10:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 06 10:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 06 10:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 06 10:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 06 10:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 06 10:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 06 10:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 06 10:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 06 10:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 06 10:33:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2681, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 06 10:33:09 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 06 10:33:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 06 10:33:09 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2681 (ref=pe_calc-dc-1728181989-35850) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 06 10:33:09 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2681 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 06 10:33:09 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 06 10:33:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 06 10:33:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 06 10:34:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.770000
Oct 06 10:34:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 06 10:34:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 06 10:35:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.540000
Oct 06 10:35:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 06 10:35:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.060000
Oct 06 10:35:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 10:36:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.880000
Oct 06 10:36:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 10:36:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.160000
Oct 06 10:37:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.950000
Oct 06 10:37:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.030000
Oct 06 10:38:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.580000
Oct 06 10:38:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.990000
Oct 06 10:39:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.000000
Oct 06 10:39:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.110000
Oct 06 10:40:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.480000
Oct 06 10:40:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.640000
Oct 06 10:41:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.770000
Oct 06 10:41:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 06 10:42:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.770000
Oct 06 10:42:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 06 10:43:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.010000
Oct 06 10:43:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.970000
Oct 06 10:44:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.410000
Oct 06 10:44:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.930000
Oct 06 10:45:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 13.760000
Oct 06 10:45:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.730000
Oct 06 10:46:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.640000
Oct 06 10:46:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.410000
Oct 06 10:47:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.940000
Oct 06 10:47:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 10:47:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 06 10:48:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.060000
Oct 06 10:48:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 06 10:48:09 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 06 10:48:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 06 10:48:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 06 10:48:09 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 06 10:48:09 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 06 10:48:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 06 10:48:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 06 10:48:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 06 10:48:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 06 10:48:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 06 10:48:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 06 10:48:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 06 10:48:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 06 10:48:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 06 10:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 06 10:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 06 10:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 06 10:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 06 10:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 06 10:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 06 10:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 06 10:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 06 10:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 06 10:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 06 10:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 06 10:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 06 10:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 06 10:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 06 10:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 06 10:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 06 10:48:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2682, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 06 10:48:09 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 06 10:48:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 06 10:48:09 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2682 (ref=pe_calc-dc-1728182889-35862) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 06 10:48:09 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2682 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 06 10:48:09 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 06 10:48:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 06 10:48:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.160000
Oct 06 10:48:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 10:49:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.600000
Oct 06 10:49:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 10:49:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.160000
Oct 06 10:50:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 06 10:50:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.440000
Oct 06 10:50:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 06 10:51:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.840000
Oct 06 10:51:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 10:51:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.290000
Oct 06 10:52:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.340000
Oct 06 10:52:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 10:52:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.760000
Oct 06 10:53:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.180000
Oct 06 10:53:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.480000
Oct 06 10:54:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.890000
Oct 06 10:54:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 10:54:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.860000
Oct 06 10:55:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 13.910000
Oct 06 10:55:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 10:55:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.600000
Oct 06 10:56:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 12.220000
Oct 06 10:56:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.780000
Oct 06 10:57:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.120000
Oct 06 10:57:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 06 10:58:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.880000
Oct 06 10:58:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 06 10:58:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.630000
Oct 06 10:59:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.150000
Oct 06 10:59:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.250000
Oct 06 10:59:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 11:00:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 06 11:01:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.060000
Oct 06 11:01:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 06 11:01:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.460000
Oct 06 11:01:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 11:02:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.830000
Oct 06 11:02:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 11:02:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.570000
Oct 06 11:03:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.110000
Oct 06 11:03:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 11:03:09 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 06 11:03:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 06 11:03:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 06 11:03:09 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 06 11:03:09 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 06 11:03:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 06 11:03:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 06 11:03:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 06 11:03:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 06 11:03:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 06 11:03:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 06 11:03:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 06 11:03:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 06 11:03:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 06 11:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 06 11:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 06 11:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 06 11:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 06 11:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 06 11:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 06 11:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 06 11:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 06 11:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 06 11:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 06 11:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 06 11:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 06 11:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 06 11:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 06 11:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 06 11:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 06 11:03:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2683, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 06 11:03:09 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 06 11:03:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 06 11:03:09 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2683 (ref=pe_calc-dc-1728183789-35879) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 06 11:03:09 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2683 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 06 11:03:09 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 06 11:03:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 06 11:03:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 06 11:04:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.950000
Oct 06 11:04:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 06 11:05:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.500000
Oct 06 11:05:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 11:05:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.620000
Oct 06 11:06:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.840000
Oct 06 11:06:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 11:06:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 06 11:07:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.130000
Oct 06 11:07:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 06 11:07:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.660000
Oct 06 11:08:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.110000
Oct 06 11:08:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.730000
Oct 06 11:09:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 15.670000
Oct 06 11:09:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 13.140000
Oct 06 11:10:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.930000
Oct 06 11:10:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.630000
Oct 06 11:11:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.480000
Oct 06 11:11:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.890000
Oct 06 11:12:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.780000
Oct 06 11:12:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.840000
Oct 06 11:13:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 13.970000
Oct 06 11:13:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 15.830000
Oct 06 11:14:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.290000
Oct 06 11:14:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.690000
Oct 06 11:15:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.890000
Oct 06 11:15:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.960000
Oct 06 11:16:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.400000
Oct 06 11:16:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.510000
Oct 06 11:17:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.790000
Oct 06 11:17:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.410000
Oct 06 11:18:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.150000
Oct 06 11:18:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 11:18:09 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 06 11:18:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 06 11:18:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 06 11:18:09 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 06 11:18:09 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 06 11:18:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 06 11:18:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 06 11:18:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 06 11:18:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 06 11:18:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 06 11:18:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 06 11:18:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 06 11:18:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 06 11:18:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 06 11:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 06 11:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 06 11:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 06 11:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 06 11:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 06 11:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 06 11:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 06 11:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 06 11:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 06 11:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 06 11:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 06 11:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 06 11:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 06 11:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 06 11:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 06 11:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 06 11:18:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2684, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 06 11:18:09 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 06 11:18:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 06 11:18:09 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2684 (ref=pe_calc-dc-1728184689-35887) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 06 11:18:09 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2684 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 06 11:18:09 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 06 11:18:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 06 11:18:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 06 11:19:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.610000
Oct 06 11:19:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 06 11:19:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 06 11:20:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.630000
Oct 06 11:20:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 06 11:20:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.000000
Oct 06 11:21:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.940000
Oct 06 11:21:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 11:21:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.340000
Oct 06 11:21:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 11:22:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.590000
Oct 06 11:22:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.480000
Oct 06 11:22:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 11:23:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.820000
Oct 06 11:23:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.390000
Oct 06 11:23:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 11:24:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.450000
Oct 06 11:24:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 11:24:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.070000
Oct 06 11:24:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 11:25:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.260000
Oct 06 11:25:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 06 11:26:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.890000
Oct 06 11:26:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 06 11:26:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.090000
Oct 06 11:26:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 11:27:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.850000
Oct 06 11:27:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 11:27:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.490000
Oct 06 11:27:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 11:28:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.200000
Oct 06 11:28:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.030000
Oct 06 11:29:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.620000
Oct 06 11:29:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.310000
Oct 06 11:29:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 11:30:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.080000
Oct 06 11:30:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 06 11:31:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.850000
Oct 06 11:31:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 06 11:31:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.400000
Oct 06 11:31:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 11:32:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 06 11:33:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.670000
Oct 06 11:33:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 06 11:33:09 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 06 11:33:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 06 11:33:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 06 11:33:09 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 06 11:33:09 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 06 11:33:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 06 11:33:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 06 11:33:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 06 11:33:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 06 11:33:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 06 11:33:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 06 11:33:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 06 11:33:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 06 11:33:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 06 11:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 06 11:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 06 11:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 06 11:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 06 11:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 06 11:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 06 11:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 06 11:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 06 11:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 06 11:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 06 11:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 06 11:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 06 11:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 06 11:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 06 11:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 06 11:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 06 11:33:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2685, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 06 11:33:09 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 06 11:33:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 06 11:33:09 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2685 (ref=pe_calc-dc-1728185589-35909) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 06 11:33:09 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2685 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 06 11:33:09 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 06 11:33:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 06 11:33:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.220000
Oct 06 11:33:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 11:34:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.560000
Oct 06 11:34:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.840000
Oct 06 11:35:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.880000
Oct 06 11:35:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.800000
Oct 06 11:36:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 12.220000
Oct 06 11:36:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.950000
Oct 06 11:37:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.930000
Oct 06 11:37:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 11:37:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.990000
Oct 06 11:38:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.610000
Oct 06 11:38:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 11:38:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.660000
Oct 06 11:39:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.340000
Oct 06 11:39:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.540000
Oct 06 11:39:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 11:40:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.190000
Oct 06 11:40:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was medium)
Oct 06 11:41:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.520000
Oct 06 11:41:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was negligible)
Oct 06 11:41:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.400000
Oct 06 11:41:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 11:42:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.560000
Oct 06 11:42:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 11:42:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.660000
Oct 06 11:43:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.020000
Oct 06 11:43:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.760000
Oct 06 11:43:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 11:44:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.720000
Oct 06 11:44:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.230000
Oct 06 11:44:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 11:45:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.730000
Oct 06 11:45:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.440000
Oct 06 11:45:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 11:46:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 06 11:47:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.770000
Oct 06 11:47:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 06 11:47:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 06 11:48:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.780000
Oct 06 11:48:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 06 11:48:09 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 06 11:48:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 06 11:48:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 06 11:48:09 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 06 11:48:09 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 06 11:48:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 06 11:48:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 06 11:48:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 06 11:48:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 06 11:48:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 06 11:48:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 06 11:48:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 06 11:48:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 06 11:48:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 06 11:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 06 11:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 06 11:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 06 11:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 06 11:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 06 11:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 06 11:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 06 11:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 06 11:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 06 11:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 06 11:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 06 11:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 06 11:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 06 11:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 06 11:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 06 11:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 06 11:48:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2686, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 06 11:48:09 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 06 11:48:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 06 11:48:09 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2686 (ref=pe_calc-dc-1728186489-35925) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 06 11:48:09 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2686 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 06 11:48:09 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 06 11:48:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 06 11:48:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.620000
Oct 06 11:49:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.790000
Oct 06 11:49:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.470000
Oct 06 11:50:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.720000
Oct 06 11:50:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 12.090000
Oct 06 11:51:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.220000
Oct 06 11:51:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 12.310000
Oct 06 11:52:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.540000
Oct 06 11:52:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.040000
Oct 06 11:53:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.340000
Oct 06 11:53:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.710000
Oct 06 11:54:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 14.000000
Oct 06 11:54:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.120000
Oct 06 11:55:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.480000
Oct 06 11:55:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.160000
Oct 06 11:56:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.520000
Oct 06 11:56:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.690000
Oct 06 11:57:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.380000
Oct 06 11:57:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.440000
Oct 06 11:57:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 11:58:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 06 11:59:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.520000
Oct 06 11:59:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 06 11:59:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.260000
Oct 06 12:00:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.220000
Oct 06 12:00:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.520000
Oct 06 12:01:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.340000
Oct 06 12:01:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.910000
Oct 06 12:02:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.390000
Oct 06 12:02:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.560000
Oct 06 12:03:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 06 12:03:09 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 06 12:03:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 06 12:03:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 06 12:03:09 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 06 12:03:09 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 06 12:03:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 06 12:03:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 06 12:03:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 06 12:03:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 06 12:03:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 06 12:03:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 06 12:03:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 06 12:03:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 06 12:03:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 06 12:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 06 12:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 06 12:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 06 12:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 06 12:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 06 12:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 06 12:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 06 12:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 06 12:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 06 12:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 06 12:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 06 12:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 06 12:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 06 12:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 06 12:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 06 12:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 06 12:03:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2687, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 06 12:03:09 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 06 12:03:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 06 12:03:09 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2687 (ref=pe_calc-dc-1728187389-35930) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 06 12:03:09 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2687 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 06 12:03:09 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 06 12:03:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 06 12:03:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.080000
Oct 06 12:03:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 06 12:04:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.350000
Oct 06 12:04:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 12:04:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 06 12:05:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.390000
Oct 06 12:05:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 06 12:05:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was medium)
Oct 06 12:06:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.340000
Oct 06 12:06:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was negligible)
Oct 06 12:06:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.670000
Oct 06 12:07:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.040000
Oct 06 12:07:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.560000
Oct 06 12:08:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.340000
Oct 06 12:08:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.550000
Oct 06 12:09:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.460000
Oct 06 12:09:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.490000
Oct 06 12:10:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.330000
Oct 06 12:10:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 12:10:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.620000
Oct 06 12:10:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 12:11:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.630000
Oct 06 12:11:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.910000
Oct 06 12:11:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 12:12:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.690000
Oct 06 12:12:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 12:12:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.110000
Oct 06 12:13:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.270000
Oct 06 12:13:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.850000
Oct 06 12:13:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 12:14:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 06 12:14:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.160000
Oct 06 12:14:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 06 12:15:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.970000
Oct 06 12:15:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 12:15:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.200000
Oct 06 12:15:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 12:16:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.180000
Oct 06 12:16:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 12:16:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.930000
Oct 06 12:16:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 12:17:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.310000
Oct 06 12:17:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was medium)
Oct 06 12:18:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.910000
Oct 06 12:18:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was negligible)
Oct 06 12:18:09 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 06 12:18:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 06 12:18:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 06 12:18:09 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 06 12:18:09 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 06 12:18:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 06 12:18:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 06 12:18:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 06 12:18:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 06 12:18:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 06 12:18:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 06 12:18:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 06 12:18:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 06 12:18:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 06 12:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 06 12:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 06 12:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 06 12:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 06 12:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 06 12:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 06 12:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 06 12:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 06 12:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 06 12:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 06 12:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 06 12:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 06 12:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 06 12:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 06 12:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 06 12:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 06 12:18:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2688, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 06 12:18:09 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 06 12:18:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 06 12:18:09 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2688 (ref=pe_calc-dc-1728188289-35950) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 06 12:18:09 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2688 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 06 12:18:09 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 06 12:18:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 06 12:18:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.820000
Oct 06 12:19:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.790000
Oct 06 12:19:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.920000
Oct 06 12:20:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.250000
Oct 06 12:20:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.540000
Oct 06 12:21:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 12.380000
Oct 06 12:21:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.580000
Oct 06 12:22:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 12.650000
Oct 06 12:22:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.020000
Oct 06 12:23:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.110000
Oct 06 12:23:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.560000
Oct 06 12:24:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.700000
Oct 06 12:24:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 06 12:25:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.790000
Oct 06 12:25:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 06 12:25:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 06 12:26:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.180000
Oct 06 12:26:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 06 12:26:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.220000
Oct 06 12:27:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.190000
Oct 06 12:27:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 12:27:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.410000
Oct 06 12:28:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.320000
Oct 06 12:28:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 12:28:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 06 12:29:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 06 12:30:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was negligible)
Oct 06 12:31:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.470000
Oct 06 12:31:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 06 12:31:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.430000
Oct 06 12:32:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.330000
Oct 06 12:32:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 12:32:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.730000
Oct 06 12:33:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.010000
Oct 06 12:33:09 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 06 12:33:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 06 12:33:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 06 12:33:09 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 06 12:33:09 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 06 12:33:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 06 12:33:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 06 12:33:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 06 12:33:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 06 12:33:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 06 12:33:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 06 12:33:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 06 12:33:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 06 12:33:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 06 12:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 06 12:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 06 12:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 06 12:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 06 12:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 06 12:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 06 12:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 06 12:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 06 12:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 06 12:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 06 12:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 06 12:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 06 12:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 06 12:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 06 12:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 06 12:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 06 12:33:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2689, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 06 12:33:09 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 06 12:33:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 06 12:33:09 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2689 (ref=pe_calc-dc-1728189189-35962) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 06 12:33:09 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2689 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 06 12:33:09 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 06 12:33:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 06 12:33:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.170000
Oct 06 12:33:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 12:34:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.600000
Oct 06 12:34:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 12:34:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.280000
Oct 06 12:35:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.170000
Oct 06 12:35:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.560000
Oct 06 12:35:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 12:36:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.840000
Oct 06 12:36:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 12:36:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.880000
Oct 06 12:37:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.040000
Oct 06 12:37:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.180000
Oct 06 12:37:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 12:38:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.830000
Oct 06 12:38:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 12:38:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.210000
Oct 06 12:39:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.290000
Oct 06 12:39:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.610000
Oct 06 12:40:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.510000
Oct 06 12:40:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.030000
Oct 06 12:41:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.480000
Oct 06 12:41:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.300000
Oct 06 12:42:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 13.280000
Oct 06 12:42:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 17.969999
Oct 06 12:43:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 12.980000
Oct 06 12:43:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.910000
Oct 06 12:44:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.640000
Oct 06 12:44:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.990000
Oct 06 12:45:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 14.160000
Oct 06 12:45:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.720000
Oct 06 12:46:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.790000
Oct 06 12:46:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.600000
Oct 06 12:47:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.280000
Oct 06 12:47:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.910000
Oct 06 12:48:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.770000
Oct 06 12:48:09 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 06 12:48:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 06 12:48:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 06 12:48:09 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 06 12:48:09 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 06 12:48:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 06 12:48:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 06 12:48:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 06 12:48:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 06 12:48:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 06 12:48:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 06 12:48:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 06 12:48:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 06 12:48:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 06 12:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 06 12:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 06 12:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 06 12:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 06 12:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 06 12:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 06 12:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 06 12:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 06 12:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 06 12:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 06 12:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 06 12:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 06 12:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 06 12:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 06 12:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 06 12:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 06 12:48:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2690, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 06 12:48:09 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 06 12:48:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 06 12:48:09 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2690 (ref=pe_calc-dc-1728190089-35969) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 06 12:48:09 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2690 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 06 12:48:09 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 06 12:48:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 06 12:48:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 12.900000
Oct 06 12:49:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.600000
Oct 06 12:49:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.820000
Oct 06 12:50:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.730000
Oct 06 12:50:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.320000
Oct 06 12:51:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 06 12:51:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.680000
Oct 06 12:51:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 06 12:52:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.100000
Oct 06 12:52:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 06 12:53:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 06 12:54:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.290000
Oct 06 12:54:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was negligible)
Oct 06 12:54:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.270000
Oct 06 12:55:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.650000
Oct 06 12:55:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.920000
Oct 06 12:55:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 12:56:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 17.230000
Oct 06 12:56:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.340000
Oct 06 12:57:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 14.400000
Oct 06 12:57:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.800000
Oct 06 12:58:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.920000
Oct 06 12:58:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.360000
Oct 06 12:59:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.410000
Oct 06 12:59:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.450000
Oct 06 13:00:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.650000
Oct 06 13:00:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.970000
Oct 06 13:01:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.370000
Oct 06 13:01:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.870000
Oct 06 13:02:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.660000
Oct 06 13:02:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.850000
Oct 06 13:02:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 13:03:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 17.110001
Oct 06 13:03:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 13:03:09 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 06 13:03:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 06 13:03:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 06 13:03:09 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 06 13:03:09 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 06 13:03:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 06 13:03:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 06 13:03:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 06 13:03:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 06 13:03:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 06 13:03:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 06 13:03:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 06 13:03:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 06 13:03:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 06 13:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 06 13:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 06 13:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 06 13:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 06 13:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 06 13:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 06 13:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 06 13:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 06 13:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 06 13:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 06 13:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 06 13:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 06 13:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 06 13:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 06 13:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 06 13:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 06 13:03:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2691, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 06 13:03:09 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 06 13:03:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 06 13:03:09 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2691 (ref=pe_calc-dc-1728190989-35978) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 06 13:03:09 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2691 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 06 13:03:09 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 06 13:03:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 06 13:03:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 14.820000
Oct 06 13:04:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 13.290000
Oct 06 13:04:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.570000
Oct 06 13:05:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.490000
Oct 06 13:05:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.300000
Oct 06 13:06:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.090000
Oct 06 13:06:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.380000
Oct 06 13:07:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.450000
Oct 06 13:07:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 13:07:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.730000
Oct 06 13:07:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 13:08:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.390000
Oct 06 13:08:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.860000
Oct 06 13:09:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.620000
Oct 06 13:09:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.040000
Oct 06 13:10:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.530000
Oct 06 13:10:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 12.340000
Oct 06 13:11:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.020000
Oct 06 13:11:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.170000
Oct 06 13:12:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.430000
Oct 06 13:12:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.170000
Oct 06 13:12:38 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 13:13:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.600000
Oct 06 13:13:08 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 13:13:38 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.850000
Oct 06 13:14:08 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.000000
Oct 06 13:14:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.570000
Oct 06 13:15:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.730000
Oct 06 13:15:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.360000
Oct 06 13:16:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 13.330000
Oct 06 13:16:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.880000
Oct 06 13:17:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.490000
Oct 06 13:17:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 13.100000
Oct 06 13:18:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.750000
Oct 06 13:18:09 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 06 13:18:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 06 13:18:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 06 13:18:09 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 06 13:18:09 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 06 13:18:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 06 13:18:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 06 13:18:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 06 13:18:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 06 13:18:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 06 13:18:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 06 13:18:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 06 13:18:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 06 13:18:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 06 13:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 06 13:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 06 13:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 06 13:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 06 13:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 06 13:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 06 13:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 06 13:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 06 13:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 06 13:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 06 13:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 06 13:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 06 13:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 06 13:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 06 13:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 06 13:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 06 13:18:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2692, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 06 13:18:09 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 06 13:18:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 06 13:18:09 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2692 (ref=pe_calc-dc-1728191889-35983) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 06 13:18:09 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2692 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 06 13:18:09 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 06 13:18:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 06 13:18:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.140000
Oct 06 13:19:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.260000
Oct 06 13:19:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 13:19:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 06 13:20:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.600000
Oct 06 13:20:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 06 13:21:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 12.710000
Oct 06 13:21:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.550000
Oct 06 13:22:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.510000
Oct 06 13:22:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.160000
Oct 06 13:23:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.710000
Oct 06 13:23:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 13:23:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 06 13:25:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.080000
Oct 06 13:25:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 06 13:25:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.450000
Oct 06 13:25:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 13:26:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.580000
Oct 06 13:26:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 13:26:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.890000
Oct 06 13:27:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.260000
Oct 06 13:27:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.720000
Oct 06 13:28:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.020000
Oct 06 13:28:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.580000
Oct 06 13:29:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.900000
Oct 06 13:29:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 13:29:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.880000
Oct 06 13:29:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 13:30:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.130000
Oct 06 13:30:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 13:30:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was medium)
Oct 06 13:31:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was negligible)
Oct 06 13:32:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.450000
Oct 06 13:32:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 06 13:32:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.790000
Oct 06 13:32:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 13:33:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.940000
Oct 06 13:33:09 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 06 13:33:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 06 13:33:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 06 13:33:09 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 06 13:33:09 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 06 13:33:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 06 13:33:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 06 13:33:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 06 13:33:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 06 13:33:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 06 13:33:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 06 13:33:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 06 13:33:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 06 13:33:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 06 13:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 06 13:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 06 13:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 06 13:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 06 13:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 06 13:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 06 13:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 06 13:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 06 13:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 06 13:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 06 13:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 06 13:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 06 13:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 06 13:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 06 13:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 06 13:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 06 13:33:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2693, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 06 13:33:09 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 06 13:33:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 06 13:33:09 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2693 (ref=pe_calc-dc-1728192789-35999) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 06 13:33:09 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2693 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 06 13:33:09 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 06 13:33:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 06 13:33:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.520000
Oct 06 13:34:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.580000
Oct 06 13:34:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 18.629999
Oct 06 13:35:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 17.270000
Oct 06 13:35:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.440000
Oct 06 13:36:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.300000
Oct 06 13:36:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.970000
Oct 06 13:37:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.180000
Oct 06 13:37:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.870000
Oct 06 13:37:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 13:38:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.270000
Oct 06 13:38:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.420000
Oct 06 13:38:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 13:39:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.970000
Oct 06 13:39:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.860000
Oct 06 13:39:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 13:40:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.690000
Oct 06 13:40:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 13:40:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.380000
Oct 06 13:40:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 13:41:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 06 13:41:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.680000
Oct 06 13:41:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 06 13:42:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.840000
Oct 06 13:42:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.750000
Oct 06 13:42:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 13:43:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 06 13:43:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.920000
Oct 06 13:43:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 06 13:44:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.110000
Oct 06 13:44:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.240000
Oct 06 13:45:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.430000
Oct 06 13:45:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 13:45:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 06 13:47:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.800000
Oct 06 13:47:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 06 13:47:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.850000
Oct 06 13:48:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.200000
Oct 06 13:48:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 13:48:09 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 06 13:48:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 06 13:48:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 06 13:48:09 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 06 13:48:09 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 06 13:48:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 06 13:48:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 06 13:48:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 06 13:48:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 06 13:48:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 06 13:48:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 06 13:48:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 06 13:48:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 06 13:48:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 06 13:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 06 13:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 06 13:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 06 13:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 06 13:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 06 13:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 06 13:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 06 13:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 06 13:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 06 13:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 06 13:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 06 13:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 06 13:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 06 13:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 06 13:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 06 13:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 06 13:48:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2694, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 06 13:48:09 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 06 13:48:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 06 13:48:09 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2694 (ref=pe_calc-dc-1728193689-36014) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 06 13:48:09 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2694 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 06 13:48:09 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 06 13:48:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 06 13:48:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 06 13:49:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 06 13:49:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was negligible)
Oct 06 13:50:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.830000
Oct 06 13:50:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 06 13:50:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 06 13:51:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.160000
Oct 06 13:51:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 06 13:52:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 06 13:52:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.490000
Oct 06 13:52:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 06 13:53:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.800000
Oct 06 13:53:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 13:53:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 06 13:54:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 06 13:54:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was negligible)
Oct 06 13:55:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.380000
Oct 06 13:55:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 06 13:56:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 06 13:56:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.270000
Oct 06 13:56:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 06 13:57:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 06 13:57:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 06 13:58:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was negligible)
Oct 06 13:59:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 06 14:00:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was negligible)
Oct 06 14:00:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 06 14:01:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was negligible)
Oct 06 14:01:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.030000
Oct 06 14:01:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 06 14:02:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.350000
Oct 06 14:02:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.960000
Oct 06 14:03:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 06 14:03:09 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 06 14:03:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 06 14:03:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 06 14:03:09 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 06 14:03:09 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 06 14:03:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 06 14:03:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 06 14:03:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 06 14:03:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 06 14:03:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 06 14:03:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 06 14:03:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 06 14:03:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 06 14:03:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 06 14:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 06 14:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 06 14:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 06 14:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 06 14:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 06 14:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 06 14:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 06 14:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 06 14:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 06 14:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 06 14:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 06 14:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 06 14:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 06 14:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 06 14:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 06 14:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 06 14:03:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2695, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 06 14:03:09 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 06 14:03:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 06 14:03:09 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2695 (ref=pe_calc-dc-1728194589-36039) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 06 14:03:09 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2695 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 06 14:03:09 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 06 14:03:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 06 14:05:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.370000
Oct 06 14:05:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 06 14:05:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 06 14:06:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.800000
Oct 06 14:06:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 06 14:06:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 06 14:07:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.400000
Oct 06 14:07:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 06 14:08:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.200000
Oct 06 14:08:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 14:08:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.550000
Oct 06 14:09:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.410000
Oct 06 14:09:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 14:09:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.310000
Oct 06 14:09:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 14:10:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 06 14:11:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.170000
Oct 06 14:11:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 06 14:11:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 06 14:12:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.360000
Oct 06 14:12:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 06 14:12:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.060000
Oct 06 14:13:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.850000
Oct 06 14:13:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.970000
Oct 06 14:13:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 14:14:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.020000
Oct 06 14:14:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 06 14:15:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 06 14:15:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was negligible)
Oct 06 14:16:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.480000
Oct 06 14:16:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 06 14:17:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 06 14:18:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.220000
Oct 06 14:18:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 06 14:18:09 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 06 14:18:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 06 14:18:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 06 14:18:09 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 06 14:18:09 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 06 14:18:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 06 14:18:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 06 14:18:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 06 14:18:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 06 14:18:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 06 14:18:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 06 14:18:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 06 14:18:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 06 14:18:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 06 14:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 06 14:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 06 14:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 06 14:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 06 14:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 06 14:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 06 14:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 06 14:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 06 14:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 06 14:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 06 14:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 06 14:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 06 14:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 06 14:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 06 14:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 06 14:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 06 14:18:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2696, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 06 14:18:09 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 06 14:18:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 06 14:18:09 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2696 (ref=pe_calc-dc-1728195489-36059) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 06 14:18:09 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2696 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 06 14:18:09 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 06 14:18:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 06 14:18:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 06 14:19:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 06 14:19:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was negligible)
Oct 06 14:20:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.330000
Oct 06 14:20:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 06 14:21:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 06 14:21:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 06 14:22:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.860000
Oct 06 14:22:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was negligible)
Oct 06 14:22:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 06 14:23:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.780000
Oct 06 14:23:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 06 14:23:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.170000
Oct 06 14:23:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 14:24:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.230000
Oct 06 14:24:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 14:24:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.290000
Oct 06 14:25:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.480000
Oct 06 14:25:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.840000
Oct 06 14:26:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 06 14:27:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 06 14:27:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.580000
Oct 06 14:27:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was negligible)
Oct 06 14:28:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.600000
Oct 06 14:28:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 14:28:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 06 14:29:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.320000
Oct 06 14:29:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 06 14:29:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.290000
Oct 06 14:29:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 14:30:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.490000
Oct 06 14:30:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.910000
Oct 06 14:30:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 14:31:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.380000
Oct 06 14:31:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 14:31:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.880000
Oct 06 14:32:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.710000
Oct 06 14:32:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.410000
Oct 06 14:32:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 14:33:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.550000
Oct 06 14:33:09 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 06 14:33:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 06 14:33:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 06 14:33:09 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 06 14:33:09 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 06 14:33:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 06 14:33:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 06 14:33:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 06 14:33:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 06 14:33:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 06 14:33:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 06 14:33:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 06 14:33:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 06 14:33:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 06 14:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 06 14:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 06 14:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 06 14:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 06 14:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 06 14:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 06 14:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 06 14:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 06 14:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 06 14:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 06 14:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 06 14:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 06 14:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 06 14:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 06 14:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 06 14:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 06 14:33:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2697, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 06 14:33:09 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 06 14:33:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 06 14:33:09 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2697 (ref=pe_calc-dc-1728196389-36081) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 06 14:33:09 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2697 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 06 14:33:09 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 06 14:33:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 06 14:33:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.230000
Oct 06 14:34:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.670000
Oct 06 14:34:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 06 14:35:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.850000
Oct 06 14:35:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 06 14:36:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 06 14:37:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 06 14:38:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.690000
Oct 06 14:38:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was negligible)
Oct 06 14:39:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.170000
Oct 06 14:39:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 14:39:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 06 14:40:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.730000
Oct 06 14:40:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 06 14:40:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.260000
Oct 06 14:41:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 13.470000
Oct 06 14:41:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 14.870000
Oct 06 14:42:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.210000
Oct 06 14:42:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.180000
Oct 06 14:43:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.540000
Oct 06 14:43:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 06 14:44:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 06 14:45:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was negligible)
Oct 06 14:45:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.910000
Oct 06 14:45:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 06 14:46:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 12.120000
Oct 06 14:46:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 14.680000
Oct 06 14:47:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 13.430000
Oct 06 14:47:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.550000
Oct 06 14:48:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.060000
Oct 06 14:48:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 14:48:09 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 06 14:48:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 06 14:48:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 06 14:48:09 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 06 14:48:09 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 06 14:48:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 06 14:48:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 06 14:48:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 06 14:48:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 06 14:48:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 06 14:48:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 06 14:48:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 06 14:48:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 06 14:48:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 06 14:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 06 14:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 06 14:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 06 14:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 06 14:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 06 14:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 06 14:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 06 14:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 06 14:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 06 14:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 06 14:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 06 14:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 06 14:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 06 14:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 06 14:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 06 14:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 06 14:48:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2698, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 06 14:48:09 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 06 14:48:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 06 14:48:09 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2698 (ref=pe_calc-dc-1728197289-36095) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 06 14:48:09 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2698 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 06 14:48:09 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 06 14:48:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 06 14:48:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 06 14:49:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.490000
Oct 06 14:49:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 06 14:50:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.650000
Oct 06 14:50:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.810000
Oct 06 14:51:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.840000
Oct 06 14:51:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.150000
Oct 06 14:51:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 14:52:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.280000
Oct 06 14:52:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 14:52:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.120000
Oct 06 14:53:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.550000
Oct 06 14:53:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.620000
Oct 06 14:54:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.660000
Oct 06 14:54:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 06 14:55:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.900000
Oct 06 14:55:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 06 14:56:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.930000
Oct 06 14:56:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 14:56:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.310000
Oct 06 14:57:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 06 14:58:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.180000
Oct 06 14:58:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 06 14:59:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 06 14:59:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.530000
Oct 06 14:59:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 06 15:00:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.800000
Oct 06 15:00:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.430000
Oct 06 15:01:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.570000
Oct 06 15:01:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.810000
Oct 06 15:01:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 15:02:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.700000
Oct 06 15:02:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.180000
Oct 06 15:03:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.930000
Oct 06 15:03:09 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 06 15:03:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 06 15:03:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 06 15:03:09 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 06 15:03:09 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 06 15:03:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 06 15:03:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 06 15:03:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 06 15:03:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 06 15:03:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 06 15:03:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 06 15:03:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 06 15:03:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 06 15:03:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 06 15:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 06 15:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 06 15:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 06 15:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 06 15:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 06 15:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 06 15:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 06 15:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 06 15:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 06 15:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 06 15:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 06 15:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 06 15:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 06 15:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 06 15:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 06 15:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 06 15:03:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2699, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 06 15:03:09 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 06 15:03:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 06 15:03:09 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2699 (ref=pe_calc-dc-1728198189-36108) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 06 15:03:09 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2699 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 06 15:03:09 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 06 15:03:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 06 15:03:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 13.770000
Oct 06 15:04:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 12.710000
Oct 06 15:04:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.650000
Oct 06 15:05:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.040000
Oct 06 15:05:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 15:05:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.210000
Oct 06 15:06:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 06 15:06:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.590000
Oct 06 15:06:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 06 15:07:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.530000
Oct 06 15:07:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 15:07:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 06 15:08:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.410000
Oct 06 15:08:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 06 15:08:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.770000
Oct 06 15:09:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.560000
Oct 06 15:09:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.340000
Oct 06 15:10:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.590000
Oct 06 15:10:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 15:10:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 06 15:11:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.130000
Oct 06 15:11:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 06 15:12:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.000000
Oct 06 15:12:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.050000
Oct 06 15:13:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 06 15:14:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.020000
Oct 06 15:14:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 06 15:14:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.820000
Oct 06 15:15:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.880000
Oct 06 15:15:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 15:15:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.580000
Oct 06 15:16:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.790000
Oct 06 15:16:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.040000
Oct 06 15:16:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 15:17:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.310000
Oct 06 15:17:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.170000
Oct 06 15:17:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 15:18:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.820000
Oct 06 15:18:09 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 06 15:18:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 06 15:18:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 06 15:18:09 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 06 15:18:09 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 06 15:18:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 06 15:18:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 06 15:18:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 06 15:18:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 06 15:18:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 06 15:18:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 06 15:18:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 06 15:18:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 06 15:18:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 06 15:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 06 15:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 06 15:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 06 15:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 06 15:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 06 15:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 06 15:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 06 15:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 06 15:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 06 15:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 06 15:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 06 15:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 06 15:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 06 15:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 06 15:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 06 15:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 06 15:18:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2700, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 06 15:18:09 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 06 15:18:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 06 15:18:09 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2700 (ref=pe_calc-dc-1728199089-36123) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 06 15:18:09 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2700 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 06 15:18:09 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 06 15:18:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 06 15:18:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.840000
Oct 06 15:19:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.310000
Oct 06 15:19:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.950000
Oct 06 15:20:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.260000
Oct 06 15:20:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 15:20:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.990000
Oct 06 15:21:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 06 15:22:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.940000
Oct 06 15:22:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 06 15:22:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.400000
Oct 06 15:22:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 15:23:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.500000
Oct 06 15:23:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 15:23:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.090000
Oct 06 15:23:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 15:24:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 06 15:24:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.050000
Oct 06 15:24:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 06 15:25:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.210000
Oct 06 15:25:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.800000
Oct 06 15:26:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 12.720000
Oct 06 15:26:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 12.400000
Oct 06 15:27:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.680000
Oct 06 15:27:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.940000
Oct 06 15:27:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 15:28:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 06 15:29:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 06 15:29:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.220000
Oct 06 15:29:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was negligible)
Oct 06 15:30:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.430000
Oct 06 15:30:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 15:30:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.140000
Oct 06 15:31:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.910000
Oct 06 15:31:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 15:31:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 12.630000
Oct 06 15:31:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 15:32:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.950000
Oct 06 15:32:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.790000
Oct 06 15:33:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.190000
Oct 06 15:33:09 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 06 15:33:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 06 15:33:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 06 15:33:09 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 06 15:33:09 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 06 15:33:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 06 15:33:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 06 15:33:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 06 15:33:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 06 15:33:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 06 15:33:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 06 15:33:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 06 15:33:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 06 15:33:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 06 15:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 06 15:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 06 15:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 06 15:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 06 15:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 06 15:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 06 15:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 06 15:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 06 15:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 06 15:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 06 15:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 06 15:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 06 15:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 06 15:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 06 15:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 06 15:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 06 15:33:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2701, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 06 15:33:09 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 06 15:33:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 06 15:33:09 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2701 (ref=pe_calc-dc-1728199989-36139) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 06 15:33:09 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2701 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 06 15:33:09 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 06 15:33:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 06 15:33:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.790000
Oct 06 15:34:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.390000
Oct 06 15:34:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 15:34:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was medium)
Oct 06 15:35:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was negligible)
Oct 06 15:36:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.920000
Oct 06 15:36:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 06 15:36:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.310000
Oct 06 15:37:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 12.810000
Oct 06 15:37:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 13.260000
Oct 06 15:38:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.020000
Oct 06 15:38:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.850000
Oct 06 15:39:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.160000
Oct 06 15:39:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 15:39:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.050000
Oct 06 15:40:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 06 15:41:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.520000
Oct 06 15:41:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 06 15:41:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.760000
Oct 06 15:41:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 15:42:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 06 15:42:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.230000
Oct 06 15:42:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 06 15:43:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.880000
Oct 06 15:43:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 06 15:44:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 06 15:44:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.070000
Oct 06 15:44:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was negligible)
Oct 06 15:45:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.560000
Oct 06 15:45:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 06 15:46:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 06 15:46:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was negligible)
Oct 06 15:47:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.440000
Oct 06 15:47:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 06 15:47:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.250000
Oct 06 15:48:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 06 15:48:09 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 06 15:48:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 06 15:48:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 06 15:48:09 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 06 15:48:09 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 06 15:48:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 06 15:48:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 06 15:48:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 06 15:48:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 06 15:48:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 06 15:48:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 06 15:48:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 06 15:48:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 06 15:48:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 06 15:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 06 15:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 06 15:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 06 15:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 06 15:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 06 15:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 06 15:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 06 15:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 06 15:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 06 15:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 06 15:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 06 15:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 06 15:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 06 15:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 06 15:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 06 15:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 06 15:48:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2702, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 06 15:48:09 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 06 15:48:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 06 15:48:09 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2702 (ref=pe_calc-dc-1728200889-36158) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 06 15:48:09 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2702 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 06 15:48:09 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 06 15:48:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 06 15:50:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 06 15:51:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was negligible)
Oct 06 15:52:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.680000
Oct 06 15:52:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 06 15:53:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.600000
Oct 06 15:53:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.190000
Oct 06 15:53:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 15:54:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was medium)
Oct 06 15:54:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was negligible)
Oct 06 15:55:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 06 15:57:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.220000
Oct 06 15:57:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was negligible)
Oct 06 15:57:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.580000
Oct 06 15:58:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 06 15:58:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.970000
Oct 06 15:58:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 06 15:59:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 12.580000
Oct 06 15:59:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.400000
Oct 06 16:00:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.820000
Oct 06 16:00:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.530000
Oct 06 16:01:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.470000
Oct 06 16:01:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.240000
Oct 06 16:01:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 16:02:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 06 16:02:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.750000
Oct 06 16:02:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 06 16:03:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 06 16:03:09 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 06 16:03:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 06 16:03:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 06 16:03:09 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 06 16:03:09 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 06 16:03:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 06 16:03:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 06 16:03:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 06 16:03:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 06 16:03:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 06 16:03:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 06 16:03:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 06 16:03:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 06 16:03:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 06 16:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 06 16:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 06 16:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 06 16:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 06 16:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 06 16:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 06 16:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 06 16:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 06 16:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 06 16:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 06 16:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 06 16:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 06 16:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 06 16:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 06 16:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 06 16:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 06 16:03:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2703, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 06 16:03:09 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 06 16:03:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 06 16:03:09 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2703 (ref=pe_calc-dc-1728201789-36173) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 06 16:03:09 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2703 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 06 16:03:09 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 06 16:03:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 06 16:03:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 06 16:04:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.580000
Oct 06 16:04:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was negligible)
Oct 06 16:04:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.130000
Oct 06 16:05:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.270000
Oct 06 16:05:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 16:05:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was medium)
Oct 06 16:06:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.240000
Oct 06 16:06:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was negligible)
Oct 06 16:07:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.550000
Oct 06 16:07:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 16:07:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.330000
Oct 06 16:07:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 16:08:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.250000
Oct 06 16:08:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 06 16:09:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.330000
Oct 06 16:09:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 06 16:09:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.240000
Oct 06 16:10:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.530000
Oct 06 16:10:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 16:10:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.400000
Oct 06 16:10:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 16:11:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.560000
Oct 06 16:11:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.030000
Oct 06 16:12:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.990000
Oct 06 16:12:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 15.150000
Oct 06 16:13:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 14.330000
Oct 06 16:13:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.710000
Oct 06 16:14:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.200000
Oct 06 16:14:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 16:14:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.270000
Oct 06 16:14:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 16:15:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.000000
Oct 06 16:15:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.880000
Oct 06 16:15:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 16:16:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.500000
Oct 06 16:16:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 16:16:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.170000
Oct 06 16:17:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.130000
Oct 06 16:17:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 16:17:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.450000
Oct 06 16:17:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 16:18:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.330000
Oct 06 16:18:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 16:18:09 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 06 16:18:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 06 16:18:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 06 16:18:09 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 06 16:18:09 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 06 16:18:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 06 16:18:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 06 16:18:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 06 16:18:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 06 16:18:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 06 16:18:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 06 16:18:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 06 16:18:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 06 16:18:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 06 16:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 06 16:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 06 16:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 06 16:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 06 16:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 06 16:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 06 16:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 06 16:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 06 16:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 06 16:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 06 16:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 06 16:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 06 16:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 06 16:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 06 16:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 06 16:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 06 16:18:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2704, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 06 16:18:09 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 06 16:18:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 06 16:18:09 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2704 (ref=pe_calc-dc-1728202689-36192) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 06 16:18:09 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2704 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 06 16:18:09 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 06 16:18:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 06 16:18:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.560000
Oct 06 16:19:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.980000
Oct 06 16:19:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 16:19:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.840000
Oct 06 16:19:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 16:20:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 06 16:20:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 06 16:24:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was negligible)
Oct 06 16:26:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.500000
Oct 06 16:26:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 06 16:27:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.730000
Oct 06 16:27:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 16:27:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.220000
Oct 06 16:27:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 16:28:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 06 16:28:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.090000
Oct 06 16:28:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 06 16:29:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.500000
Oct 06 16:29:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.070000
Oct 06 16:30:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.880000
Oct 06 16:30:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.620000
Oct 06 16:30:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 16:31:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.270000
Oct 06 16:31:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.870000
Oct 06 16:31:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 16:32:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.580000
Oct 06 16:32:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 12.820000
Oct 06 16:33:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.140000
Oct 06 16:33:09 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 06 16:33:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 06 16:33:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 06 16:33:09 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 06 16:33:09 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 06 16:33:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 06 16:33:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 06 16:33:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 06 16:33:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 06 16:33:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 06 16:33:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 06 16:33:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 06 16:33:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 06 16:33:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 06 16:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 06 16:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 06 16:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 06 16:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 06 16:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 06 16:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 06 16:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 06 16:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 06 16:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 06 16:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 06 16:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 06 16:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 06 16:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 06 16:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 06 16:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 06 16:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 06 16:33:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2705, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 06 16:33:09 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 06 16:33:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 06 16:33:09 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2705 (ref=pe_calc-dc-1728203589-36205) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 06 16:33:09 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2705 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 06 16:33:09 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 06 16:33:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 06 16:33:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.450000
Oct 06 16:34:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 06 16:34:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.160000
Oct 06 16:34:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 06 16:35:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 06 16:35:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.500000
Oct 06 16:35:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 06 16:36:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 06 16:36:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.680000
Oct 06 16:36:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 06 16:37:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 06 16:39:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 06 16:39:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.510000
Oct 06 16:39:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was negligible)
Oct 06 16:40:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.310000
Oct 06 16:40:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 16:40:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.420000
Oct 06 16:40:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 16:41:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 06 16:42:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 06 16:42:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was negligible)
Oct 06 16:43:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 06 16:43:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.720000
Oct 06 16:43:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was negligible)
Oct 06 16:44:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 06 16:44:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.070000
Oct 06 16:44:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 06 16:45:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 06 16:45:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 06 16:46:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.450000
Oct 06 16:46:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was negligible)
Oct 06 16:47:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.200000
Oct 06 16:47:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 16:47:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.290000
Oct 06 16:47:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 16:48:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.900000
Oct 06 16:48:09 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 06 16:48:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 06 16:48:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 06 16:48:09 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 06 16:48:09 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 06 16:48:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 06 16:48:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 06 16:48:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 06 16:48:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 06 16:48:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 06 16:48:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 06 16:48:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 06 16:48:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 06 16:48:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 06 16:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 06 16:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 06 16:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 06 16:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 06 16:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 06 16:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 06 16:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 06 16:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 06 16:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 06 16:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 06 16:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 06 16:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 06 16:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 06 16:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 06 16:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 06 16:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 06 16:48:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2706, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 06 16:48:09 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 06 16:48:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 06 16:48:09 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2706 (ref=pe_calc-dc-1728204489-36229) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 06 16:48:09 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2706 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 06 16:48:09 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 06 16:48:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 06 16:48:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.240000
Oct 06 16:49:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.390000
Oct 06 16:49:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 16:49:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.470000
Oct 06 16:49:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 16:50:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.460000
Oct 06 16:50:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.500000
Oct 06 16:51:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.940000
Oct 06 16:51:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.550000
Oct 06 16:52:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.850000
Oct 06 16:52:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.120000
Oct 06 16:53:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.780000
Oct 06 16:53:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.370000
Oct 06 16:54:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.750000
Oct 06 16:54:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.870000
Oct 06 16:55:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.330000
Oct 06 16:55:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 16:55:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.060000
Oct 06 16:56:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 06 16:56:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.740000
Oct 06 16:56:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 06 16:57:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.720000
Oct 06 16:57:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 16:57:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.440000
Oct 06 16:58:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.690000
Oct 06 16:58:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.350000
Oct 06 16:59:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.610000
Oct 06 16:59:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.360000
Oct 06 16:59:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 17:00:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was medium)
Oct 06 17:00:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.360000
Oct 06 17:00:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was negligible)
Oct 06 17:01:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.900000
Oct 06 17:01:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 17:01:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.800000
Oct 06 17:01:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 17:02:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 06 17:03:09 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 06 17:03:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 06 17:03:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 06 17:03:09 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 06 17:03:09 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 06 17:03:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 06 17:03:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 06 17:03:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 06 17:03:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 06 17:03:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 06 17:03:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 06 17:03:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 06 17:03:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 06 17:03:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 06 17:03:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 06 17:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 06 17:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 06 17:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 06 17:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 06 17:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 06 17:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 06 17:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 06 17:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 06 17:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 06 17:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 06 17:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 06 17:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 06 17:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 06 17:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 06 17:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 06 17:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 06 17:03:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2707, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 06 17:03:09 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 06 17:03:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 06 17:03:09 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2707 (ref=pe_calc-dc-1728205389-36242) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 06 17:03:09 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2707 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 06 17:03:09 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 06 17:03:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 06 17:04:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.320000
Oct 06 17:04:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was negligible)
Oct 06 17:05:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.490000
Oct 06 17:05:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.990000
Oct 06 17:05:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 17:06:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 16.360001
Oct 06 17:06:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 14.200000
Oct 06 17:07:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.930000
Oct 06 17:07:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.790000
Oct 06 17:08:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.840000
Oct 06 17:08:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 17:08:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.420000
Oct 06 17:08:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 17:09:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.650000
Oct 06 17:09:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.260000
Oct 06 17:09:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 17:10:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 06 17:11:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.710000
Oct 06 17:11:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 06 17:12:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.290000
Oct 06 17:12:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.170000
Oct 06 17:13:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.360000
Oct 06 17:13:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.040000
Oct 06 17:14:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.200000
Oct 06 17:14:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 17:14:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.850000
Oct 06 17:15:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.130000
Oct 06 17:15:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 17:15:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.770000
Oct 06 17:15:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 17:16:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 06 17:16:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.660000
Oct 06 17:16:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 06 17:17:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 06 17:17:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.140000
Oct 06 17:17:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 06 17:18:09 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 06 17:18:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 06 17:18:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 06 17:18:09 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 06 17:18:09 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 06 17:18:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 06 17:18:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 06 17:18:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 06 17:18:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 06 17:18:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 06 17:18:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 06 17:18:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 06 17:18:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 06 17:18:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 06 17:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 06 17:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 06 17:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 06 17:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 06 17:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 06 17:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 06 17:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 06 17:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 06 17:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 06 17:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 06 17:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 06 17:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 06 17:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 06 17:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 06 17:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 06 17:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 06 17:18:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2708, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 06 17:18:09 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 06 17:18:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 06 17:18:09 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2708 (ref=pe_calc-dc-1728206289-36258) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 06 17:18:09 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2708 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 06 17:18:09 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 06 17:18:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 06 17:18:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.480000
Oct 06 17:18:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 17:18:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.550000
Oct 06 17:19:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 06 17:19:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.150000
Oct 06 17:19:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 06 17:20:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.270000
Oct 06 17:20:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 17:20:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.600000
Oct 06 17:20:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 17:21:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.960000
Oct 06 17:21:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.180000
Oct 06 17:22:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.250000
Oct 06 17:22:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 17:22:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.470000
Oct 06 17:22:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 17:23:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.890000
Oct 06 17:23:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 17:23:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.490000
Oct 06 17:23:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 17:24:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.560000
Oct 06 17:24:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.660000
Oct 06 17:24:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 17:25:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.760000
Oct 06 17:25:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 17:25:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.220000
Oct 06 17:26:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.790000
Oct 06 17:26:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.900000
Oct 06 17:27:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 12.220000
Oct 06 17:27:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.910000
Oct 06 17:28:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 06 17:29:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.460000
Oct 06 17:29:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 06 17:30:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.620000
Oct 06 17:30:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 17:30:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.400000
Oct 06 17:31:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 06 17:33:09 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 06 17:33:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 06 17:33:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 06 17:33:09 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 06 17:33:09 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 06 17:33:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 06 17:33:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 06 17:33:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 06 17:33:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 06 17:33:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 06 17:33:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 06 17:33:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 06 17:33:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 06 17:33:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 06 17:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 06 17:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 06 17:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 06 17:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 06 17:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 06 17:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 06 17:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 06 17:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 06 17:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 06 17:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 06 17:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 06 17:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 06 17:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 06 17:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 06 17:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 06 17:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 06 17:33:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2709, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 06 17:33:09 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 06 17:33:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 06 17:33:09 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2709 (ref=pe_calc-dc-1728207189-36274) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 06 17:33:09 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2709 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 06 17:33:09 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 06 17:33:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 06 17:33:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.700000
Oct 06 17:33:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 06 17:33:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.580000
Oct 06 17:33:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 17:34:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.710000
Oct 06 17:34:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.860000
Oct 06 17:35:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.140000
Oct 06 17:35:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.020000
Oct 06 17:35:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 17:36:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.330000
Oct 06 17:36:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.480000
Oct 06 17:36:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 17:37:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.200000
Oct 06 17:37:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.350000
Oct 06 17:38:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.800000
Oct 06 17:38:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.660000
Oct 06 17:39:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.160000
Oct 06 17:39:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.810000
Oct 06 17:40:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.720000
Oct 06 17:40:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 17:40:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.210000
Oct 06 17:41:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.940000
Oct 06 17:41:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 06 17:42:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.310000
Oct 06 17:42:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 06 17:43:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.340000
Oct 06 17:43:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.030000
Oct 06 17:43:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 17:44:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.990000
Oct 06 17:44:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 17:44:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.910000
Oct 06 17:44:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 17:45:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.500000
Oct 06 17:45:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.120000
Oct 06 17:45:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 17:46:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.160000
Oct 06 17:46:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.210000
Oct 06 17:46:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 17:47:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.700000
Oct 06 17:47:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 17:47:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 06 17:48:09 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 06 17:48:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 06 17:48:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 06 17:48:09 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 06 17:48:09 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 06 17:48:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 06 17:48:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 06 17:48:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 06 17:48:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 06 17:48:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 06 17:48:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 06 17:48:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 06 17:48:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 06 17:48:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 06 17:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 06 17:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 06 17:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 06 17:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 06 17:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 06 17:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 06 17:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 06 17:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 06 17:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 06 17:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 06 17:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 06 17:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 06 17:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 06 17:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 06 17:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 06 17:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 06 17:48:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2710, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 06 17:48:09 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 06 17:48:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 06 17:48:09 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2710 (ref=pe_calc-dc-1728208089-36289) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 06 17:48:09 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2710 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 06 17:48:09 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 06 17:48:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 06 17:48:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 06 17:48:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was negligible)
Oct 06 17:50:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.890000
Oct 06 17:50:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 06 17:50:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 06 17:51:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.220000
Oct 06 17:51:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 06 17:52:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 06 17:53:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.880000
Oct 06 17:53:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 06 17:54:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.560000
Oct 06 17:54:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 06 17:55:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.550000
Oct 06 17:55:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 06 17:56:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.160000
Oct 06 17:56:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 17:56:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.630000
Oct 06 17:56:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 17:57:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.830000
Oct 06 17:57:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 17:57:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 06 17:58:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.620000
Oct 06 17:58:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 06 17:58:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.760000
Oct 06 17:58:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 17:59:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.840000
Oct 06 17:59:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.080000
Oct 06 18:00:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.080000
Oct 06 18:00:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.220000
Oct 06 18:00:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 18:01:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.380000
Oct 06 18:01:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.770000
Oct 06 18:01:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 18:02:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.440000
Oct 06 18:02:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.510000
Oct 06 18:03:09 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 06 18:03:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 06 18:03:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 06 18:03:09 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 06 18:03:09 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 06 18:03:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 06 18:03:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 06 18:03:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 06 18:03:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 06 18:03:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 06 18:03:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 06 18:03:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 06 18:03:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 06 18:03:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 06 18:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 06 18:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 06 18:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 06 18:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 06 18:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 06 18:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 06 18:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 06 18:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 06 18:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 06 18:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 06 18:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 06 18:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 06 18:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 06 18:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 06 18:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 06 18:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 06 18:03:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2711, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 06 18:03:09 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 06 18:03:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 06 18:03:09 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2711 (ref=pe_calc-dc-1728208989-36307) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 06 18:03:09 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2711 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 06 18:03:09 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 06 18:03:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 06 18:03:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.180000
Oct 06 18:03:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.940000
Oct 06 18:04:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.590000
Oct 06 18:04:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 18:04:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.150000
Oct 06 18:04:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 18:05:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.580000
Oct 06 18:05:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.510000
Oct 06 18:06:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.460000
Oct 06 18:06:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.120000
Oct 06 18:07:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.080000
Oct 06 18:07:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 18:07:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.370000
Oct 06 18:08:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.390000
Oct 06 18:08:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 06 18:09:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.400000
Oct 06 18:09:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 06 18:10:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.670000
Oct 06 18:10:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 18:10:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 06 18:11:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.800000
Oct 06 18:11:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 06 18:11:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.990000
Oct 06 18:12:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.640000
Oct 06 18:12:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.300000
Oct 06 18:12:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 18:13:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.180000
Oct 06 18:13:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.580000
Oct 06 18:14:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.010000
Oct 06 18:14:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 18:14:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.000000
Oct 06 18:15:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.460000
Oct 06 18:15:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.970000
Oct 06 18:15:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 18:16:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 06 18:16:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.510000
Oct 06 18:16:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 06 18:17:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.030000
Oct 06 18:17:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 06 18:18:09 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 06 18:18:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 06 18:18:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 06 18:18:09 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 06 18:18:09 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 06 18:18:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 06 18:18:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 06 18:18:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 06 18:18:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 06 18:18:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 06 18:18:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 06 18:18:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 06 18:18:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 06 18:18:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 06 18:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 06 18:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 06 18:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 06 18:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 06 18:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 06 18:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 06 18:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 06 18:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 06 18:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 06 18:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 06 18:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 06 18:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 06 18:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 06 18:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 06 18:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 06 18:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 06 18:18:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2712, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 06 18:18:09 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 06 18:18:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 06 18:18:09 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2712 (ref=pe_calc-dc-1728209889-36322) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 06 18:18:09 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2712 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 06 18:18:09 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 06 18:18:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 06 18:18:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.940000
Oct 06 18:18:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 06 18:18:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.250000
Oct 06 18:18:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 18:19:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.990000
Oct 06 18:19:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 18:19:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.260000
Oct 06 18:19:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 18:20:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.770000
Oct 06 18:20:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 18:20:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.760000
Oct 06 18:20:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 18:21:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.490000
Oct 06 18:21:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 18:21:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.480000
Oct 06 18:21:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 18:22:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.980000
Oct 06 18:22:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.480000
Oct 06 18:23:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.160000
Oct 06 18:23:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 18:23:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.760000
Oct 06 18:23:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 18:24:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.690000
Oct 06 18:24:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 06 18:25:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.820000
Oct 06 18:25:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 06 18:25:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.500000
Oct 06 18:26:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.660000
Oct 06 18:26:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.030000
Oct 06 18:26:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 18:27:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 06 18:28:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.090000
Oct 06 18:28:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 06 18:28:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 06 18:31:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 06 18:31:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.350000
Oct 06 18:31:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was negligible)
Oct 06 18:32:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.710000
Oct 06 18:32:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.180000
Oct 06 18:33:09 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 06 18:33:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 06 18:33:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 06 18:33:09 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 06 18:33:09 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 06 18:33:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 06 18:33:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 06 18:33:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 06 18:33:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 06 18:33:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 06 18:33:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 06 18:33:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 06 18:33:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 06 18:33:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 06 18:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 06 18:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 06 18:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 06 18:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 06 18:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 06 18:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 06 18:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 06 18:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 06 18:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 06 18:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 06 18:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 06 18:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 06 18:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 06 18:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 06 18:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 06 18:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 06 18:33:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2713, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 06 18:33:09 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 06 18:33:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 06 18:33:09 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2713 (ref=pe_calc-dc-1728210789-36341) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 06 18:33:09 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2713 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 06 18:33:09 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 06 18:33:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 06 18:33:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.360000
Oct 06 18:33:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 18:33:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.290000
Oct 06 18:33:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 18:34:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.030000
Oct 06 18:34:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.050000
Oct 06 18:35:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.230000
Oct 06 18:35:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 18:35:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.270000
Oct 06 18:36:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.670000
Oct 06 18:36:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 18:36:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.620000
Oct 06 18:37:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.330000
Oct 06 18:37:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.680000
Oct 06 18:37:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 18:38:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 06 18:38:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 06 18:40:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 12.420000
Oct 06 18:40:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was negligible)
Oct 06 18:40:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.180000
Oct 06 18:41:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.030000
Oct 06 18:41:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.580000
Oct 06 18:42:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.850000
Oct 06 18:42:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 06 18:43:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.550000
Oct 06 18:43:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 06 18:43:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.550000
Oct 06 18:44:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.360000
Oct 06 18:44:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.220000
Oct 06 18:44:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 18:45:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.710000
Oct 06 18:45:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 18:45:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.660000
Oct 06 18:46:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.150000
Oct 06 18:46:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 18:46:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.790000
Oct 06 18:46:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 18:47:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.600000
Oct 06 18:47:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.420000
Oct 06 18:47:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 18:48:09 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 06 18:48:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 06 18:48:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 06 18:48:09 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 06 18:48:09 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 06 18:48:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 06 18:48:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 06 18:48:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 06 18:48:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 06 18:48:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 06 18:48:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 06 18:48:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 06 18:48:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 06 18:48:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 06 18:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 06 18:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 06 18:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 06 18:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 06 18:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 06 18:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 06 18:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 06 18:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 06 18:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 06 18:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 06 18:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 06 18:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 06 18:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 06 18:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 06 18:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 06 18:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 06 18:48:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2714, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 06 18:48:09 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 06 18:48:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 06 18:48:09 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2714 (ref=pe_calc-dc-1728211689-36357) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 06 18:48:09 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2714 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 06 18:48:09 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 06 18:48:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 06 18:48:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.800000
Oct 06 18:48:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 18:48:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.790000
Oct 06 18:48:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 18:49:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 06 18:50:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.170000
Oct 06 18:50:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 06 18:50:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.430000
Oct 06 18:51:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.930000
Oct 06 18:51:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.850000
Oct 06 18:52:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.930000
Oct 06 18:52:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 06 18:53:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 06 18:53:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.940000
Oct 06 18:53:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was negligible)
Oct 06 18:54:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.240000
Oct 06 18:54:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.830000
Oct 06 18:55:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.390000
Oct 06 18:55:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 18:55:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 06 18:56:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.820000
Oct 06 18:56:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 06 18:56:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.050000
Oct 06 18:57:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 06 18:57:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 06 18:58:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.900000
Oct 06 18:58:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was negligible)
Oct 06 18:58:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.010000
Oct 06 18:59:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.510000
Oct 06 18:59:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 18:59:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 06 19:00:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.820000
Oct 06 19:00:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 06 19:00:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.810000
Oct 06 19:01:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.780000
Oct 06 19:01:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.220000
Oct 06 19:01:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 19:02:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 06 19:02:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.310000
Oct 06 19:02:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 06 19:03:09 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 06 19:03:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 06 19:03:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 06 19:03:09 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 06 19:03:09 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 06 19:03:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 06 19:03:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 06 19:03:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 06 19:03:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 06 19:03:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 06 19:03:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 06 19:03:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 06 19:03:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 06 19:03:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 06 19:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 06 19:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 06 19:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 06 19:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 06 19:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 06 19:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 06 19:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 06 19:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 06 19:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 06 19:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 06 19:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 06 19:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 06 19:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 06 19:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 06 19:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 06 19:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 06 19:03:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2715, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 06 19:03:09 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 06 19:03:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 06 19:03:09 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2715 (ref=pe_calc-dc-1728212589-36377) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 06 19:03:09 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2715 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 06 19:03:09 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 06 19:03:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 06 19:03:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.910000
Oct 06 19:03:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 19:03:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.160000
Oct 06 19:03:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 19:04:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.290000
Oct 06 19:04:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 19:04:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.460000
Oct 06 19:05:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.230000
Oct 06 19:05:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 19:05:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.010000
Oct 06 19:06:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.750000
Oct 06 19:06:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.080000
Oct 06 19:07:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.350000
Oct 06 19:07:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.200000
Oct 06 19:08:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.380000
Oct 06 19:08:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 19:08:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was medium)
Oct 06 19:09:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was negligible)
Oct 06 19:10:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 06 19:11:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was negligible)
Oct 06 19:11:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 06 19:12:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.970000
Oct 06 19:12:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was negligible)
Oct 06 19:12:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.300000
Oct 06 19:12:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 19:13:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.400000
Oct 06 19:13:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 19:13:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.620000
Oct 06 19:14:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.030000
Oct 06 19:14:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 06 19:16:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 06 19:17:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was negligible)
Oct 06 19:18:09 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 06 19:18:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 06 19:18:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 06 19:18:09 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 06 19:18:09 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 06 19:18:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 06 19:18:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 06 19:18:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 06 19:18:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 06 19:18:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 06 19:18:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 06 19:18:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 06 19:18:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 06 19:18:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 06 19:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 06 19:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 06 19:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 06 19:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 06 19:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 06 19:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 06 19:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 06 19:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 06 19:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 06 19:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 06 19:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 06 19:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 06 19:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 06 19:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 06 19:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 06 19:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 06 19:18:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2716, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 06 19:18:09 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 06 19:18:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 06 19:18:09 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2716 (ref=pe_calc-dc-1728213489-36394) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 06 19:18:09 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2716 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 06 19:18:09 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 06 19:18:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 06 19:18:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.510000
Oct 06 19:18:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 06 19:18:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.570000
Oct 06 19:19:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.250000
Oct 06 19:19:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 19:19:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.230000
Oct 06 19:20:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.740000
Oct 06 19:20:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.210000
Oct 06 19:21:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.990000
Oct 06 19:21:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 19:21:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 06 19:22:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.400000
Oct 06 19:22:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 06 19:23:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.150000
Oct 06 19:23:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 19:23:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.280000
Oct 06 19:23:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 19:24:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.690000
Oct 06 19:24:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 19:24:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.460000
Oct 06 19:24:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 19:25:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.890000
Oct 06 19:25:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 19:25:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.830000
Oct 06 19:26:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.440000
Oct 06 19:26:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.740000
Oct 06 19:27:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.180000
Oct 06 19:27:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.120000
Oct 06 19:28:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.850000
Oct 06 19:28:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 06 19:30:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.850000
Oct 06 19:30:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 06 19:30:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.280000
Oct 06 19:31:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.470000
Oct 06 19:31:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 19:31:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.770000
Oct 06 19:32:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 06 19:32:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.000000
Oct 06 19:32:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 06 19:33:09 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 06 19:33:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 06 19:33:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 06 19:33:09 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 06 19:33:09 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 06 19:33:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 06 19:33:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 06 19:33:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 06 19:33:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 06 19:33:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 06 19:33:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 06 19:33:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 06 19:33:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 06 19:33:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 06 19:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 06 19:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 06 19:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 06 19:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 06 19:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 06 19:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 06 19:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 06 19:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 06 19:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 06 19:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 06 19:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 06 19:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 06 19:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 06 19:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 06 19:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 06 19:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 06 19:33:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2717, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 06 19:33:09 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 06 19:33:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 06 19:33:09 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2717 (ref=pe_calc-dc-1728214389-36410) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 06 19:33:09 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2717 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 06 19:33:09 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 06 19:33:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 06 19:33:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.230000
Oct 06 19:33:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 19:33:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.320000
Oct 06 19:33:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 19:34:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 12.520000
Oct 06 19:34:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.190000
Oct 06 19:35:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.110000
Oct 06 19:35:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.530000
Oct 06 19:36:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.560000
Oct 06 19:36:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.090000
Oct 06 19:36:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 19:37:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.760000
Oct 06 19:37:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.380000
Oct 06 19:37:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 19:38:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.100000
Oct 06 19:38:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.800000
Oct 06 19:38:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 19:39:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.510000
Oct 06 19:39:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 19:39:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.580000
Oct 06 19:39:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 19:40:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 06 19:40:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.150000
Oct 06 19:40:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 06 19:41:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.590000
Oct 06 19:41:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.810000
Oct 06 19:41:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 19:42:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.370000
Oct 06 19:42:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.190000
Oct 06 19:43:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.380000
Oct 06 19:43:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.770000
Oct 06 19:43:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 19:44:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.010000
Oct 06 19:44:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 19:44:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 13.140000
Oct 06 19:44:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 19:45:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.820000
Oct 06 19:45:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.940000
Oct 06 19:46:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.990000
Oct 06 19:46:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.960000
Oct 06 19:46:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 19:47:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.040000
Oct 06 19:47:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.290000
Oct 06 19:48:09 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 06 19:48:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 06 19:48:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 06 19:48:09 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 06 19:48:09 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 06 19:48:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 06 19:48:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 06 19:48:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 06 19:48:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 06 19:48:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 06 19:48:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 06 19:48:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 06 19:48:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 06 19:48:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 06 19:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 06 19:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 06 19:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 06 19:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 06 19:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 06 19:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 06 19:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 06 19:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 06 19:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 06 19:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 06 19:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 06 19:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 06 19:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 06 19:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 06 19:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 06 19:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 06 19:48:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2718, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 06 19:48:09 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 06 19:48:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 06 19:48:09 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2718 (ref=pe_calc-dc-1728215289-36425) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 06 19:48:09 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2718 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 06 19:48:09 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 06 19:48:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 06 19:48:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.550000
Oct 06 19:48:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 19:48:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.520000
Oct 06 19:49:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.550000
Oct 06 19:49:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.910000
Oct 06 19:50:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.310000
Oct 06 19:50:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.350000
Oct 06 19:50:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 19:51:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 06 19:51:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.570000
Oct 06 19:51:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 06 19:52:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 06 19:52:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 06 19:53:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.460000
Oct 06 19:53:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was negligible)
Oct 06 19:53:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.360000
Oct 06 19:53:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 19:54:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.280000
Oct 06 19:54:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.170000
Oct 06 19:55:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.930000
Oct 06 19:55:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 19:55:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.270000
Oct 06 19:55:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 19:56:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.280000
Oct 06 19:56:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 19:56:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.180000
Oct 06 19:57:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.000000
Oct 06 19:57:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.490000
Oct 06 19:58:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.130000
Oct 06 19:58:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.880000
Oct 06 19:58:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 19:59:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 06 19:59:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.580000
Oct 06 19:59:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 06 20:00:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.740000
Oct 06 20:00:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.180000
Oct 06 20:01:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.530000
Oct 06 20:01:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 06 20:02:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.490000
Oct 06 20:02:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 06 20:02:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.690000
Oct 06 20:02:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 20:03:09 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 06 20:03:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 06 20:03:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 06 20:03:09 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 06 20:03:09 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 06 20:03:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 06 20:03:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 06 20:03:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 06 20:03:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 06 20:03:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 06 20:03:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 06 20:03:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 06 20:03:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 06 20:03:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 06 20:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 06 20:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 06 20:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 06 20:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 06 20:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 06 20:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 06 20:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 06 20:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 06 20:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 06 20:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 06 20:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 06 20:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 06 20:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 06 20:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 06 20:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 06 20:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 06 20:03:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2719, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 06 20:03:09 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 06 20:03:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 06 20:03:09 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2719 (ref=pe_calc-dc-1728216189-36443) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 06 20:03:09 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2719 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 06 20:03:09 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 06 20:03:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 06 20:03:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.680000
Oct 06 20:03:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.740000
Oct 06 20:04:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.440000
Oct 06 20:04:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.920000
Oct 06 20:05:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.090000
Oct 06 20:05:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.030000
Oct 06 20:06:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.570000
Oct 06 20:06:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.880000
Oct 06 20:06:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 20:07:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.140000
Oct 06 20:07:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 06 20:08:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.830000
Oct 06 20:08:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 06 20:08:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.510000
Oct 06 20:09:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 06 20:09:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.300000
Oct 06 20:09:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 06 20:10:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.310000
Oct 06 20:10:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 20:10:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was medium)
Oct 06 20:11:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.610000
Oct 06 20:11:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was negligible)
Oct 06 20:11:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.650000
Oct 06 20:11:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 20:12:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.480000
Oct 06 20:12:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.520000
Oct 06 20:13:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.210000
Oct 06 20:13:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 20:13:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 06 20:14:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 06 20:15:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.700000
Oct 06 20:15:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was negligible)
Oct 06 20:15:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.300000
Oct 06 20:16:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.200000
Oct 06 20:16:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.170000
Oct 06 20:16:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 20:17:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was medium)
Oct 06 20:17:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.490000
Oct 06 20:17:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was negligible)
Oct 06 20:18:09 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 06 20:18:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 06 20:18:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 06 20:18:09 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 06 20:18:09 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 06 20:18:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 06 20:18:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 06 20:18:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 06 20:18:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 06 20:18:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 06 20:18:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 06 20:18:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 06 20:18:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 06 20:18:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 06 20:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 06 20:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 06 20:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 06 20:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 06 20:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 06 20:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 06 20:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 06 20:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 06 20:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 06 20:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 06 20:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 06 20:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 06 20:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 06 20:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 06 20:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 06 20:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 06 20:18:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2720, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 06 20:18:09 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 06 20:18:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 06 20:18:09 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2720 (ref=pe_calc-dc-1728217089-36460) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 06 20:18:09 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2720 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 06 20:18:09 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 06 20:18:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 06 20:18:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.170000
Oct 06 20:18:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.250000
Oct 06 20:19:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.410000
Oct 06 20:19:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 15.410000
Oct 06 20:20:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 12.530000
Oct 06 20:20:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.620000
Oct 06 20:21:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.690000
Oct 06 20:21:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.950000
Oct 06 20:21:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 20:22:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.740000
Oct 06 20:22:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 20:22:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.140000
Oct 06 20:22:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 20:23:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 12.100000
Oct 06 20:23:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 20:23:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.470000
Oct 06 20:24:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.320000
Oct 06 20:24:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 20:24:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 06 20:25:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.880000
Oct 06 20:25:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 06 20:25:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.700000
Oct 06 20:25:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 20:26:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.450000
Oct 06 20:26:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.630000
Oct 06 20:27:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.000000
Oct 06 20:27:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.820000
Oct 06 20:28:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.920000
Oct 06 20:28:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 20:28:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.910000
Oct 06 20:28:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 20:29:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.840000
Oct 06 20:29:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 20:29:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 06 20:30:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.310000
Oct 06 20:30:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 06 20:30:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.620000
Oct 06 20:30:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 20:31:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.810000
Oct 06 20:31:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 13.340000
Oct 06 20:32:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.810000
Oct 06 20:32:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.090000
Oct 06 20:33:09 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 06 20:33:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 06 20:33:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 06 20:33:09 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 06 20:33:09 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 06 20:33:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 06 20:33:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 06 20:33:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 06 20:33:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 06 20:33:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 06 20:33:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 06 20:33:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 06 20:33:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 06 20:33:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 06 20:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 06 20:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 06 20:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 06 20:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 06 20:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 06 20:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 06 20:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 06 20:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 06 20:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 06 20:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 06 20:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 06 20:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 06 20:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 06 20:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 06 20:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 06 20:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 06 20:33:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2721, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 06 20:33:09 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 06 20:33:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 06 20:33:09 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2721 (ref=pe_calc-dc-1728217989-36475) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 06 20:33:09 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2721 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 06 20:33:09 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 06 20:33:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 06 20:33:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.010000
Oct 06 20:33:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.210000
Oct 06 20:34:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.120000
Oct 06 20:34:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.190000
Oct 06 20:35:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.600000
Oct 06 20:35:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 20:35:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 06 20:36:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 06 20:36:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was negligible)
Oct 06 20:37:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 06 20:37:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.640000
Oct 06 20:37:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was negligible)
Oct 06 20:38:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.670000
Oct 06 20:38:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 20:38:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.010000
Oct 06 20:39:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.350000
Oct 06 20:39:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 20:39:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.900000
Oct 06 20:40:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 06 20:40:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.770000
Oct 06 20:40:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 06 20:41:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 06 20:41:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 06 20:42:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.730000
Oct 06 20:42:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was negligible)
Oct 06 20:43:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 06 20:43:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 06 20:44:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.740000
Oct 06 20:44:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was negligible)
Oct 06 20:45:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.290000
Oct 06 20:45:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 20:45:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.760000
Oct 06 20:45:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 20:46:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.540000
Oct 06 20:46:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.980000
Oct 06 20:47:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.400000
Oct 06 20:47:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 20:47:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.210000
Oct 06 20:47:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 20:48:09 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 06 20:48:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 06 20:48:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 06 20:48:09 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 06 20:48:09 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 06 20:48:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 06 20:48:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 06 20:48:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 06 20:48:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 06 20:48:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 06 20:48:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 06 20:48:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 06 20:48:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 06 20:48:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 06 20:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 06 20:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 06 20:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 06 20:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 06 20:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 06 20:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 06 20:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 06 20:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 06 20:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 06 20:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 06 20:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 06 20:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 06 20:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 06 20:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 06 20:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 06 20:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 06 20:48:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2722, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 06 20:48:09 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 06 20:48:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 06 20:48:09 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2722 (ref=pe_calc-dc-1728218889-36496) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 06 20:48:09 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2722 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 06 20:48:09 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 06 20:48:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 06 20:48:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.290000
Oct 06 20:48:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 20:48:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.830000
Oct 06 20:48:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 20:49:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.660000
Oct 06 20:49:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 13.060000
Oct 06 20:50:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.160000
Oct 06 20:50:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.270000
Oct 06 20:51:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.810000
Oct 06 20:51:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 13.400000
Oct 06 20:52:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.130000
Oct 06 20:52:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.720000
Oct 06 20:53:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.710000
Oct 06 20:53:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.150000
Oct 06 20:53:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 20:54:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 06 20:55:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.130000
Oct 06 20:55:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 06 20:55:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.830000
Oct 06 20:55:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 20:56:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 06 20:56:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 06 20:57:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.150000
Oct 06 20:57:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was negligible)
Oct 06 20:58:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.240000
Oct 06 20:58:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 12.010000
Oct 06 20:59:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.830000
Oct 06 20:59:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 13.840000
Oct 06 21:00:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.290000
Oct 06 21:00:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.250000
Oct 06 21:01:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.700000
Oct 06 21:01:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.950000
Oct 06 21:02:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.830000
Oct 06 21:02:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.840000
Oct 06 21:02:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 21:03:09 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 06 21:03:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 06 21:03:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 06 21:03:09 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 06 21:03:09 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 06 21:03:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 06 21:03:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 06 21:03:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 06 21:03:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 06 21:03:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 06 21:03:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 06 21:03:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 06 21:03:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 06 21:03:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 06 21:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 06 21:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 06 21:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 06 21:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 06 21:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 06 21:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 06 21:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 06 21:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 06 21:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 06 21:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 06 21:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 06 21:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 06 21:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 06 21:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 06 21:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 06 21:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 06 21:03:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2723, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 06 21:03:09 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 06 21:03:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 06 21:03:09 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2723 (ref=pe_calc-dc-1728219789-36507) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 06 21:03:09 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2723 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 06 21:03:09 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 06 21:03:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 06 21:03:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.040000
Oct 06 21:03:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 21:03:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.710000
Oct 06 21:04:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.080000
Oct 06 21:04:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.870000
Oct 06 21:05:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.250000
Oct 06 21:05:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.690000
Oct 06 21:05:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 21:06:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 06 21:08:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.530000
Oct 06 21:08:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 06 21:09:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.930000
Oct 06 21:09:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.900000
Oct 06 21:10:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.590000
Oct 06 21:10:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 06 21:11:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.030000
Oct 06 21:11:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 06 21:11:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.900000
Oct 06 21:12:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.540000
Oct 06 21:12:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 21:12:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.370000
Oct 06 21:13:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.650000
Oct 06 21:13:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.080000
Oct 06 21:14:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.230000
Oct 06 21:14:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 21:14:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 06 21:15:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.900000
Oct 06 21:15:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 06 21:16:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 12.100000
Oct 06 21:16:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.980000
Oct 06 21:17:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.670000
Oct 06 21:17:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 21:17:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.010000
Oct 06 21:17:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 21:18:09 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 06 21:18:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 06 21:18:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 06 21:18:09 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 06 21:18:09 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 06 21:18:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 06 21:18:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 06 21:18:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 06 21:18:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 06 21:18:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 06 21:18:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 06 21:18:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 06 21:18:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 06 21:18:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 06 21:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 06 21:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 06 21:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 06 21:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 06 21:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 06 21:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 06 21:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 06 21:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 06 21:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 06 21:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 06 21:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 06 21:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 06 21:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 06 21:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 06 21:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 06 21:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 06 21:18:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2724, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 06 21:18:09 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 06 21:18:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 06 21:18:09 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2724 (ref=pe_calc-dc-1728220689-36520) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 06 21:18:09 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2724 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 06 21:18:09 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 06 21:18:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 06 21:18:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.090000
Oct 06 21:18:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 21:18:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 06 21:19:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 06 21:19:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was negligible)
Oct 06 21:20:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.630000
Oct 06 21:20:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 06 21:20:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.730000
Oct 06 21:20:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 21:21:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.990000
Oct 06 21:21:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 06 21:22:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.700000
Oct 06 21:22:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 06 21:22:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 06 21:23:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.350000
Oct 06 21:23:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 06 21:23:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.850000
Oct 06 21:24:09 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.230000
Oct 06 21:24:39 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.760000
Oct 06 21:24:39 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 21:25:09 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 06 21:27:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.420000
Oct 06 21:27:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 06 21:27:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.440000
Oct 06 21:28:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 06 21:28:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 06 21:30:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was negligible)
Oct 06 21:31:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.710000
Oct 06 21:31:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 06 21:31:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.190000
Oct 06 21:32:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.910000
Oct 06 21:32:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.650000
Oct 06 21:33:09 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 06 21:33:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 06 21:33:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 06 21:33:09 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 06 21:33:09 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 06 21:33:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 06 21:33:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 06 21:33:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 06 21:33:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 06 21:33:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 06 21:33:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 06 21:33:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 06 21:33:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 06 21:33:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 06 21:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 06 21:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 06 21:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 06 21:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 06 21:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 06 21:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 06 21:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 06 21:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 06 21:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 06 21:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 06 21:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 06 21:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 06 21:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 06 21:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 06 21:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 06 21:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 06 21:33:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2725, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 06 21:33:09 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 06 21:33:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 06 21:33:09 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2725 (ref=pe_calc-dc-1728221589-36538) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 06 21:33:09 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2725 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 06 21:33:09 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 06 21:33:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 06 21:33:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.370000
Oct 06 21:33:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 21:33:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.400000
Oct 06 21:34:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 06 21:35:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 06 21:35:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.240000
Oct 06 21:35:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was negligible)
Oct 06 21:36:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 06 21:36:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.220000
Oct 06 21:36:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 06 21:37:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.780000
Oct 06 21:37:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 21:37:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.220000
Oct 06 21:37:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 21:38:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.660000
Oct 06 21:38:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.510000
Oct 06 21:39:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.440000
Oct 06 21:39:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.090000
Oct 06 21:39:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 21:40:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 06 21:41:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 06 21:41:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was negligible)
Oct 06 21:42:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.420000
Oct 06 21:42:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 06 21:42:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 06 21:44:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.910000
Oct 06 21:44:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 06 21:44:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.210000
Oct 06 21:44:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 21:45:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 06 21:46:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 06 21:48:09 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 06 21:48:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 06 21:48:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 06 21:48:09 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 06 21:48:09 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 06 21:48:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 06 21:48:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 06 21:48:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 06 21:48:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 06 21:48:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 06 21:48:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 06 21:48:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 06 21:48:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 06 21:48:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 06 21:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 06 21:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 06 21:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 06 21:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 06 21:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 06 21:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 06 21:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 06 21:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 06 21:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 06 21:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 06 21:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 06 21:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 06 21:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 06 21:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 06 21:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 06 21:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 06 21:48:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2726, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 06 21:48:09 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 06 21:48:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 06 21:48:09 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2726 (ref=pe_calc-dc-1728222489-36557) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 06 21:48:09 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2726 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 06 21:48:09 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 06 21:48:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 06 21:48:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.190000
Oct 06 21:48:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was negligible)
Oct 06 21:49:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was medium)
Oct 06 21:49:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was negligible)
Oct 06 21:50:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.480000
Oct 06 21:50:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 06 21:51:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 06 21:51:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.020000
Oct 06 21:51:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 06 21:52:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 14.230000
Oct 06 21:52:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 13.790000
Oct 06 21:53:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.470000
Oct 06 21:53:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.820000
Oct 06 21:54:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.510000
Oct 06 21:54:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.530000
Oct 06 21:54:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 21:55:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 06 21:55:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.410000
Oct 06 21:55:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 06 21:56:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.430000
Oct 06 21:56:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 21:56:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.580000
Oct 06 21:57:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.470000
Oct 06 21:57:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 21:57:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.750000
Oct 06 21:57:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 21:58:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.910000
Oct 06 21:58:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 21:58:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.350000
Oct 06 21:58:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 21:59:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.320000
Oct 06 21:59:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 06 22:00:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.680000
Oct 06 22:00:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 06 22:00:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 13.020000
Oct 06 22:01:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.570000
Oct 06 22:01:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 15.270000
Oct 06 22:02:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 13.660000
Oct 06 22:02:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 13.490000
Oct 06 22:03:09 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 06 22:03:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 06 22:03:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 06 22:03:09 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 06 22:03:09 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 06 22:03:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 06 22:03:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 06 22:03:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 06 22:03:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 06 22:03:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 06 22:03:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 06 22:03:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 06 22:03:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 06 22:03:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 06 22:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 06 22:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 06 22:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 06 22:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 06 22:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 06 22:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 06 22:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 06 22:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 06 22:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 06 22:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 06 22:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 06 22:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 06 22:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 06 22:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 06 22:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 06 22:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 06 22:03:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2727, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 06 22:03:09 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 06 22:03:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 06 22:03:09 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2727 (ref=pe_calc-dc-1728223389-36574) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 06 22:03:09 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2727 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 06 22:03:09 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 06 22:03:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 06 22:03:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 16.520000
Oct 06 22:03:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 12.570000
Oct 06 22:04:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 13.630000
Oct 06 22:04:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 17.200001
Oct 06 22:05:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 18.110001
Oct 06 22:05:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 21.110001
Oct 06 22:06:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 21.559999
Oct 06 22:06:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 20.080000
Oct 06 22:07:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 14.930000
Oct 06 22:07:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 17.370001
Oct 06 22:08:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 17.020000
Oct 06 22:08:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 20.639999
Oct 06 22:09:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 18.950001
Oct 06 22:09:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 18.469999
Oct 06 22:10:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 17.750000
Oct 06 22:10:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 20.920000
Oct 06 22:11:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 20.160000
Oct 06 22:11:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 20.690001
Oct 06 22:12:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 15.030000
Oct 06 22:12:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 16.709999
Oct 06 22:13:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 14.820000
Oct 06 22:13:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 20.049999
Oct 06 22:14:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 19.120001
Oct 06 22:14:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 20.889999
Oct 06 22:15:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 21.120001
Oct 06 22:15:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 25.110001
Oct 06 22:16:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 18.629999
Oct 06 22:16:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 16.450001
Oct 06 22:17:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 16.900000
Oct 06 22:17:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 13.930000
Oct 06 22:18:09 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 06 22:18:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 06 22:18:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 06 22:18:09 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 06 22:18:09 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 06 22:18:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 06 22:18:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 06 22:18:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 06 22:18:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 06 22:18:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 06 22:18:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 06 22:18:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 06 22:18:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 06 22:18:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 06 22:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 06 22:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 06 22:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 06 22:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 06 22:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 06 22:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 06 22:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 06 22:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 06 22:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 06 22:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 06 22:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 06 22:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 06 22:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 06 22:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 06 22:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 06 22:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 06 22:18:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2728, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 06 22:18:09 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 06 22:18:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 06 22:18:09 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2728 (ref=pe_calc-dc-1728224289-36575) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 06 22:18:09 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2728 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 06 22:18:09 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 06 22:18:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 06 22:18:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.930000
Oct 06 22:18:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.790000
Oct 06 22:19:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.840000
Oct 06 22:19:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.700000
Oct 06 22:20:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.030000
Oct 06 22:20:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 14.320000
Oct 06 22:21:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.750000
Oct 06 22:21:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 16.010000
Oct 06 22:22:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 13.840000
Oct 06 22:22:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 13.360000
Oct 06 22:23:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 12.170000
Oct 06 22:23:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.200000
Oct 06 22:24:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 12.190000
Oct 06 22:24:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 15.920000
Oct 06 22:25:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 12.310000
Oct 06 22:25:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 12.300000
Oct 06 22:26:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.530000
Oct 06 22:26:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.840000
Oct 06 22:27:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 13.620000
Oct 06 22:27:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 12.730000
Oct 06 22:28:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 12.550000
Oct 06 22:28:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 13.700000
Oct 06 22:29:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 17.320000
Oct 06 22:29:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 14.910000
Oct 06 22:30:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 13.700000
Oct 06 22:30:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 16.469999
Oct 06 22:31:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 16.590000
Oct 06 22:31:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 24.830000
Oct 06 22:32:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 17.459999
Oct 06 22:32:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 13.260000
Oct 06 22:33:09 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 06 22:33:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 06 22:33:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 06 22:33:09 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 06 22:33:09 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 06 22:33:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 06 22:33:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 06 22:33:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 06 22:33:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 06 22:33:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 06 22:33:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 06 22:33:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 06 22:33:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 06 22:33:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 06 22:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 06 22:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 06 22:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 06 22:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 06 22:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 06 22:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 06 22:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 06 22:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 06 22:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 06 22:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 06 22:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 06 22:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 06 22:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 06 22:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 06 22:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 06 22:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 06 22:33:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2729, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 06 22:33:09 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 06 22:33:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 06 22:33:09 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2729 (ref=pe_calc-dc-1728225189-36576) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 06 22:33:09 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2729 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 06 22:33:09 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 06 22:33:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 06 22:33:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.010000
Oct 06 22:33:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 16.209999
Oct 06 22:34:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 16.809999
Oct 06 22:34:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 14.990000
Oct 06 22:35:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 13.330000
Oct 06 22:35:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 13.230000
Oct 06 22:36:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 12.520000
Oct 06 22:36:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 14.320000
Oct 06 22:37:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 16.959999
Oct 06 22:37:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 15.640000
Oct 06 22:38:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 17.870001
Oct 06 22:38:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 16.440001
Oct 06 22:39:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 13.710000
Oct 06 22:39:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 19.969999
Oct 06 22:40:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 16.100000
Oct 06 22:40:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 13.340000
Oct 06 22:41:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 13.550000
Oct 06 22:41:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 12.410000
Oct 06 22:42:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 12.090000
Oct 06 22:42:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 12.240000
Oct 06 22:43:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.160000
Oct 06 22:43:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.490000
Oct 06 22:44:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.750000
Oct 06 22:44:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.410000
Oct 06 22:44:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 22:45:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was medium)
Oct 06 22:45:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.860000
Oct 06 22:45:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was negligible)
Oct 06 22:46:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.460000
Oct 06 22:46:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.800000
Oct 06 22:46:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 22:47:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.840000
Oct 06 22:47:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 22:47:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.130000
Oct 06 22:48:09 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 06 22:48:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 06 22:48:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 06 22:48:09 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 06 22:48:09 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 06 22:48:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 06 22:48:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 06 22:48:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 06 22:48:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 06 22:48:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 06 22:48:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 06 22:48:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 06 22:48:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 06 22:48:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 06 22:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 06 22:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 06 22:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 06 22:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 06 22:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 06 22:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 06 22:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 06 22:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 06 22:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 06 22:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 06 22:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 06 22:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 06 22:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 06 22:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 06 22:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 06 22:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 06 22:48:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2730, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 06 22:48:09 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 06 22:48:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 06 22:48:09 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2730 (ref=pe_calc-dc-1728226089-36582) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 06 22:48:09 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2730 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 06 22:48:09 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 06 22:48:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 06 22:48:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 06 22:49:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 06 22:50:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.910000
Oct 06 22:50:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was negligible)
Oct 06 22:51:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was medium)
Oct 06 22:52:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.670000
Oct 06 22:52:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was negligible)
Oct 06 22:52:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.580000
Oct 06 22:53:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.680000
Oct 06 22:53:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.580000
Oct 06 22:54:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.250000
Oct 06 22:54:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 22:54:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 06 22:55:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.280000
Oct 06 22:55:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 06 22:55:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 06 22:56:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 06 22:56:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.240000
Oct 06 22:56:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was negligible)
Oct 06 22:57:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.110000
Oct 06 22:57:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 06 22:58:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 06 22:58:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was negligible)
Oct 06 22:59:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 06 23:00:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.570000
Oct 06 23:00:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was negligible)
Oct 06 23:01:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 06 23:01:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.500000
Oct 06 23:01:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 06 23:02:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.390000
Oct 06 23:02:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 23:02:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.680000
Oct 06 23:03:09 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 06 23:03:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 06 23:03:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 06 23:03:09 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 06 23:03:09 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 06 23:03:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 06 23:03:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 06 23:03:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 06 23:03:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 06 23:03:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 06 23:03:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 06 23:03:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 06 23:03:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 06 23:03:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 06 23:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 06 23:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 06 23:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 06 23:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 06 23:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 06 23:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 06 23:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 06 23:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 06 23:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 06 23:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 06 23:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 06 23:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 06 23:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 06 23:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 06 23:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 06 23:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 06 23:03:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2731, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 06 23:03:09 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 06 23:03:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 06 23:03:09 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2731 (ref=pe_calc-dc-1728226989-36602) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 06 23:03:09 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2731 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 06 23:03:09 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 06 23:03:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 06 23:03:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.080000
Oct 06 23:03:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 12.410000
Oct 06 23:03:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 23:04:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.800000
Oct 06 23:04:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.480000
Oct 06 23:04:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 23:05:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was medium)
Oct 06 23:06:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.470000
Oct 06 23:06:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was negligible)
Oct 06 23:06:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 06 23:07:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 06 23:07:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 17.020000
Oct 06 23:07:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was negligible)
Oct 06 23:08:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.770000
Oct 06 23:08:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.410000
Oct 06 23:09:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 12.120000
Oct 06 23:09:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.590000
Oct 06 23:10:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.390000
Oct 06 23:10:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.620000
Oct 06 23:10:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 23:11:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was medium)
Oct 06 23:12:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was negligible)
Oct 06 23:12:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.520000
Oct 06 23:12:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 06 23:13:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.730000
Oct 06 23:13:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 23:13:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.790000
Oct 06 23:13:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 23:14:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.850000
Oct 06 23:14:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.520000
Oct 06 23:15:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.350000
Oct 06 23:15:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.410000
Oct 06 23:16:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 06 23:16:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.890000
Oct 06 23:16:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 06 23:17:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.260000
Oct 06 23:17:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 23:17:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.650000
Oct 06 23:18:09 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 06 23:18:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 06 23:18:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 06 23:18:09 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 06 23:18:09 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 06 23:18:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 06 23:18:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 06 23:18:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 06 23:18:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 06 23:18:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 06 23:18:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 06 23:18:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 06 23:18:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 06 23:18:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 06 23:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 06 23:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 06 23:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 06 23:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 06 23:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 06 23:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 06 23:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 06 23:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 06 23:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 06 23:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 06 23:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 06 23:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 06 23:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 06 23:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 06 23:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 06 23:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 06 23:18:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2732, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 06 23:18:09 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 06 23:18:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 06 23:18:09 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2732 (ref=pe_calc-dc-1728227889-36619) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 06 23:18:09 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2732 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 06 23:18:09 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 06 23:18:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 06 23:18:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 06 23:19:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 06 23:20:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was negligible)
Oct 06 23:20:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 06 23:21:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was negligible)
Oct 06 23:21:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.260000
Oct 06 23:21:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 06 23:22:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.090000
Oct 06 23:22:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 23:22:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.010000
Oct 06 23:22:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 23:23:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.300000
Oct 06 23:23:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.170000
Oct 06 23:23:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 23:24:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.510000
Oct 06 23:24:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 23:24:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.790000
Oct 06 23:24:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 23:25:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.380000
Oct 06 23:25:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 23:25:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.200000
Oct 06 23:26:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.240000
Oct 06 23:26:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 23:26:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.740000
Oct 06 23:27:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.250000
Oct 06 23:27:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.240000
Oct 06 23:28:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.440000
Oct 06 23:28:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 23:28:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.860000
Oct 06 23:29:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.610000
Oct 06 23:29:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 13.050000
Oct 06 23:30:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.190000
Oct 06 23:30:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.080000
Oct 06 23:31:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.920000
Oct 06 23:31:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.350000
Oct 06 23:31:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 23:32:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.210000
Oct 06 23:32:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 23:32:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.700000
Oct 06 23:32:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 23:33:09 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 06 23:33:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 06 23:33:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 06 23:33:09 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 06 23:33:09 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 06 23:33:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 06 23:33:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 06 23:33:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 06 23:33:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 06 23:33:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 06 23:33:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 06 23:33:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 06 23:33:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 06 23:33:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 06 23:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 06 23:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 06 23:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 06 23:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 06 23:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 06 23:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 06 23:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 06 23:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 06 23:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 06 23:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 06 23:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 06 23:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 06 23:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 06 23:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 06 23:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 06 23:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 06 23:33:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2733, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 06 23:33:09 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 06 23:33:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 06 23:33:09 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2733 (ref=pe_calc-dc-1728228789-36637) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 06 23:33:09 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2733 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 06 23:33:09 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 06 23:33:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 06 23:33:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 06 23:33:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.890000
Oct 06 23:33:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 06 23:34:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.220000
Oct 06 23:34:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.250000
Oct 06 23:34:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 23:35:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 12.420000
Oct 06 23:35:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.910000
Oct 06 23:36:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.730000
Oct 06 23:36:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 06 23:37:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 06 23:37:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.630000
Oct 06 23:37:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was negligible)
Oct 06 23:38:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 06 23:38:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.180000
Oct 06 23:38:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 06 23:39:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.750000
Oct 06 23:39:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.770000
Oct 06 23:40:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 06 23:42:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.370000
Oct 06 23:42:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 06 23:42:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 06 23:43:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.320000
Oct 06 23:43:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 06 23:43:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 06 23:44:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.130000
Oct 06 23:44:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 06 23:45:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.340000
Oct 06 23:45:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 06 23:46:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.540000
Oct 06 23:46:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 06 23:47:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.220000
Oct 06 23:47:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.300000
Oct 06 23:48:09 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 06 23:48:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 06 23:48:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 06 23:48:09 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 06 23:48:09 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 06 23:48:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 06 23:48:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 06 23:48:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 06 23:48:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 06 23:48:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 06 23:48:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 06 23:48:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 06 23:48:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 06 23:48:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 06 23:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 06 23:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 06 23:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 06 23:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 06 23:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 06 23:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 06 23:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 06 23:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 06 23:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 06 23:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 06 23:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 06 23:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 06 23:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 06 23:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 06 23:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 06 23:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 06 23:48:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2734, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 06 23:48:09 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 06 23:48:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 06 23:48:09 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2734 (ref=pe_calc-dc-1728229689-36654) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 06 23:48:09 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2734 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 06 23:48:09 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 06 23:48:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 06 23:48:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 06 23:48:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 06 23:49:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.320000
Oct 06 23:49:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was negligible)
Oct 06 23:50:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.650000
Oct 06 23:50:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.250000
Oct 06 23:51:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.170000
Oct 06 23:51:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 23:51:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.200000
Oct 06 23:52:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.570000
Oct 06 23:52:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 23:52:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.860000
Oct 06 23:53:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.430000
Oct 06 23:53:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.450000
Oct 06 23:54:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.540000
Oct 06 23:54:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 13.440000
Oct 06 23:55:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.160000
Oct 06 23:55:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.800000
Oct 06 23:56:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.050000
Oct 06 23:56:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.630000
Oct 06 23:57:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.350000
Oct 06 23:57:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 06 23:57:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.090000
Oct 06 23:58:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.940000
Oct 06 23:58:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 06 23:58:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 13.480000
Oct 06 23:59:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.710000
Oct 06 23:59:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.920000
Oct 07 00:00:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.300000
Oct 07 00:00:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.110000
Oct 07 00:01:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 07 00:02:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.820000
Oct 07 00:02:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 07 00:03:09 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 07 00:03:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 07 00:03:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 07 00:03:09 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 07 00:03:09 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 07 00:03:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 07 00:03:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 07 00:03:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 07 00:03:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 07 00:03:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 00:03:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 00:03:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 07 00:03:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 07 00:03:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 07 00:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 07 00:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 07 00:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 07 00:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 07 00:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 07 00:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 07 00:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 07 00:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 07 00:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 07 00:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 07 00:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 07 00:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 07 00:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 07 00:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 07 00:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 07 00:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 07 00:03:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2735, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 00:03:09 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 07 00:03:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 07 00:03:09 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2735 (ref=pe_calc-dc-1728230589-36664) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 00:03:09 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2735 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 07 00:03:09 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 07 00:03:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 07 00:03:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.250000
Oct 07 00:03:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 20.190001
Oct 07 00:04:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 17.700001
Oct 07 00:04:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 14.590000
Oct 07 00:05:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 13.770000
Oct 07 00:05:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.720000
Oct 07 00:06:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.120000
Oct 07 00:06:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.980000
Oct 07 00:07:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.020000
Oct 07 00:07:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.970000
Oct 07 00:08:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.170000
Oct 07 00:08:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.050000
Oct 07 00:09:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.050000
Oct 07 00:09:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.600000
Oct 07 00:10:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.800000
Oct 07 00:10:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 12.830000
Oct 07 00:11:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.070000
Oct 07 00:11:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.060000
Oct 07 00:12:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.730000
Oct 07 00:12:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.730000
Oct 07 00:13:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 07 00:13:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.180000
Oct 07 00:13:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 07 00:14:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 07 00:15:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.370000
Oct 07 00:15:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 07 00:16:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.020000
Oct 07 00:16:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.780000
Oct 07 00:16:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 00:17:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.450000
Oct 07 00:17:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 00:17:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.470000
Oct 07 00:18:09 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 07 00:18:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 07 00:18:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 07 00:18:09 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 07 00:18:09 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 07 00:18:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 07 00:18:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 07 00:18:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 07 00:18:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 07 00:18:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 00:18:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 00:18:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 07 00:18:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 07 00:18:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 07 00:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 07 00:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 07 00:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 07 00:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 07 00:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 07 00:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 07 00:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 07 00:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 07 00:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 07 00:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 07 00:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 07 00:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 07 00:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 07 00:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 07 00:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 07 00:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 07 00:18:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2736, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 00:18:09 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 07 00:18:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 07 00:18:09 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2736 (ref=pe_calc-dc-1728231489-36671) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 00:18:09 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2736 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 07 00:18:09 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 07 00:18:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 07 00:18:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 07 00:18:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.350000
Oct 07 00:18:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 07 00:19:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 07 00:19:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 07 00:20:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.890000
Oct 07 00:20:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was negligible)
Oct 07 00:20:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.560000
Oct 07 00:20:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 00:21:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.210000
Oct 07 00:21:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.860000
Oct 07 00:22:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.560000
Oct 07 00:22:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.730000
Oct 07 00:23:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 07 00:23:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.440000
Oct 07 00:23:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 07 00:24:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.290000
Oct 07 00:24:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 00:24:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.310000
Oct 07 00:24:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 00:25:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.370000
Oct 07 00:25:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 00:25:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.030000
Oct 07 00:26:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 07 00:26:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.240000
Oct 07 00:26:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 07 00:27:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.610000
Oct 07 00:27:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.140000
Oct 07 00:27:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 00:28:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 07 00:28:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.400000
Oct 07 00:28:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 07 00:29:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.570000
Oct 07 00:29:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.960000
Oct 07 00:30:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.360000
Oct 07 00:30:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 00:30:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.930000
Oct 07 00:30:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 00:31:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.570000
Oct 07 00:31:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.830000
Oct 07 00:32:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.840000
Oct 07 00:32:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 12.070000
Oct 07 00:33:09 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 07 00:33:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 07 00:33:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 07 00:33:09 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 07 00:33:09 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 07 00:33:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 07 00:33:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 07 00:33:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 07 00:33:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 07 00:33:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 00:33:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 00:33:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 07 00:33:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 07 00:33:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 07 00:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 07 00:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 07 00:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 07 00:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 07 00:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 07 00:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 07 00:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 07 00:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 07 00:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 07 00:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 07 00:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 07 00:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 07 00:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 07 00:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 07 00:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 07 00:33:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 07 00:33:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2737, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 00:33:09 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 07 00:33:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 07 00:33:09 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2737 (ref=pe_calc-dc-1728232389-36690) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 00:33:09 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2737 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 07 00:33:09 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 07 00:33:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 07 00:33:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.580000
Oct 07 00:33:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.000000
Oct 07 00:34:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.500000
Oct 07 00:34:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.130000
Oct 07 00:35:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.440000
Oct 07 00:35:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.150000
Oct 07 00:36:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.130000
Oct 07 00:36:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.100000
Oct 07 00:37:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.820000
Oct 07 00:37:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.250000
Oct 07 00:38:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.650000
Oct 07 00:38:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 00:38:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.120000
Oct 07 00:39:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.570000
Oct 07 00:39:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.380000
Oct 07 00:40:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.790000
Oct 07 00:40:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.330000
Oct 07 00:41:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.320000
Oct 07 00:41:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.820000
Oct 07 00:41:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 00:42:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 07 00:42:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.090000
Oct 07 00:42:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 07 00:43:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.890000
Oct 07 00:43:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.200000
Oct 07 00:44:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.140000
Oct 07 00:44:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 00:44:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 16.469999
Oct 07 00:44:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 00:45:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.060000
Oct 07 00:45:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.140000
Oct 07 00:46:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.090000
Oct 07 00:46:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 00:46:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.050000
Oct 07 00:46:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 00:47:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.800000
Oct 07 00:47:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.690000
Oct 07 00:48:09 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 07 00:48:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 07 00:48:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 07 00:48:09 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 07 00:48:09 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 07 00:48:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 07 00:48:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 07 00:48:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 07 00:48:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 07 00:48:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 00:48:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 00:48:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 07 00:48:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 07 00:48:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 07 00:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 07 00:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 07 00:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 07 00:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 07 00:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 07 00:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 07 00:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 07 00:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 07 00:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 07 00:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 07 00:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 07 00:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 07 00:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 07 00:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 07 00:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 07 00:48:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 07 00:48:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2738, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 00:48:09 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 07 00:48:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 07 00:48:09 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2738 (ref=pe_calc-dc-1728233289-36699) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 00:48:09 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2738 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 07 00:48:09 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 07 00:48:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 07 00:48:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.170000
Oct 07 00:48:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.760000
Oct 07 00:49:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.970000
Oct 07 00:49:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.610000
Oct 07 00:50:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.390000
Oct 07 00:50:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 00:50:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.400000
Oct 07 00:50:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 00:51:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.440000
Oct 07 00:51:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.210000
Oct 07 00:51:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 00:52:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.740000
Oct 07 00:52:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.290000
Oct 07 00:52:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 00:53:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.810000
Oct 07 00:53:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.390000
Oct 07 00:53:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 00:54:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 07 00:54:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.340000
Oct 07 00:54:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 07 00:55:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 07 00:55:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 07 00:56:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was negligible)
Oct 07 00:56:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.130000
Oct 07 00:56:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 07 00:57:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.520000
Oct 07 00:57:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.950000
Oct 07 00:58:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.550000
Oct 07 00:58:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.070000
Oct 07 00:58:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 00:59:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.470000
Oct 07 00:59:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 00:59:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.470000
Oct 07 01:00:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.810000
Oct 07 01:00:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.440000
Oct 07 01:01:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.400000
Oct 07 01:01:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 01:01:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.570000
Oct 07 01:01:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 01:02:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.850000
Oct 07 01:02:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.610000
Oct 07 01:03:09 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 07 01:03:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 07 01:03:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 07 01:03:09 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 07 01:03:09 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 07 01:03:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 07 01:03:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 07 01:03:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 07 01:03:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 07 01:03:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 01:03:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 01:03:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 07 01:03:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 07 01:03:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 07 01:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 07 01:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 07 01:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 07 01:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 07 01:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 07 01:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 07 01:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 07 01:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 07 01:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 07 01:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 07 01:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 07 01:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 07 01:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 07 01:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 07 01:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 07 01:03:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 07 01:03:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2739, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 01:03:09 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 07 01:03:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 07 01:03:09 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2739 (ref=pe_calc-dc-1728234189-36715) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 01:03:09 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2739 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 07 01:03:09 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 07 01:03:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 07 01:03:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.990000
Oct 07 01:03:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 13.830000
Oct 07 01:04:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.220000
Oct 07 01:04:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.350000
Oct 07 01:05:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.480000
Oct 07 01:05:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.440000
Oct 07 01:06:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 07 01:07:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.830000
Oct 07 01:07:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 07 01:08:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.880000
Oct 07 01:08:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.830000
Oct 07 01:09:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 07 01:09:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.630000
Oct 07 01:09:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 07 01:10:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.990000
Oct 07 01:10:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 01:10:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.420000
Oct 07 01:11:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was medium)
Oct 07 01:11:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.450000
Oct 07 01:11:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was negligible)
Oct 07 01:12:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.400000
Oct 07 01:12:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 01:12:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.840000
Oct 07 01:13:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.210000
Oct 07 01:13:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.900000
Oct 07 01:14:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.380000
Oct 07 01:14:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 01:14:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 07 01:15:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 07 01:15:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.880000
Oct 07 01:15:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was negligible)
Oct 07 01:16:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.000000
Oct 07 01:16:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.140000
Oct 07 01:17:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.220000
Oct 07 01:17:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 01:17:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.280000
Oct 07 01:18:09 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 07 01:18:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 07 01:18:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 07 01:18:09 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 07 01:18:09 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 07 01:18:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 07 01:18:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 07 01:18:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 07 01:18:09 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 07 01:18:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 01:18:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 01:18:09 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 07 01:18:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 07 01:18:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 07 01:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 07 01:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 07 01:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 07 01:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 07 01:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 07 01:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 07 01:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 07 01:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 07 01:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 07 01:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 07 01:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 07 01:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 07 01:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 07 01:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 07 01:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 07 01:18:09 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 07 01:18:09 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2740, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 01:18:09 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 07 01:18:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 07 01:18:09 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2740 (ref=pe_calc-dc-1728235089-36729) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 01:18:09 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2740 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 07 01:18:09 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 07 01:18:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 07 01:18:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 07 01:18:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.030000
Oct 07 01:18:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 07 01:19:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.840000
Oct 07 01:19:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.000000
Oct 07 01:20:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.430000
Oct 07 01:20:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 15.930000
Oct 07 01:21:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 14.480000
Oct 07 01:21:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 25.889999
Oct 07 01:22:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 17.510000
Oct 07 01:22:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 18.360001
Oct 07 01:23:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 15.010000
Oct 07 01:23:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 17.200001
Oct 07 01:24:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 17.080000
Oct 07 01:24:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 15.670000
Oct 07 01:25:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.880000
Oct 07 01:25:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 12.700000
Oct 07 01:26:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 18.059999
Oct 07 01:26:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 14.210000
Oct 07 01:27:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 19.969999
Oct 07 01:27:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 14.020000
Oct 07 01:28:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.390000
Oct 07 01:28:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.220000
Oct 07 01:29:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.320000
Oct 07 01:29:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.520000
Oct 07 01:30:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 12.710000
Oct 07 01:30:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 21.510000
Oct 07 01:31:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 15.630000
Oct 07 01:31:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 15.980000
Oct 07 01:32:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 12.370000
Oct 07 01:32:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.380000
Oct 07 01:33:09 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 07 01:33:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 07 01:33:09 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 07 01:33:10 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 07 01:33:10 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 07 01:33:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 07 01:33:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 07 01:33:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 07 01:33:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 07 01:33:10 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 01:33:10 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 01:33:10 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 07 01:33:10 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 07 01:33:10 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 07 01:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 07 01:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 07 01:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 07 01:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 07 01:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 07 01:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 07 01:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 07 01:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 07 01:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 07 01:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 07 01:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 07 01:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 07 01:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 07 01:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 07 01:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 07 01:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 07 01:33:10 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2741, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 01:33:10 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 07 01:33:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 07 01:33:10 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2741 (ref=pe_calc-dc-1728235989-36732) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 01:33:10 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2741 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 07 01:33:10 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 07 01:33:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 07 01:33:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.770000
Oct 07 01:33:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.850000
Oct 07 01:34:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 16.900000
Oct 07 01:34:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 12.740000
Oct 07 01:35:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.450000
Oct 07 01:35:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.620000
Oct 07 01:36:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 12.530000
Oct 07 01:36:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 12.300000
Oct 07 01:37:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.220000
Oct 07 01:37:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 13.480000
Oct 07 01:38:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.700000
Oct 07 01:38:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.580000
Oct 07 01:39:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 07 01:39:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.420000
Oct 07 01:39:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 07 01:40:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.790000
Oct 07 01:40:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.150000
Oct 07 01:40:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 01:41:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.020000
Oct 07 01:41:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 01:41:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.270000
Oct 07 01:41:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 01:42:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.340000
Oct 07 01:42:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.910000
Oct 07 01:42:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 01:43:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.750000
Oct 07 01:43:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 01:43:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.830000
Oct 07 01:44:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 07 01:45:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.860000
Oct 07 01:45:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 07 01:45:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.700000
Oct 07 01:45:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 01:46:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.650000
Oct 07 01:46:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.940000
Oct 07 01:47:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.330000
Oct 07 01:47:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 01:47:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.120000
Oct 07 01:47:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 01:48:10 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 07 01:48:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 07 01:48:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 07 01:48:10 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 07 01:48:10 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 07 01:48:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 07 01:48:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 07 01:48:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 07 01:48:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 07 01:48:10 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 01:48:10 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 01:48:10 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 07 01:48:10 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 07 01:48:10 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 07 01:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 07 01:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 07 01:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 07 01:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 07 01:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 07 01:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 07 01:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 07 01:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 07 01:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 07 01:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 07 01:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 07 01:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 07 01:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 07 01:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 07 01:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 07 01:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 07 01:48:10 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2742, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 01:48:10 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 07 01:48:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 07 01:48:10 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2742 (ref=pe_calc-dc-1728236890-36745) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 01:48:10 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2742 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 07 01:48:10 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 07 01:48:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 07 01:48:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.500000
Oct 07 01:48:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 07 01:49:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.580000
Oct 07 01:49:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 07 01:49:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.120000
Oct 07 01:50:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.910000
Oct 07 01:50:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.400000
Oct 07 01:51:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.150000
Oct 07 01:51:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 01:51:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.240000
Oct 07 01:52:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.310000
Oct 07 01:52:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 07 01:53:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.270000
Oct 07 01:53:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 07 01:53:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.010000
Oct 07 01:54:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.950000
Oct 07 01:54:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.720000
Oct 07 01:54:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 01:55:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.820000
Oct 07 01:55:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 01:55:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.550000
Oct 07 01:56:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.180000
Oct 07 01:56:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.260000
Oct 07 01:57:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.520000
Oct 07 01:57:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.020000
Oct 07 01:57:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 01:58:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 07 01:58:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.640000
Oct 07 01:58:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 07 01:59:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.770000
Oct 07 01:59:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 01:59:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.450000
Oct 07 02:00:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.620000
Oct 07 02:00:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.910000
Oct 07 02:01:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.180000
Oct 07 02:01:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.010000
Oct 07 02:01:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 02:02:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.080000
Oct 07 02:02:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 02:02:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 07 02:03:10 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 07 02:03:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 07 02:03:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 07 02:03:10 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 07 02:03:10 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 07 02:03:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 07 02:03:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 07 02:03:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 07 02:03:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 07 02:03:10 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 02:03:10 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 02:03:10 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 07 02:03:10 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 07 02:03:10 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 07 02:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 07 02:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 07 02:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 07 02:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 07 02:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 07 02:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 07 02:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 07 02:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 07 02:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 07 02:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 07 02:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 07 02:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 07 02:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 07 02:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 07 02:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 07 02:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 07 02:03:10 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2743, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 02:03:10 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 07 02:03:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 07 02:03:10 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2743 (ref=pe_calc-dc-1728237790-36760) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 02:03:10 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2743 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 07 02:03:10 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 07 02:03:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 07 02:03:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 07 02:03:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.520000
Oct 07 02:03:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was negligible)
Oct 07 02:04:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.670000
Oct 07 02:04:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.790000
Oct 07 02:05:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.300000
Oct 07 02:05:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 02:05:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.000000
Oct 07 02:05:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 02:06:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.150000
Oct 07 02:06:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.680000
Oct 07 02:07:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.090000
Oct 07 02:07:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.840000
Oct 07 02:08:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.460000
Oct 07 02:08:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.730000
Oct 07 02:09:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.790000
Oct 07 02:09:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 07 02:10:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 07 02:11:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was negligible)
Oct 07 02:11:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 07 02:14:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was negligible)
Oct 07 02:15:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.060000
Oct 07 02:15:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 07 02:15:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 07 02:16:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 07 02:17:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.250000
Oct 07 02:17:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was negligible)
Oct 07 02:17:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.220000
Oct 07 02:17:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 02:18:10 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 07 02:18:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 07 02:18:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 07 02:18:10 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 07 02:18:10 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 07 02:18:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 07 02:18:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 07 02:18:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 07 02:18:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 07 02:18:10 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 02:18:10 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 02:18:10 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 07 02:18:10 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 07 02:18:10 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 07 02:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 07 02:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 07 02:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 07 02:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 07 02:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 07 02:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 07 02:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 07 02:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 07 02:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 07 02:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 07 02:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 07 02:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 07 02:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 07 02:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 07 02:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 07 02:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 07 02:18:10 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2744, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 02:18:10 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 07 02:18:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 07 02:18:10 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2744 (ref=pe_calc-dc-1728238690-36775) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 02:18:10 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2744 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 07 02:18:10 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 07 02:18:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 07 02:18:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.670000
Oct 07 02:18:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.720000
Oct 07 02:19:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 07 02:21:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 07 02:21:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was negligible)
Oct 07 02:22:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.340000
Oct 07 02:22:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 07 02:22:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.500000
Oct 07 02:22:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 02:23:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.750000
Oct 07 02:23:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 07 02:24:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.600000
Oct 07 02:24:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 07 02:24:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.610000
Oct 07 02:25:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.260000
Oct 07 02:25:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 07 02:26:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 07 02:27:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was negligible)
Oct 07 02:29:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 07 02:30:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.020000
Oct 07 02:30:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was negligible)
Oct 07 02:30:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.360000
Oct 07 02:31:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.090000
Oct 07 02:31:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.550000
Oct 07 02:32:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.150000
Oct 07 02:32:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 02:32:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was medium)
Oct 07 02:33:10 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 07 02:33:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 07 02:33:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 07 02:33:10 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 07 02:33:10 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 07 02:33:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 07 02:33:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 07 02:33:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 07 02:33:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 07 02:33:10 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 02:33:10 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 02:33:10 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 07 02:33:10 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 07 02:33:10 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 07 02:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 07 02:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 07 02:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 07 02:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 07 02:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 07 02:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 07 02:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 07 02:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 07 02:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 07 02:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 07 02:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 07 02:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 07 02:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 07 02:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 07 02:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 07 02:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 07 02:33:10 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2745, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 02:33:10 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 07 02:33:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 07 02:33:10 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2745 (ref=pe_calc-dc-1728239590-36790) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 02:33:10 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2745 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 07 02:33:10 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 07 02:33:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 07 02:33:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.980000
Oct 07 02:33:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was negligible)
Oct 07 02:33:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.830000
Oct 07 02:34:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.130000
Oct 07 02:34:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 14.870000
Oct 07 02:35:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 13.010000
Oct 07 02:35:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 12.380000
Oct 07 02:36:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.190000
Oct 07 02:36:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 14.710000
Oct 07 02:37:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.590000
Oct 07 02:37:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.850000
Oct 07 02:38:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.880000
Oct 07 02:38:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 02:38:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 07 02:39:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 07 02:40:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.890000
Oct 07 02:40:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was negligible)
Oct 07 02:40:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.610000
Oct 07 02:41:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 07 02:41:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.330000
Oct 07 02:41:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 07 02:42:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was medium)
Oct 07 02:44:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 14.420000
Oct 07 02:44:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was negligible)
Oct 07 02:45:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 12.320000
Oct 07 02:45:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.590000
Oct 07 02:46:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.990000
Oct 07 02:46:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 02:46:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.080000
Oct 07 02:46:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 02:47:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.390000
Oct 07 02:47:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.730000
Oct 07 02:47:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 02:48:10 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 07 02:48:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 07 02:48:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 07 02:48:10 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 07 02:48:10 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 07 02:48:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 07 02:48:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 07 02:48:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 07 02:48:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 07 02:48:10 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 02:48:10 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 02:48:10 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 07 02:48:10 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 07 02:48:10 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 07 02:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 07 02:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 07 02:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 07 02:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 07 02:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 07 02:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 07 02:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 07 02:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 07 02:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 07 02:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 07 02:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 07 02:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 07 02:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 07 02:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 07 02:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 07 02:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 07 02:48:10 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2746, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 02:48:10 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 07 02:48:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 07 02:48:10 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2746 (ref=pe_calc-dc-1728240490-36803) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 02:48:10 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2746 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 07 02:48:10 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 07 02:48:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 07 02:48:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 07 02:48:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 07 02:49:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.600000
Oct 07 02:49:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was negligible)
Oct 07 02:49:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 07 02:50:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 07 02:51:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was negligible)
Oct 07 02:52:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 07 02:55:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.970000
Oct 07 02:55:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was negligible)
Oct 07 02:56:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 07 02:56:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.660000
Oct 07 02:56:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 07 02:57:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.640000
Oct 07 02:57:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 02:57:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.160000
Oct 07 02:57:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 02:58:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.200000
Oct 07 02:58:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.460000
Oct 07 02:59:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 07 03:00:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 07 03:00:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was negligible)
Oct 07 03:01:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 07 03:01:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.830000
Oct 07 03:01:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was negligible)
Oct 07 03:02:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.490000
Oct 07 03:02:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 03:02:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.580000
Oct 07 03:03:10 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 07 03:03:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 07 03:03:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 07 03:03:10 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 07 03:03:10 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 07 03:03:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 07 03:03:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 07 03:03:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 07 03:03:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 07 03:03:10 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 03:03:10 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 03:03:10 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 07 03:03:10 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 07 03:03:10 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 07 03:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 07 03:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 07 03:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 07 03:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 07 03:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 07 03:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 07 03:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 07 03:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 07 03:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 07 03:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 07 03:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 07 03:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 07 03:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 07 03:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 07 03:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 07 03:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 07 03:03:10 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2747, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 03:03:10 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 07 03:03:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 07 03:03:10 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2747 (ref=pe_calc-dc-1728241390-36822) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 03:03:10 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2747 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 07 03:03:10 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 07 03:03:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 07 03:03:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.260000
Oct 07 03:03:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.150000
Oct 07 03:04:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.690000
Oct 07 03:04:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 03:04:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.300000
Oct 07 03:04:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 03:05:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.130000
Oct 07 03:05:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 03:05:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 07 03:06:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 07 03:06:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.240000
Oct 07 03:06:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was negligible)
Oct 07 03:07:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was medium)
Oct 07 03:07:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.010000
Oct 07 03:07:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was negligible)
Oct 07 03:08:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 07 03:08:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 07 03:09:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.920000
Oct 07 03:09:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was negligible)
Oct 07 03:09:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 07 03:10:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 07 03:13:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.260000
Oct 07 03:13:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was negligible)
Oct 07 03:14:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.790000
Oct 07 03:14:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 07 03:15:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 07 03:16:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.410000
Oct 07 03:16:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was negligible)
Oct 07 03:17:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.370000
Oct 07 03:17:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.760000
Oct 07 03:18:10 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 07 03:18:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 07 03:18:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 07 03:18:10 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 07 03:18:10 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 07 03:18:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 07 03:18:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 07 03:18:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 07 03:18:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 07 03:18:10 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 03:18:10 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 03:18:10 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 07 03:18:10 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 07 03:18:10 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 07 03:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 07 03:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 07 03:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 07 03:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 07 03:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 07 03:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 07 03:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 07 03:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 07 03:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 07 03:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 07 03:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 07 03:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 07 03:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 07 03:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 07 03:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 07 03:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 07 03:18:10 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2748, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 03:18:10 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 07 03:18:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 07 03:18:10 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2748 (ref=pe_calc-dc-1728242290-36840) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 03:18:10 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2748 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 07 03:18:10 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 07 03:18:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 07 03:18:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.090000
Oct 07 03:18:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 03:18:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.700000
Oct 07 03:18:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 03:19:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.280000
Oct 07 03:19:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 03:19:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.770000
Oct 07 03:19:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 03:20:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.730000
Oct 07 03:20:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.270000
Oct 07 03:21:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.450000
Oct 07 03:21:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.820000
Oct 07 03:21:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 03:22:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 07 03:23:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 07 03:25:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was negligible)
Oct 07 03:25:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.850000
Oct 07 03:25:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 07 03:26:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 07 03:26:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 07 03:27:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.160000
Oct 07 03:27:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was negligible)
Oct 07 03:28:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.420000
Oct 07 03:28:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.450000
Oct 07 03:29:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 07 03:29:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.730000
Oct 07 03:29:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 07 03:30:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.010000
Oct 07 03:30:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.800000
Oct 07 03:30:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 03:31:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.560000
Oct 07 03:31:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 03:31:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.140000
Oct 07 03:32:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.130000
Oct 07 03:32:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.530000
Oct 07 03:32:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 03:33:10 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 07 03:33:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 07 03:33:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 07 03:33:10 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 07 03:33:10 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 07 03:33:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 07 03:33:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 07 03:33:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 07 03:33:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 07 03:33:10 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 03:33:10 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 03:33:10 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 07 03:33:10 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 07 03:33:10 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 07 03:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 07 03:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 07 03:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 07 03:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 07 03:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 07 03:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 07 03:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 07 03:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 07 03:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 07 03:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 07 03:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 07 03:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 07 03:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 07 03:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 07 03:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 07 03:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 07 03:33:10 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2749, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 03:33:10 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 07 03:33:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 07 03:33:10 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2749 (ref=pe_calc-dc-1728243190-36858) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 03:33:10 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2749 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 07 03:33:10 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 07 03:33:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 07 03:33:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 07 03:33:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.350000
Oct 07 03:33:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 07 03:34:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 07 03:34:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 07 03:35:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.630000
Oct 07 03:35:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was negligible)
Oct 07 03:35:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.000000
Oct 07 03:35:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 03:36:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.090000
Oct 07 03:36:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 07 03:37:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.170000
Oct 07 03:37:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 07 03:37:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 07 03:38:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 07 03:42:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was negligible)
Oct 07 03:43:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.510000
Oct 07 03:43:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 07 03:44:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.480000
Oct 07 03:44:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.260000
Oct 07 03:45:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.490000
Oct 07 03:45:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 03:45:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 07 03:46:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 07 03:48:10 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 07 03:48:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 07 03:48:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 07 03:48:10 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 07 03:48:10 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 07 03:48:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 07 03:48:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 07 03:48:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 07 03:48:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 07 03:48:10 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 03:48:10 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 03:48:10 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 07 03:48:10 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 07 03:48:10 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 07 03:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 07 03:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 07 03:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 07 03:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 07 03:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 07 03:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 07 03:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 07 03:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 07 03:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 07 03:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 07 03:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 07 03:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 07 03:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 07 03:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 07 03:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 07 03:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 07 03:48:10 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2750, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 03:48:10 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 07 03:48:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 07 03:48:10 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2750 (ref=pe_calc-dc-1728244090-36874) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 03:48:10 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2750 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 07 03:48:10 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 07 03:48:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 07 03:48:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was negligible)
Oct 07 03:48:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.380000
Oct 07 03:48:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 07 03:49:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 07 03:49:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 07 03:50:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.260000
Oct 07 03:50:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was negligible)
Oct 07 03:50:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was medium)
Oct 07 03:51:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was negligible)
Oct 07 03:52:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 07 03:55:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was negligible)
Oct 07 03:56:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.080000
Oct 07 03:56:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 07 03:57:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.890000
Oct 07 03:57:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.320000
Oct 07 03:57:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 03:58:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.060000
Oct 07 03:58:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 03:58:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.830000
Oct 07 03:59:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.550000
Oct 07 03:59:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 03:59:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 07 04:00:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.420000
Oct 07 04:00:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 07 04:00:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.150000
Oct 07 04:00:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 04:01:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.770000
Oct 07 04:01:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 04:01:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 13.190000
Oct 07 04:02:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.720000
Oct 07 04:02:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.380000
Oct 07 04:03:10 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 07 04:03:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 07 04:03:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 07 04:03:10 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 07 04:03:10 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 07 04:03:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 07 04:03:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 07 04:03:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 07 04:03:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 07 04:03:10 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 04:03:10 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 04:03:10 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 07 04:03:10 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 07 04:03:10 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 07 04:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 07 04:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 07 04:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 07 04:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 07 04:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 07 04:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 07 04:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 07 04:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 07 04:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 07 04:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 07 04:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 07 04:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 07 04:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 07 04:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 07 04:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 07 04:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 07 04:03:10 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2751, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 04:03:10 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 07 04:03:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 07 04:03:10 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2751 (ref=pe_calc-dc-1728244990-36892) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 04:03:10 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2751 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 07 04:03:10 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 07 04:03:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 07 04:03:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 07 04:03:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.580000
Oct 07 04:03:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 07 04:04:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.320000
Oct 07 04:04:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.560000
Oct 07 04:04:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 04:05:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.110000
Oct 07 04:05:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 04:05:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.490000
Oct 07 04:06:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 07 04:06:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.350000
Oct 07 04:06:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 07 04:07:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 07 04:07:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.940000
Oct 07 04:07:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 07 04:08:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 07 04:08:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.330000
Oct 07 04:08:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 07 04:09:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.640000
Oct 07 04:09:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 04:09:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.310000
Oct 07 04:09:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 04:10:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was medium)
Oct 07 04:10:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was negligible)
Oct 07 04:12:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.310000
Oct 07 04:12:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 07 04:13:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was medium)
Oct 07 04:14:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.110000
Oct 07 04:14:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was negligible)
Oct 07 04:14:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.050000
Oct 07 04:15:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.050000
Oct 07 04:15:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.570000
Oct 07 04:15:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 04:16:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.120000
Oct 07 04:16:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 04:16:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.590000
Oct 07 04:16:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 04:17:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 07 04:17:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.670000
Oct 07 04:17:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 07 04:18:10 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 07 04:18:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 07 04:18:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 07 04:18:10 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 07 04:18:10 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 07 04:18:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 07 04:18:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 07 04:18:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 07 04:18:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 07 04:18:10 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 04:18:10 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 04:18:10 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 07 04:18:10 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 07 04:18:10 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 07 04:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 07 04:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 07 04:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 07 04:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 07 04:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 07 04:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 07 04:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 07 04:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 07 04:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 07 04:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 07 04:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 07 04:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 07 04:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 07 04:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 07 04:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 07 04:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 07 04:18:10 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2752, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 04:18:10 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 07 04:18:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 07 04:18:10 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2752 (ref=pe_calc-dc-1728245890-36915) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 04:18:10 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2752 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 07 04:18:10 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 07 04:18:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 07 04:18:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 07 04:19:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.230000
Oct 07 04:19:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 07 04:19:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.610000
Oct 07 04:20:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.930000
Oct 07 04:20:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 14.790000
Oct 07 04:21:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.790000
Oct 07 04:21:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.740000
Oct 07 04:22:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.930000
Oct 07 04:22:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 04:22:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.700000
Oct 07 04:22:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 04:23:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.140000
Oct 07 04:23:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 04:23:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.830000
Oct 07 04:23:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 04:24:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.820000
Oct 07 04:24:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.200000
Oct 07 04:24:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 04:25:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 07 04:25:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 07 04:26:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was negligible)
Oct 07 04:27:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.080000
Oct 07 04:27:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 07 04:27:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.490000
Oct 07 04:28:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 07 04:29:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.180000
Oct 07 04:29:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 07 04:29:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 07 04:30:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 07 04:30:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.920000
Oct 07 04:30:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was negligible)
Oct 07 04:31:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was medium)
Oct 07 04:32:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.600000
Oct 07 04:32:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was negligible)
Oct 07 04:33:10 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 07 04:33:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 07 04:33:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 07 04:33:10 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 07 04:33:10 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 07 04:33:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 07 04:33:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 07 04:33:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 07 04:33:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 07 04:33:10 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 04:33:10 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 04:33:10 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 07 04:33:10 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 07 04:33:10 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 07 04:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 07 04:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 07 04:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 07 04:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 07 04:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 07 04:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 07 04:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 07 04:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 07 04:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 07 04:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 07 04:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 07 04:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 07 04:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 07 04:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 07 04:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 07 04:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 07 04:33:10 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2753, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 04:33:10 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 07 04:33:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 07 04:33:10 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2753 (ref=pe_calc-dc-1728246790-36934) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 04:33:10 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2753 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 07 04:33:10 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 07 04:33:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 07 04:33:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was medium)
Oct 07 04:35:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.750000
Oct 07 04:35:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was negligible)
Oct 07 04:35:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was medium)
Oct 07 04:36:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was negligible)
Oct 07 04:36:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 07 04:37:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.230000
Oct 07 04:37:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was negligible)
Oct 07 04:38:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.720000
Oct 07 04:38:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 04:38:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.470000
Oct 07 04:38:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 04:39:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 07 04:39:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.720000
Oct 07 04:39:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 07 04:40:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.210000
Oct 07 04:40:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 04:40:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.440000
Oct 07 04:40:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 04:41:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 07 04:41:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 07 04:42:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.970000
Oct 07 04:42:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was negligible)
Oct 07 04:42:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.960000
Oct 07 04:43:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.760000
Oct 07 04:43:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.920000
Oct 07 04:43:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 04:44:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 07 04:45:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.770000
Oct 07 04:45:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 07 04:45:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.780000
Oct 07 04:46:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.310000
Oct 07 04:46:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.170000
Oct 07 04:46:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 04:47:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.330000
Oct 07 04:47:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 04:47:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.220000
Oct 07 04:47:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 04:48:10 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 07 04:48:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 07 04:48:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 07 04:48:10 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 07 04:48:10 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 07 04:48:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 07 04:48:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 07 04:48:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 07 04:48:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 07 04:48:10 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 04:48:10 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 04:48:10 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 07 04:48:10 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 07 04:48:10 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 07 04:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 07 04:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 07 04:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 07 04:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 07 04:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 07 04:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 07 04:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 07 04:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 07 04:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 07 04:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 07 04:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 07 04:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 07 04:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 07 04:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 07 04:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 07 04:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 07 04:48:10 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2754, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 04:48:10 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 07 04:48:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 07 04:48:10 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2754 (ref=pe_calc-dc-1728247690-36956) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 04:48:10 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2754 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 07 04:48:10 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 07 04:48:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 07 04:48:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 07 04:48:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.640000
Oct 07 04:48:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 07 04:49:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.190000
Oct 07 04:49:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 04:49:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 07 04:50:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 07 04:51:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was negligible)
Oct 07 04:52:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.500000
Oct 07 04:52:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 07 04:52:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 07 04:53:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 07 04:53:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was negligible)
Oct 07 04:54:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.240000
Oct 07 04:54:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 07 04:54:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.680000
Oct 07 04:54:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 04:55:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 07 04:55:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.310000
Oct 07 04:55:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 07 04:56:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.150000
Oct 07 04:56:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.940000
Oct 07 04:56:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 04:57:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.570000
Oct 07 04:57:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.520000
Oct 07 04:58:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 07 04:59:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 07 04:59:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.540000
Oct 07 04:59:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was negligible)
Oct 07 05:00:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.990000
Oct 07 05:00:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.090000
Oct 07 05:01:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.470000
Oct 07 05:01:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 07 05:02:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 07 05:02:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.890000
Oct 07 05:02:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was negligible)
Oct 07 05:03:10 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 07 05:03:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 07 05:03:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 07 05:03:10 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 07 05:03:10 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 07 05:03:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 07 05:03:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 07 05:03:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 07 05:03:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 07 05:03:10 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 05:03:10 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 05:03:10 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 07 05:03:10 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 07 05:03:10 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 07 05:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 07 05:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 07 05:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 07 05:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 07 05:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 07 05:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 07 05:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 07 05:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 07 05:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 07 05:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 07 05:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 07 05:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 07 05:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 07 05:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 07 05:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 07 05:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 07 05:03:10 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2755, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 05:03:10 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 07 05:03:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 07 05:03:10 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2755 (ref=pe_calc-dc-1728248590-36978) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 05:03:10 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2755 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 07 05:03:10 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 07 05:03:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 07 05:03:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.800000
Oct 07 05:03:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.220000
Oct 07 05:03:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 05:04:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 07 05:04:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 07 05:05:40 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was negligible)
Oct 07 05:06:10 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.970000
Oct 07 05:06:10 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 07 05:06:40 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.740000
Oct 07 05:07:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.780000
Oct 07 05:07:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 05:07:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.710000
Oct 07 05:08:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.840000
Oct 07 05:08:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 05:08:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.280000
Oct 07 05:09:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 07 05:10:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.480000
Oct 07 05:10:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 07 05:10:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.760000
Oct 07 05:11:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 07 05:11:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.660000
Oct 07 05:11:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 07 05:12:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.370000
Oct 07 05:12:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.400000
Oct 07 05:13:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.650000
Oct 07 05:13:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.590000
Oct 07 05:14:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.910000
Oct 07 05:14:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.580000
Oct 07 05:14:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 05:15:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 07 05:15:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 07 05:16:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was negligible)
Oct 07 05:16:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 07 05:17:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.530000
Oct 07 05:17:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was negligible)
Oct 07 05:17:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.740000
Oct 07 05:18:10 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 07 05:18:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 07 05:18:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 07 05:18:10 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 07 05:18:10 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 07 05:18:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 07 05:18:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 07 05:18:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 07 05:18:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 07 05:18:10 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 05:18:10 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 05:18:10 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 07 05:18:10 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 07 05:18:10 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 07 05:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 07 05:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 07 05:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 07 05:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 07 05:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 07 05:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 07 05:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 07 05:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 07 05:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 07 05:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 07 05:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 07 05:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 07 05:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 07 05:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 07 05:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 07 05:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 07 05:18:10 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2756, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 05:18:10 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 07 05:18:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 07 05:18:10 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2756 (ref=pe_calc-dc-1728249490-36996) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 05:18:10 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2756 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 07 05:18:10 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 07 05:18:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 07 05:18:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.660000
Oct 07 05:18:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.270000
Oct 07 05:19:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 07 05:20:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.590000
Oct 07 05:20:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 07 05:20:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.980000
Oct 07 05:20:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 05:21:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.490000
Oct 07 05:21:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 05:21:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.680000
Oct 07 05:22:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.490000
Oct 07 05:22:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.490000
Oct 07 05:23:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 15.440000
Oct 07 05:23:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 13.020000
Oct 07 05:24:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.710000
Oct 07 05:24:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 12.920000
Oct 07 05:25:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.340000
Oct 07 05:25:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.170000
Oct 07 05:25:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 05:26:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.920000
Oct 07 05:26:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 05:26:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.570000
Oct 07 05:27:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 07 05:29:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.390000
Oct 07 05:29:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 07 05:29:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 07 05:30:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 07 05:30:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.560000
Oct 07 05:30:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was negligible)
Oct 07 05:31:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 07 05:31:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 07 05:32:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.230000
Oct 07 05:32:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was negligible)
Oct 07 05:32:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was medium)
Oct 07 05:33:10 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 07 05:33:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 07 05:33:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 07 05:33:10 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 07 05:33:10 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 07 05:33:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 07 05:33:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 07 05:33:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 07 05:33:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 07 05:33:10 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 05:33:10 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 05:33:10 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 07 05:33:10 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 07 05:33:10 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 07 05:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 07 05:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 07 05:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 07 05:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 07 05:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 07 05:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 07 05:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 07 05:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 07 05:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 07 05:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 07 05:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 07 05:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 07 05:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 07 05:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 07 05:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 07 05:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 07 05:33:10 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2757, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 05:33:10 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 07 05:33:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 07 05:33:10 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2757 (ref=pe_calc-dc-1728250390-37012) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 05:33:10 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2757 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 07 05:33:10 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 07 05:33:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 07 05:33:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.210000
Oct 07 05:33:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was negligible)
Oct 07 05:33:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 07 05:34:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.240000
Oct 07 05:34:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 07 05:34:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 07 05:35:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.420000
Oct 07 05:35:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 07 05:36:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.000000
Oct 07 05:36:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 07 05:37:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 07 05:38:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was negligible)
Oct 07 05:38:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.930000
Oct 07 05:38:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 07 05:39:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.220000
Oct 07 05:39:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 07 05:40:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.760000
Oct 07 05:40:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 07 05:40:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 07 05:41:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 07 05:42:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was negligible)
Oct 07 05:43:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 07 05:43:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.180000
Oct 07 05:43:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was negligible)
Oct 07 05:44:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.000000
Oct 07 05:44:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.170000
Oct 07 05:44:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 05:45:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 07 05:45:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.510000
Oct 07 05:45:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 07 05:46:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.140000
Oct 07 05:46:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 05:46:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.320000
Oct 07 05:46:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 05:47:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.770000
Oct 07 05:47:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.490000
Oct 07 05:48:10 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 07 05:48:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 07 05:48:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 07 05:48:10 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 07 05:48:10 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 07 05:48:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 07 05:48:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 07 05:48:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 07 05:48:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 07 05:48:10 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 05:48:10 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 05:48:10 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 07 05:48:10 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 07 05:48:10 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 07 05:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 07 05:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 07 05:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 07 05:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 07 05:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 07 05:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 07 05:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 07 05:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 07 05:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 07 05:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 07 05:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 07 05:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 07 05:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 07 05:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 07 05:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 07 05:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 07 05:48:10 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2758, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 05:48:10 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 07 05:48:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 07 05:48:10 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2758 (ref=pe_calc-dc-1728251290-37034) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 05:48:10 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2758 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 07 05:48:10 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 07 05:48:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 07 05:48:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.810000
Oct 07 05:48:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 05:48:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.720000
Oct 07 05:48:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 05:49:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.120000
Oct 07 05:49:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.420000
Oct 07 05:49:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 05:50:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 07 05:50:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.550000
Oct 07 05:50:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 07 05:51:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.720000
Oct 07 05:51:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 05:51:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.790000
Oct 07 05:51:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 05:52:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.080000
Oct 07 05:52:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 07 05:53:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.400000
Oct 07 05:53:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 07 05:53:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.260000
Oct 07 05:54:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 07 05:54:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.980000
Oct 07 05:54:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 07 05:55:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 07 05:56:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.520000
Oct 07 05:56:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 07 05:56:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.520000
Oct 07 05:57:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.230000
Oct 07 05:57:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.380000
Oct 07 05:57:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 05:58:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.640000
Oct 07 05:58:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 05:58:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.110000
Oct 07 05:59:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.450000
Oct 07 05:59:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.400000
Oct 07 06:00:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.310000
Oct 07 06:00:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.560000
Oct 07 06:01:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.350000
Oct 07 06:01:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.590000
Oct 07 06:02:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.140000
Oct 07 06:02:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.540000
Oct 07 06:03:10 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 07 06:03:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 07 06:03:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 07 06:03:10 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 07 06:03:10 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 07 06:03:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 07 06:03:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 07 06:03:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 07 06:03:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 07 06:03:10 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 06:03:10 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 06:03:10 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 07 06:03:10 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 07 06:03:10 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 07 06:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 07 06:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 07 06:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 07 06:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 07 06:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 07 06:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 07 06:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 07 06:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 07 06:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 07 06:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 07 06:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 07 06:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 07 06:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 07 06:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 07 06:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 07 06:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 07 06:03:10 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2759, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 06:03:10 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 07 06:03:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 07 06:03:10 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2759 (ref=pe_calc-dc-1728252190-37050) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 06:03:10 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2759 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 07 06:03:10 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 07 06:03:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 07 06:03:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.440000
Oct 07 06:03:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.920000
Oct 07 06:04:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.710000
Oct 07 06:04:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.770000
Oct 07 06:05:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.140000
Oct 07 06:05:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.830000
Oct 07 06:06:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.150000
Oct 07 06:06:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 06:06:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 07 06:08:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 07 06:09:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was negligible)
Oct 07 06:10:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.430000
Oct 07 06:10:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 07 06:10:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.220000
Oct 07 06:11:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.670000
Oct 07 06:11:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.200000
Oct 07 06:12:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.900000
Oct 07 06:12:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 06:12:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 07 06:13:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.290000
Oct 07 06:13:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 07 06:13:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.760000
Oct 07 06:14:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.640000
Oct 07 06:14:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 06:14:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.570000
Oct 07 06:14:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 06:15:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.790000
Oct 07 06:15:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.590000
Oct 07 06:16:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 07 06:16:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 07 06:18:10 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 07 06:18:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 07 06:18:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 07 06:18:10 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 07 06:18:10 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 07 06:18:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 07 06:18:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 07 06:18:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 07 06:18:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 07 06:18:10 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 06:18:10 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 06:18:10 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 07 06:18:10 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 07 06:18:10 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 07 06:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 07 06:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 07 06:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 07 06:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 07 06:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 07 06:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 07 06:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 07 06:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 07 06:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 07 06:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 07 06:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 07 06:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 07 06:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 07 06:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 07 06:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 07 06:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 07 06:18:10 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2760, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 06:18:10 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 07 06:18:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 07 06:18:10 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2760 (ref=pe_calc-dc-1728253090-37063) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 06:18:10 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2760 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 07 06:18:10 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 07 06:18:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 07 06:18:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 13.900000
Oct 07 06:18:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was negligible)
Oct 07 06:19:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.560000
Oct 07 06:19:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.510000
Oct 07 06:20:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.630000
Oct 07 06:20:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.810000
Oct 07 06:20:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 06:21:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was medium)
Oct 07 06:21:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.350000
Oct 07 06:21:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was negligible)
Oct 07 06:22:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.310000
Oct 07 06:22:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 06:22:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.770000
Oct 07 06:22:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 06:23:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 07 06:23:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.730000
Oct 07 06:23:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 07 06:24:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.730000
Oct 07 06:24:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 06:24:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.780000
Oct 07 06:24:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 06:25:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.220000
Oct 07 06:25:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.230000
Oct 07 06:26:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.270000
Oct 07 06:26:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 06:26:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.900000
Oct 07 06:27:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.490000
Oct 07 06:27:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.050000
Oct 07 06:27:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 06:28:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.760000
Oct 07 06:28:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 06:28:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 12.040000
Oct 07 06:29:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.750000
Oct 07 06:29:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.610000
Oct 07 06:30:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.710000
Oct 07 06:30:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.990000
Oct 07 06:30:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 06:31:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 07 06:32:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 07 06:33:10 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 07 06:33:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 07 06:33:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 07 06:33:10 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 07 06:33:10 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 07 06:33:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 07 06:33:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 07 06:33:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 07 06:33:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 07 06:33:10 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 06:33:10 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 06:33:10 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 07 06:33:10 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 07 06:33:10 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 07 06:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 07 06:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 07 06:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 07 06:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 07 06:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 07 06:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 07 06:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 07 06:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 07 06:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 07 06:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 07 06:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 07 06:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 07 06:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 07 06:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 07 06:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 07 06:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 07 06:33:10 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2761, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 06:33:10 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 07 06:33:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 07 06:33:10 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2761 (ref=pe_calc-dc-1728253990-37080) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 06:33:10 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2761 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 07 06:33:10 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 07 06:33:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 07 06:37:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.870000
Oct 07 06:37:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was negligible)
Oct 07 06:37:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.720000
Oct 07 06:37:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 06:38:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.200000
Oct 07 06:38:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.620000
Oct 07 06:39:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.950000
Oct 07 06:39:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 06:39:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.870000
Oct 07 06:40:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.830000
Oct 07 06:40:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.240000
Oct 07 06:41:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.400000
Oct 07 06:41:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.600000
Oct 07 06:42:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.100000
Oct 07 06:42:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 06:42:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 12.230000
Oct 07 06:42:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 06:43:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.540000
Oct 07 06:43:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.840000
Oct 07 06:44:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.620000
Oct 07 06:44:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.040000
Oct 07 06:45:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.040000
Oct 07 06:45:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 06:45:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.240000
Oct 07 06:45:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 06:46:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.840000
Oct 07 06:46:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.140000
Oct 07 06:47:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.600000
Oct 07 06:47:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.260000
Oct 07 06:47:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 06:48:10 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 07 06:48:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 07 06:48:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 07 06:48:10 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 07 06:48:10 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 07 06:48:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 07 06:48:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 07 06:48:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 07 06:48:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 07 06:48:10 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 06:48:10 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 06:48:10 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 07 06:48:10 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 07 06:48:10 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 07 06:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 07 06:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 07 06:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 07 06:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 07 06:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 07 06:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 07 06:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 07 06:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 07 06:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 07 06:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 07 06:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 07 06:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 07 06:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 07 06:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 07 06:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 07 06:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 07 06:48:10 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2762, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 06:48:10 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 07 06:48:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 07 06:48:10 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2762 (ref=pe_calc-dc-1728254890-37089) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 06:48:10 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2762 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 07 06:48:10 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 07 06:48:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 07 06:48:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.800000
Oct 07 06:48:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 06:48:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.740000
Oct 07 06:49:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.290000
Oct 07 06:49:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.940000
Oct 07 06:49:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 06:50:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.490000
Oct 07 06:50:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.810000
Oct 07 06:50:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 06:51:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.330000
Oct 07 06:51:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 06:51:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.000000
Oct 07 06:51:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 06:52:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.490000
Oct 07 06:52:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.940000
Oct 07 06:53:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.490000
Oct 07 06:53:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 06:53:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 07 06:54:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 07 06:54:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.520000
Oct 07 06:54:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was negligible)
Oct 07 06:55:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.570000
Oct 07 06:55:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 06:55:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.690000
Oct 07 06:56:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.180000
Oct 07 06:56:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.880000
Oct 07 06:56:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 06:57:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.130000
Oct 07 06:57:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 06:57:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.050000
Oct 07 06:58:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.560000
Oct 07 06:58:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 06:58:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.250000
Oct 07 06:58:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 06:59:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 12.540000
Oct 07 06:59:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.510000
Oct 07 07:00:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.410000
Oct 07 07:00:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 15.470000
Oct 07 07:01:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 14.760000
Oct 07 07:01:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 12.220000
Oct 07 07:02:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.790000
Oct 07 07:02:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.520000
Oct 07 07:03:10 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 07 07:03:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 07 07:03:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 07 07:03:10 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 07 07:03:10 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 07 07:03:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 07 07:03:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 07 07:03:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 07 07:03:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 07 07:03:10 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 07:03:10 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 07:03:10 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 07 07:03:10 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 07 07:03:10 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 07 07:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 07 07:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 07 07:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 07 07:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 07 07:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 07 07:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 07 07:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 07 07:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 07 07:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 07 07:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 07 07:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 07 07:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 07 07:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 07 07:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 07 07:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 07 07:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 07 07:03:10 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2763, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 07:03:10 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 07 07:03:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 07 07:03:10 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2763 (ref=pe_calc-dc-1728255790-37104) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 07:03:10 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2763 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 07 07:03:10 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 07 07:03:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 07 07:03:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.310000
Oct 07 07:03:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 07:03:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 15.540000
Oct 07 07:03:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 07:04:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.440000
Oct 07 07:04:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.200000
Oct 07 07:05:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 15.980000
Oct 07 07:05:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 14.190000
Oct 07 07:06:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.970000
Oct 07 07:06:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 15.040000
Oct 07 07:07:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.270000
Oct 07 07:07:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 13.560000
Oct 07 07:08:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.830000
Oct 07 07:08:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 12.920000
Oct 07 07:09:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.250000
Oct 07 07:09:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 12.670000
Oct 07 07:10:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.190000
Oct 07 07:10:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.510000
Oct 07 07:11:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.990000
Oct 07 07:11:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.370000
Oct 07 07:12:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.100000
Oct 07 07:12:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.340000
Oct 07 07:13:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.360000
Oct 07 07:13:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 07:13:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.360000
Oct 07 07:13:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 07:14:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.070000
Oct 07 07:14:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 07:14:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.170000
Oct 07 07:14:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 07:15:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.100000
Oct 07 07:15:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.000000
Oct 07 07:16:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.410000
Oct 07 07:16:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.890000
Oct 07 07:17:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.530000
Oct 07 07:17:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 07:17:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.770000
Oct 07 07:18:10 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 07 07:18:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 07 07:18:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 07 07:18:10 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 07 07:18:10 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 07 07:18:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 07 07:18:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 07 07:18:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 07 07:18:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 07 07:18:10 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 07:18:10 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 07:18:10 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 07 07:18:10 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 07 07:18:10 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 07 07:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 07 07:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 07 07:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 07 07:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 07 07:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 07 07:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 07 07:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 07 07:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 07 07:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 07 07:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 07 07:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 07 07:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 07 07:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 07 07:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 07 07:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 07 07:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 07 07:18:10 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2764, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 07:18:10 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 07 07:18:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 07 07:18:10 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2764 (ref=pe_calc-dc-1728256690-37112) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 07:18:10 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2764 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 07 07:18:10 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 07 07:18:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 07 07:18:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.540000
Oct 07 07:18:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 07:18:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.500000
Oct 07 07:18:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 07:19:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was medium)
Oct 07 07:19:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.880000
Oct 07 07:19:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was negligible)
Oct 07 07:20:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.330000
Oct 07 07:20:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 07:20:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.850000
Oct 07 07:20:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 07:21:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.460000
Oct 07 07:21:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.640000
Oct 07 07:22:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.550000
Oct 07 07:22:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 07:22:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.050000
Oct 07 07:22:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 07:23:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.170000
Oct 07 07:23:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 07:23:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.380000
Oct 07 07:23:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 07:24:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.120000
Oct 07 07:24:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.180000
Oct 07 07:25:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.540000
Oct 07 07:25:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 07:25:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.060000
Oct 07 07:25:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 07:26:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.780000
Oct 07 07:26:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.630000
Oct 07 07:27:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.950000
Oct 07 07:27:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.030000
Oct 07 07:28:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.250000
Oct 07 07:28:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.110000
Oct 07 07:29:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.770000
Oct 07 07:29:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.730000
Oct 07 07:30:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.980000
Oct 07 07:30:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.410000
Oct 07 07:31:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.810000
Oct 07 07:31:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.160000
Oct 07 07:32:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.850000
Oct 07 07:32:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.250000
Oct 07 07:33:10 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 07 07:33:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 07 07:33:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 07 07:33:10 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 07 07:33:10 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 07 07:33:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 07 07:33:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 07 07:33:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 07 07:33:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 07 07:33:10 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 07:33:10 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 07:33:10 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 07 07:33:10 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 07 07:33:10 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 07 07:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 07 07:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 07 07:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 07 07:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 07 07:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 07 07:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 07 07:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 07 07:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 07 07:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 07 07:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 07 07:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 07 07:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 07 07:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 07 07:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 07 07:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 07 07:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 07 07:33:10 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2765, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 07:33:10 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 07 07:33:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 07 07:33:10 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2765 (ref=pe_calc-dc-1728257590-37125) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 07:33:10 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2765 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 07 07:33:10 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 07 07:33:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 07 07:33:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.980000
Oct 07 07:33:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.850000
Oct 07 07:34:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.420000
Oct 07 07:34:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 07:34:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.920000
Oct 07 07:34:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 07:35:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.850000
Oct 07 07:35:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.860000
Oct 07 07:36:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.810000
Oct 07 07:36:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.640000
Oct 07 07:37:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.750000
Oct 07 07:37:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.890000
Oct 07 07:38:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.890000
Oct 07 07:38:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 07:38:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.800000
Oct 07 07:38:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 07:39:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.190000
Oct 07 07:39:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.430000
Oct 07 07:40:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.970000
Oct 07 07:40:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.470000
Oct 07 07:41:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 07 07:42:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 07 07:43:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.210000
Oct 07 07:43:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was negligible)
Oct 07 07:43:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 07 07:44:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 07 07:44:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.450000
Oct 07 07:44:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was negligible)
Oct 07 07:45:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.650000
Oct 07 07:45:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.450000
Oct 07 07:46:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.430000
Oct 07 07:46:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.760000
Oct 07 07:47:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.310000
Oct 07 07:47:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 07:47:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.570000
Oct 07 07:47:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 07:48:10 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 07 07:48:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 07 07:48:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 07 07:48:10 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 07 07:48:10 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 07 07:48:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 07 07:48:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 07 07:48:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 07 07:48:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 07 07:48:10 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 07:48:10 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 07:48:10 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 07 07:48:10 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 07 07:48:10 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 07 07:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 07 07:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 07 07:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 07 07:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 07 07:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 07 07:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 07 07:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 07 07:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 07 07:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 07 07:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 07 07:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 07 07:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 07 07:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 07 07:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 07 07:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 07 07:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 07 07:48:10 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2766, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 07:48:10 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 07 07:48:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 07 07:48:10 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2766 (ref=pe_calc-dc-1728258490-37138) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 07:48:10 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2766 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 07 07:48:10 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 07 07:48:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 07 07:48:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.550000
Oct 07 07:48:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.540000
Oct 07 07:49:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.260000
Oct 07 07:49:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 07:49:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.180000
Oct 07 07:50:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.500000
Oct 07 07:50:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 07:50:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.420000
Oct 07 07:51:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 07 07:52:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 07 07:52:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.010000
Oct 07 07:52:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was negligible)
Oct 07 07:53:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.570000
Oct 07 07:53:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.390000
Oct 07 07:53:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 07:54:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.800000
Oct 07 07:54:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.850000
Oct 07 07:55:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.790000
Oct 07 07:55:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.690000
Oct 07 07:56:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.930000
Oct 07 07:56:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.560000
Oct 07 07:57:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.400000
Oct 07 07:57:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 07:57:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.560000
Oct 07 07:57:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 07:58:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.280000
Oct 07 07:58:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 07:58:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.030000
Oct 07 07:58:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 07:59:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.250000
Oct 07 07:59:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.310000
Oct 07 08:00:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.240000
Oct 07 08:00:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 13.630000
Oct 07 08:01:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.450000
Oct 07 08:01:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.510000
Oct 07 08:02:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 12.360000
Oct 07 08:02:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 12.600000
Oct 07 08:03:10 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 07 08:03:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 07 08:03:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 07 08:03:10 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 07 08:03:10 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 07 08:03:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 07 08:03:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 07 08:03:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 07 08:03:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 07 08:03:10 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 08:03:10 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 08:03:10 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 07 08:03:10 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 07 08:03:10 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 07 08:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 07 08:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 07 08:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 07 08:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 07 08:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 07 08:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 07 08:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 07 08:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 07 08:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 07 08:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 07 08:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 07 08:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 07 08:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 07 08:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 07 08:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 07 08:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 07 08:03:10 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2767, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 08:03:10 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 07 08:03:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 07 08:03:10 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2767 (ref=pe_calc-dc-1728259390-37149) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 08:03:10 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2767 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 07 08:03:10 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 07 08:03:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 07 08:03:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.470000
Oct 07 08:03:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.350000
Oct 07 08:03:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 08:04:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 07 08:04:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 13.220000
Oct 07 08:04:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 07 08:05:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.140000
Oct 07 08:05:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.580000
Oct 07 08:06:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.460000
Oct 07 08:06:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.650000
Oct 07 08:06:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 08:07:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 07 08:07:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.940000
Oct 07 08:07:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 07 08:08:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.660000
Oct 07 08:08:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.670000
Oct 07 08:09:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.040000
Oct 07 08:09:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.550000
Oct 07 08:10:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.220000
Oct 07 08:10:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 13.410000
Oct 07 08:11:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.670000
Oct 07 08:11:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.810000
Oct 07 08:12:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.440000
Oct 07 08:12:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.170000
Oct 07 08:12:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 08:13:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.580000
Oct 07 08:13:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 08:13:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.230000
Oct 07 08:14:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.720000
Oct 07 08:14:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.860000
Oct 07 08:15:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.540000
Oct 07 08:15:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.400000
Oct 07 08:15:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 08:16:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.540000
Oct 07 08:16:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 08:16:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.030000
Oct 07 08:16:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 08:17:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.050000
Oct 07 08:17:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 08:17:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.450000
Oct 07 08:18:10 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 07 08:18:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 07 08:18:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 07 08:18:10 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 07 08:18:10 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 07 08:18:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 07 08:18:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 07 08:18:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 07 08:18:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 07 08:18:10 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 08:18:10 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 08:18:10 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 07 08:18:10 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 07 08:18:10 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 07 08:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 07 08:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 07 08:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 07 08:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 07 08:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 07 08:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 07 08:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 07 08:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 07 08:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 07 08:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 07 08:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 07 08:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 07 08:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 07 08:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 07 08:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 07 08:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 07 08:18:10 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2768, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 08:18:10 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 07 08:18:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 07 08:18:10 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2768 (ref=pe_calc-dc-1728260290-37162) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 08:18:10 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2768 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 07 08:18:10 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 07 08:18:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 07 08:18:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 07 08:18:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.830000
Oct 07 08:18:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 07 08:19:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.850000
Oct 07 08:19:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.370000
Oct 07 08:20:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.000000
Oct 07 08:20:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.210000
Oct 07 08:21:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.240000
Oct 07 08:21:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.200000
Oct 07 08:22:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.800000
Oct 07 08:22:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.970000
Oct 07 08:23:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.380000
Oct 07 08:23:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.450000
Oct 07 08:24:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.490000
Oct 07 08:24:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.370000
Oct 07 08:24:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 08:25:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.010000
Oct 07 08:25:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 08:25:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.050000
Oct 07 08:26:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.620000
Oct 07 08:26:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 08:26:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.440000
Oct 07 08:26:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 08:27:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.920000
Oct 07 08:27:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.690000
Oct 07 08:28:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.700000
Oct 07 08:28:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 08:28:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.930000
Oct 07 08:28:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 08:29:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.740000
Oct 07 08:29:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 08:29:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.860000
Oct 07 08:30:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 07 08:30:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 07 08:31:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.080000
Oct 07 08:31:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was negligible)
Oct 07 08:32:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.210000
Oct 07 08:32:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.800000
Oct 07 08:32:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 08:33:10 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 07 08:33:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 07 08:33:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 07 08:33:10 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 07 08:33:10 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 07 08:33:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 07 08:33:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 07 08:33:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 07 08:33:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 07 08:33:10 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 08:33:10 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 08:33:10 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 07 08:33:10 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 07 08:33:10 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 07 08:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 07 08:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 07 08:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 07 08:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 07 08:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 07 08:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 07 08:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 07 08:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 07 08:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 07 08:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 07 08:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 07 08:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 07 08:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 07 08:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 07 08:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 07 08:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 07 08:33:10 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2769, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 08:33:10 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 07 08:33:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 07 08:33:10 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2769 (ref=pe_calc-dc-1728261190-37176) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 08:33:10 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2769 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 07 08:33:10 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 07 08:33:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 07 08:33:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.230000
Oct 07 08:33:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 08:33:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.720000
Oct 07 08:33:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 08:34:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.670000
Oct 07 08:34:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.930000
Oct 07 08:35:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.260000
Oct 07 08:35:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 08:35:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.880000
Oct 07 08:35:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 08:36:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.490000
Oct 07 08:36:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.340000
Oct 07 08:37:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.370000
Oct 07 08:37:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 08:37:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.560000
Oct 07 08:37:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 08:38:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.540000
Oct 07 08:38:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 12.470000
Oct 07 08:39:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.880000
Oct 07 08:39:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.170000
Oct 07 08:40:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.620000
Oct 07 08:40:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.000000
Oct 07 08:41:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.570000
Oct 07 08:41:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.110000
Oct 07 08:42:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.920000
Oct 07 08:42:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 08:42:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.460000
Oct 07 08:43:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was medium)
Oct 07 08:43:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.040000
Oct 07 08:43:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was negligible)
Oct 07 08:44:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 07 08:44:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.530000
Oct 07 08:44:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 07 08:45:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.250000
Oct 07 08:45:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.320000
Oct 07 08:46:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was medium)
Oct 07 08:47:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was negligible)
Oct 07 08:47:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.000000
Oct 07 08:47:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 07 08:48:10 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 07 08:48:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 07 08:48:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 07 08:48:10 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 07 08:48:10 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 07 08:48:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 07 08:48:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 07 08:48:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 07 08:48:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 07 08:48:10 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 08:48:10 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 08:48:10 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 07 08:48:10 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 07 08:48:10 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 07 08:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 07 08:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 07 08:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 07 08:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 07 08:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 07 08:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 07 08:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 07 08:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 07 08:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 07 08:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 07 08:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 07 08:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 07 08:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 07 08:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 07 08:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 07 08:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 07 08:48:10 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2770, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 08:48:10 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 07 08:48:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 07 08:48:10 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2770 (ref=pe_calc-dc-1728262090-37191) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 08:48:10 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2770 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 07 08:48:10 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 07 08:48:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 07 08:48:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.710000
Oct 07 08:48:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.310000
Oct 07 08:49:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.040000
Oct 07 08:49:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.970000
Oct 07 08:50:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.110000
Oct 07 08:50:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 12.680000
Oct 07 08:51:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 12.070000
Oct 07 08:51:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 12.610000
Oct 07 08:52:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 17.450001
Oct 07 08:52:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.270000
Oct 07 08:53:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.750000
Oct 07 08:53:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.070000
Oct 07 08:54:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.120000
Oct 07 08:54:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.720000
Oct 07 08:55:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.890000
Oct 07 08:55:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.570000
Oct 07 08:56:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.160000
Oct 07 08:56:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 08:56:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.410000
Oct 07 08:57:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 07 08:57:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 07 08:58:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was negligible)
Oct 07 09:00:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 07 09:00:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was negligible)
Oct 07 09:01:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.430000
Oct 07 09:01:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 07 09:01:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 12.030000
Oct 07 09:01:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 09:02:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.860000
Oct 07 09:02:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.590000
Oct 07 09:03:10 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 07 09:03:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 07 09:03:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 07 09:03:10 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 07 09:03:10 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 07 09:03:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 07 09:03:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 07 09:03:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 07 09:03:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 07 09:03:10 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 09:03:10 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 09:03:10 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 07 09:03:10 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 07 09:03:10 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 07 09:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 07 09:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 07 09:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 07 09:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 07 09:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 07 09:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 07 09:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 07 09:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 07 09:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 07 09:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 07 09:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 07 09:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 07 09:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 07 09:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 07 09:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 07 09:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 07 09:03:10 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2771, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 09:03:10 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 07 09:03:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 07 09:03:10 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2771 (ref=pe_calc-dc-1728262990-37200) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 09:03:10 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2771 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 07 09:03:10 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 07 09:03:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 07 09:03:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.820000
Oct 07 09:03:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.960000
Oct 07 09:03:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 09:04:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 07 09:04:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.040000
Oct 07 09:04:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 07 09:05:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 07 09:05:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.040000
Oct 07 09:05:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 07 09:06:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.380000
Oct 07 09:06:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.500000
Oct 07 09:06:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 09:07:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was medium)
Oct 07 09:07:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.660000
Oct 07 09:07:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was negligible)
Oct 07 09:08:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 07 09:08:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.750000
Oct 07 09:08:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 07 09:09:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 07 09:10:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.870000
Oct 07 09:10:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 07 09:11:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was medium)
Oct 07 09:11:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.320000
Oct 07 09:11:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was negligible)
Oct 07 09:12:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was medium)
Oct 07 09:12:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.190000
Oct 07 09:12:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was negligible)
Oct 07 09:13:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.130000
Oct 07 09:13:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was medium)
Oct 07 09:15:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.630000
Oct 07 09:15:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was negligible)
Oct 07 09:16:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.440000
Oct 07 09:16:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 09:16:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 12.370000
Oct 07 09:17:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.120000
Oct 07 09:17:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.140000
Oct 07 09:18:10 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 07 09:18:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 07 09:18:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 07 09:18:10 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 07 09:18:10 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 07 09:18:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 07 09:18:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 07 09:18:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 07 09:18:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 07 09:18:10 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 09:18:10 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 09:18:10 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 07 09:18:10 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 07 09:18:10 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 07 09:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 07 09:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 07 09:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 07 09:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 07 09:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 07 09:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 07 09:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 07 09:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 07 09:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 07 09:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 07 09:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 07 09:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 07 09:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 07 09:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 07 09:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 07 09:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 07 09:18:10 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2772, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 09:18:10 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 07 09:18:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 07 09:18:10 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2772 (ref=pe_calc-dc-1728263890-37220) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 09:18:10 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2772 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 07 09:18:10 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 07 09:18:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 07 09:18:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.620000
Oct 07 09:18:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.860000
Oct 07 09:19:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.380000
Oct 07 09:19:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 09:19:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.820000
Oct 07 09:19:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 09:20:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.220000
Oct 07 09:20:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.250000
Oct 07 09:20:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 09:21:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 07 09:21:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.270000
Oct 07 09:21:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 07 09:22:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 07 09:22:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.060000
Oct 07 09:22:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 07 09:23:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.390000
Oct 07 09:23:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.180000
Oct 07 09:24:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.810000
Oct 07 09:24:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 09:24:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.240000
Oct 07 09:25:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.730000
Oct 07 09:25:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.690000
Oct 07 09:25:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 09:26:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.240000
Oct 07 09:26:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.520000
Oct 07 09:27:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.500000
Oct 07 09:27:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 16.680000
Oct 07 09:28:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.270000
Oct 07 09:28:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.600000
Oct 07 09:29:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.730000
Oct 07 09:29:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.020000
Oct 07 09:30:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.380000
Oct 07 09:30:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.520000
Oct 07 09:31:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.270000
Oct 07 09:31:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 09:31:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.500000
Oct 07 09:31:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 09:32:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.260000
Oct 07 09:32:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 09:32:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 07 09:33:10 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 07 09:33:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 07 09:33:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 07 09:33:10 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 07 09:33:10 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 07 09:33:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 07 09:33:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 07 09:33:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 07 09:33:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 07 09:33:10 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 09:33:10 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 09:33:10 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 07 09:33:10 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 07 09:33:10 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 07 09:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 07 09:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 07 09:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 07 09:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 07 09:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 07 09:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 07 09:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 07 09:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 07 09:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 07 09:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 07 09:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 07 09:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 07 09:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 07 09:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 07 09:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 07 09:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 07 09:33:10 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2773, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 09:33:10 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 07 09:33:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 07 09:33:10 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2773 (ref=pe_calc-dc-1728264790-37234) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 09:33:10 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2773 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 07 09:33:10 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 07 09:33:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 07 09:33:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.070000
Oct 07 09:33:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 07 09:33:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.340000
Oct 07 09:34:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 07 09:34:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.860000
Oct 07 09:34:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 07 09:35:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.730000
Oct 07 09:35:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 09:35:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.790000
Oct 07 09:36:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.930000
Oct 07 09:36:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.050000
Oct 07 09:36:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 09:37:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was medium)
Oct 07 09:37:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was negligible)
Oct 07 09:38:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 07 09:38:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.470000
Oct 07 09:38:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was negligible)
Oct 07 09:39:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 07 09:39:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.250000
Oct 07 09:39:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 07 09:40:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.680000
Oct 07 09:40:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 07 09:41:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 07 09:41:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.820000
Oct 07 09:41:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was negligible)
Oct 07 09:42:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.460000
Oct 07 09:42:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 09:42:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 07 09:43:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.770000
Oct 07 09:43:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 07 09:43:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 07 09:44:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 07 09:44:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.920000
Oct 07 09:44:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was negligible)
Oct 07 09:45:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.220000
Oct 07 09:45:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 09:45:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 07 09:46:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 07 09:46:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.870000
Oct 07 09:46:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was negligible)
Oct 07 09:47:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 07 09:48:10 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 07 09:48:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 07 09:48:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 07 09:48:10 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 07 09:48:10 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 07 09:48:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 07 09:48:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 07 09:48:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 07 09:48:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 07 09:48:10 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 09:48:10 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 09:48:10 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 07 09:48:10 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 07 09:48:10 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 07 09:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 07 09:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 07 09:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 07 09:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 07 09:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 07 09:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 07 09:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 07 09:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 07 09:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 07 09:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 07 09:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 07 09:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 07 09:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 07 09:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 07 09:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 07 09:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 07 09:48:10 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2774, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 09:48:10 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 07 09:48:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 07 09:48:10 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2774 (ref=pe_calc-dc-1728265690-37260) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 09:48:10 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2774 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 07 09:48:10 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 07 09:48:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 07 09:49:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 07 09:50:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.950000
Oct 07 09:50:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was negligible)
Oct 07 09:50:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.040000
Oct 07 09:51:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.450000
Oct 07 09:51:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.540000
Oct 07 09:52:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.960000
Oct 07 09:52:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 09:52:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 07 09:54:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.650000
Oct 07 09:54:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 07 09:54:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.700000
Oct 07 09:55:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.590000
Oct 07 09:55:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.090000
Oct 07 09:56:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.330000
Oct 07 09:56:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 09:56:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 07 09:57:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.270000
Oct 07 09:57:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 07 09:57:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.870000
Oct 07 09:58:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 07 09:58:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 14.710000
Oct 07 09:58:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 07 09:59:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.700000
Oct 07 09:59:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.540000
Oct 07 10:00:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.820000
Oct 07 10:00:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.690000
Oct 07 10:01:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.600000
Oct 07 10:01:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 14.650000
Oct 07 10:02:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.680000
Oct 07 10:02:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.410000
Oct 07 10:03:10 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 07 10:03:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 07 10:03:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 07 10:03:10 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 07 10:03:10 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 07 10:03:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 07 10:03:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 07 10:03:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 07 10:03:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 07 10:03:10 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 10:03:10 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 10:03:10 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 07 10:03:10 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 07 10:03:10 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 07 10:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 07 10:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 07 10:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 07 10:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 07 10:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 07 10:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 07 10:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 07 10:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 07 10:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 07 10:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 07 10:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 07 10:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 07 10:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 07 10:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 07 10:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 07 10:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 07 10:03:10 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2775, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 10:03:10 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 07 10:03:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 07 10:03:10 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2775 (ref=pe_calc-dc-1728266590-37271) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 10:03:10 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2775 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 07 10:03:10 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 07 10:03:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 07 10:03:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.840000
Oct 07 10:03:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.360000
Oct 07 10:04:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.310000
Oct 07 10:04:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 10:04:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.970000
Oct 07 10:04:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 10:05:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.360000
Oct 07 10:05:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 10:05:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.160000
Oct 07 10:06:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 07 10:06:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.640000
Oct 07 10:06:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 07 10:07:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 07 10:08:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 07 10:09:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.220000
Oct 07 10:09:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was negligible)
Oct 07 10:10:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.200000
Oct 07 10:10:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 10:10:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.020000
Oct 07 10:10:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 10:11:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.140000
Oct 07 10:11:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.340000
Oct 07 10:12:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.670000
Oct 07 10:12:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 10:12:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.660000
Oct 07 10:12:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 10:13:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.250000
Oct 07 10:13:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.580000
Oct 07 10:14:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.860000
Oct 07 10:14:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 10:14:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.860000
Oct 07 10:14:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 10:15:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.000000
Oct 07 10:15:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.900000
Oct 07 10:16:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.650000
Oct 07 10:16:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.490000
Oct 07 10:17:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.740000
Oct 07 10:17:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 10:17:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 07 10:18:10 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 07 10:18:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 07 10:18:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 07 10:18:10 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 07 10:18:10 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 07 10:18:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 07 10:18:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 07 10:18:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 07 10:18:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 07 10:18:10 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 10:18:10 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 10:18:10 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 07 10:18:10 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 07 10:18:10 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 07 10:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 07 10:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 07 10:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 07 10:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 07 10:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 07 10:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 07 10:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 07 10:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 07 10:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 07 10:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 07 10:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 07 10:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 07 10:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 07 10:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 07 10:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 07 10:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 07 10:18:10 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2776, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 10:18:10 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 07 10:18:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 07 10:18:10 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2776 (ref=pe_calc-dc-1728267490-37288) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 10:18:10 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2776 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 07 10:18:10 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 07 10:18:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 07 10:18:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.950000
Oct 07 10:18:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 07 10:18:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.500000
Oct 07 10:19:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.500000
Oct 07 10:19:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 07 10:20:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.020000
Oct 07 10:20:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 07 10:20:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.340000
Oct 07 10:21:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.810000
Oct 07 10:21:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.910000
Oct 07 10:22:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.890000
Oct 07 10:22:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 10:22:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.880000
Oct 07 10:22:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 10:23:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.590000
Oct 07 10:23:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.390000
Oct 07 10:24:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 12.240000
Oct 07 10:24:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.610000
Oct 07 10:25:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.350000
Oct 07 10:25:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.710000
Oct 07 10:26:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.040000
Oct 07 10:26:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.900000
Oct 07 10:27:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.020000
Oct 07 10:27:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.050000
Oct 07 10:28:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.030000
Oct 07 10:28:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 10:28:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 07 10:29:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.870000
Oct 07 10:29:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 07 10:30:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.710000
Oct 07 10:30:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.510000
Oct 07 10:31:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.080000
Oct 07 10:31:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.100000
Oct 07 10:32:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.520000
Oct 07 10:32:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 10:32:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 07 10:33:10 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 07 10:33:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 07 10:33:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 07 10:33:10 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 07 10:33:10 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 07 10:33:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 07 10:33:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 07 10:33:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 07 10:33:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 07 10:33:10 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 10:33:10 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 10:33:10 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 07 10:33:10 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 07 10:33:10 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 07 10:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 07 10:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 07 10:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 07 10:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 07 10:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 07 10:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 07 10:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 07 10:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 07 10:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 07 10:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 07 10:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 07 10:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 07 10:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 07 10:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 07 10:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 07 10:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 07 10:33:10 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2777, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 10:33:10 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 07 10:33:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 07 10:33:10 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2777 (ref=pe_calc-dc-1728268390-37299) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 10:33:10 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2777 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 07 10:33:10 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 07 10:33:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 07 10:34:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.380000
Oct 07 10:34:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 07 10:34:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 12.770000
Oct 07 10:34:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 10:35:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.360000
Oct 07 10:35:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.950000
Oct 07 10:36:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 07 10:36:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 07 10:37:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was negligible)
Oct 07 10:38:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.960000
Oct 07 10:38:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 07 10:38:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 07 10:39:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.990000
Oct 07 10:39:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 07 10:39:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.090000
Oct 07 10:39:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 10:40:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.160000
Oct 07 10:40:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.190000
Oct 07 10:40:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 10:41:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.400000
Oct 07 10:41:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.870000
Oct 07 10:42:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.490000
Oct 07 10:42:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.990000
Oct 07 10:43:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.320000
Oct 07 10:43:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.840000
Oct 07 10:43:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 10:44:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 07 10:44:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.250000
Oct 07 10:44:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 07 10:45:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.720000
Oct 07 10:45:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.620000
Oct 07 10:46:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 07 10:46:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 07 10:47:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 12.750000
Oct 07 10:47:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was negligible)
Oct 07 10:47:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 12.840000
Oct 07 10:48:10 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 07 10:48:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 07 10:48:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 07 10:48:10 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 07 10:48:10 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 07 10:48:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 07 10:48:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 07 10:48:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 07 10:48:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 07 10:48:10 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 10:48:10 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 10:48:10 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 07 10:48:10 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 07 10:48:10 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 07 10:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 07 10:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 07 10:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 07 10:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 07 10:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 07 10:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 07 10:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 07 10:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 07 10:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 07 10:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 07 10:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 07 10:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 07 10:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 07 10:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 07 10:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 07 10:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 07 10:48:10 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2778, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 10:48:10 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 07 10:48:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 07 10:48:10 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2778 (ref=pe_calc-dc-1728269290-37316) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 10:48:10 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2778 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 07 10:48:10 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 07 10:48:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 07 10:48:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.950000
Oct 07 10:48:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.870000
Oct 07 10:49:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.560000
Oct 07 10:49:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.350000
Oct 07 10:50:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 15.980000
Oct 07 10:50:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.790000
Oct 07 10:51:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.160000
Oct 07 10:51:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.180000
Oct 07 10:52:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.700000
Oct 07 10:52:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.340000
Oct 07 10:53:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.830000
Oct 07 10:53:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 12.990000
Oct 07 10:54:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.980000
Oct 07 10:54:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 22.370001
Oct 07 10:55:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 16.240000
Oct 07 10:55:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 12.890000
Oct 07 10:56:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.610000
Oct 07 10:56:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.110000
Oct 07 10:57:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.580000
Oct 07 10:57:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 10:57:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.770000
Oct 07 10:57:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 10:58:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.320000
Oct 07 10:58:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.250000
Oct 07 10:59:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.820000
Oct 07 10:59:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.970000
Oct 07 11:00:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.350000
Oct 07 11:00:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.180000
Oct 07 11:01:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.200000
Oct 07 11:01:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.340000
Oct 07 11:02:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.650000
Oct 07 11:02:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.640000
Oct 07 11:03:10 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 07 11:03:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 07 11:03:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 07 11:03:10 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 07 11:03:10 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 07 11:03:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 07 11:03:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 07 11:03:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 07 11:03:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 07 11:03:10 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 11:03:10 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 11:03:10 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 07 11:03:10 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 07 11:03:10 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 07 11:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 07 11:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 07 11:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 07 11:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 07 11:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 07 11:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 07 11:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 07 11:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 07 11:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 07 11:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 07 11:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 07 11:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 07 11:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 07 11:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 07 11:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 07 11:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 07 11:03:10 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2779, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 11:03:10 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 07 11:03:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 07 11:03:10 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2779 (ref=pe_calc-dc-1728270190-37319) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 11:03:10 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2779 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 07 11:03:10 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 07 11:03:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 07 11:03:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.100000
Oct 07 11:03:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.120000
Oct 07 11:04:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.680000
Oct 07 11:04:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.300000
Oct 07 11:04:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 11:05:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.610000
Oct 07 11:05:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 11:05:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.750000
Oct 07 11:06:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.470000
Oct 07 11:06:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 11:06:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.390000
Oct 07 11:06:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 11:07:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.220000
Oct 07 11:07:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.790000
Oct 07 11:08:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.540000
Oct 07 11:08:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.380000
Oct 07 11:09:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.310000
Oct 07 11:09:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.980000
Oct 07 11:10:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.900000
Oct 07 11:10:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.370000
Oct 07 11:11:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.230000
Oct 07 11:11:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.170000
Oct 07 11:12:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.630000
Oct 07 11:12:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.650000
Oct 07 11:13:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.630000
Oct 07 11:13:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 12.850000
Oct 07 11:14:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 12.130000
Oct 07 11:14:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.060000
Oct 07 11:15:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.240000
Oct 07 11:15:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 11:15:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.940000
Oct 07 11:16:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.950000
Oct 07 11:16:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.000000
Oct 07 11:16:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 11:17:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.250000
Oct 07 11:17:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 11:17:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.280000
Oct 07 11:18:10 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 07 11:18:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 07 11:18:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 07 11:18:10 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 07 11:18:10 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 07 11:18:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 07 11:18:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 07 11:18:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 07 11:18:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 07 11:18:10 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 11:18:10 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 11:18:10 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 07 11:18:10 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 07 11:18:10 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 07 11:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 07 11:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 07 11:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 07 11:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 07 11:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 07 11:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 07 11:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 07 11:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 07 11:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 07 11:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 07 11:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 07 11:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 07 11:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 07 11:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 07 11:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 07 11:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 07 11:18:10 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2780, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 11:18:10 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 07 11:18:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 07 11:18:10 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2780 (ref=pe_calc-dc-1728271090-37327) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 11:18:10 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2780 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 07 11:18:10 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 07 11:18:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 07 11:18:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 07 11:18:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.150000
Oct 07 11:18:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 07 11:19:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.230000
Oct 07 11:19:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.300000
Oct 07 11:20:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.750000
Oct 07 11:20:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 11:20:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.430000
Oct 07 11:21:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.520000
Oct 07 11:21:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.720000
Oct 07 11:21:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 11:22:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.990000
Oct 07 11:22:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.990000
Oct 07 11:22:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 11:23:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.130000
Oct 07 11:23:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 07 11:24:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.440000
Oct 07 11:24:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 07 11:24:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.730000
Oct 07 11:25:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.470000
Oct 07 11:25:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.320000
Oct 07 11:26:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.230000
Oct 07 11:26:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.930000
Oct 07 11:27:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.700000
Oct 07 11:27:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.030000
Oct 07 11:28:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 12.370000
Oct 07 11:28:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.660000
Oct 07 11:29:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.950000
Oct 07 11:29:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 11:29:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 14.820000
Oct 07 11:29:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 11:30:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.770000
Oct 07 11:30:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 14.370000
Oct 07 11:31:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.080000
Oct 07 11:31:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.020000
Oct 07 11:32:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.910000
Oct 07 11:32:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.160000
Oct 07 11:33:10 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 07 11:33:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 07 11:33:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 07 11:33:10 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 07 11:33:10 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 07 11:33:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 07 11:33:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 07 11:33:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 07 11:33:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 07 11:33:10 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 11:33:10 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 11:33:10 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 07 11:33:10 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 07 11:33:10 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 07 11:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 07 11:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 07 11:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 07 11:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 07 11:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 07 11:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 07 11:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 07 11:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 07 11:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 07 11:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 07 11:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 07 11:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 07 11:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 07 11:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 07 11:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 07 11:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 07 11:33:10 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2781, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 11:33:10 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 07 11:33:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 07 11:33:10 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2781 (ref=pe_calc-dc-1728271990-37337) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 11:33:10 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2781 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 07 11:33:10 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 07 11:33:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 07 11:33:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.170000
Oct 07 11:33:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.200000
Oct 07 11:34:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.790000
Oct 07 11:34:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 13.470000
Oct 07 11:35:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.360000
Oct 07 11:35:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.720000
Oct 07 11:36:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 14.130000
Oct 07 11:36:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 22.530001
Oct 07 11:37:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 19.930000
Oct 07 11:37:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 13.340000
Oct 07 11:38:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 12.230000
Oct 07 11:38:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.020000
Oct 07 11:39:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.770000
Oct 07 11:39:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.150000
Oct 07 11:40:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.600000
Oct 07 11:40:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 14.390000
Oct 07 11:41:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 13.760000
Oct 07 11:41:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 21.500000
Oct 07 11:42:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 14.070000
Oct 07 11:42:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 13.990000
Oct 07 11:43:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.910000
Oct 07 11:43:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.670000
Oct 07 11:44:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.340000
Oct 07 11:44:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 11:44:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.970000
Oct 07 11:44:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 11:45:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.130000
Oct 07 11:45:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.010000
Oct 07 11:46:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.430000
Oct 07 11:46:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.010000
Oct 07 11:47:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.790000
Oct 07 11:47:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.650000
Oct 07 11:48:10 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 07 11:48:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 07 11:48:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 07 11:48:10 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 07 11:48:10 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 07 11:48:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 07 11:48:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 07 11:48:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 07 11:48:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 07 11:48:10 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 11:48:10 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 11:48:10 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 07 11:48:10 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 07 11:48:10 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 07 11:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 07 11:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 07 11:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 07 11:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 07 11:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 07 11:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 07 11:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 07 11:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 07 11:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 07 11:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 07 11:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 07 11:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 07 11:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 07 11:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 07 11:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 07 11:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 07 11:48:10 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2782, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 11:48:10 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 07 11:48:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 07 11:48:10 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2782 (ref=pe_calc-dc-1728272890-37340) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 11:48:10 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2782 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 07 11:48:10 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 07 11:48:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 07 11:48:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.860000
Oct 07 11:48:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 12.550000
Oct 07 11:49:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.100000
Oct 07 11:49:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 16.570000
Oct 07 11:50:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 15.470000
Oct 07 11:50:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.850000
Oct 07 11:51:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.520000
Oct 07 11:51:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.330000
Oct 07 11:52:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.260000
Oct 07 11:52:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 11:52:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.740000
Oct 07 11:52:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 11:53:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.250000
Oct 07 11:53:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 14.360000
Oct 07 11:54:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.170000
Oct 07 11:54:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 12.270000
Oct 07 11:55:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 12.870000
Oct 07 11:55:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.070000
Oct 07 11:56:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.570000
Oct 07 11:56:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.010000
Oct 07 11:56:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 11:57:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 07 11:57:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.900000
Oct 07 11:57:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 07 11:58:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.350000
Oct 07 11:58:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.350000
Oct 07 11:58:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 11:59:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.370000
Oct 07 11:59:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.840000
Oct 07 12:00:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 07 12:00:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.470000
Oct 07 12:00:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 07 12:01:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.480000
Oct 07 12:01:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.120000
Oct 07 12:02:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.620000
Oct 07 12:02:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.900000
Oct 07 12:03:10 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 07 12:03:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 07 12:03:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 07 12:03:10 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 07 12:03:10 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 07 12:03:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 07 12:03:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 07 12:03:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 07 12:03:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 07 12:03:10 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 12:03:10 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 12:03:10 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 07 12:03:10 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 07 12:03:10 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 07 12:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 07 12:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 07 12:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 07 12:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 07 12:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 07 12:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 07 12:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 07 12:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 07 12:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 07 12:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 07 12:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 07 12:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 07 12:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 07 12:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 07 12:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 07 12:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 07 12:03:10 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2783, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 12:03:10 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 07 12:03:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 07 12:03:10 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2783 (ref=pe_calc-dc-1728273790-37349) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 12:03:10 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2783 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 07 12:03:10 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 07 12:03:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 07 12:03:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.490000
Oct 07 12:03:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 12.120000
Oct 07 12:04:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.040000
Oct 07 12:04:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.520000
Oct 07 12:05:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.430000
Oct 07 12:05:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.500000
Oct 07 12:06:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.760000
Oct 07 12:06:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.300000
Oct 07 12:06:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 12:07:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.510000
Oct 07 12:07:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 12:07:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.600000
Oct 07 12:08:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.960000
Oct 07 12:08:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 12.720000
Oct 07 12:09:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.660000
Oct 07 12:09:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.520000
Oct 07 12:10:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.970000
Oct 07 12:10:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.050000
Oct 07 12:11:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.420000
Oct 07 12:11:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 12:11:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.940000
Oct 07 12:11:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 12:12:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.170000
Oct 07 12:12:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.590000
Oct 07 12:13:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.700000
Oct 07 12:13:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.440000
Oct 07 12:14:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.250000
Oct 07 12:14:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.330000
Oct 07 12:15:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.230000
Oct 07 12:15:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 12:15:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.420000
Oct 07 12:15:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 12:16:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.640000
Oct 07 12:16:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.030000
Oct 07 12:16:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 12:17:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.700000
Oct 07 12:17:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 12:17:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.410000
Oct 07 12:18:10 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 07 12:18:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 07 12:18:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 07 12:18:10 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 07 12:18:10 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 07 12:18:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 07 12:18:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 07 12:18:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 07 12:18:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 07 12:18:10 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 12:18:10 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 12:18:10 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 07 12:18:10 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 07 12:18:10 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 07 12:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 07 12:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 07 12:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 07 12:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 07 12:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 07 12:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 07 12:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 07 12:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 07 12:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 07 12:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 07 12:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 07 12:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 07 12:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 07 12:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 07 12:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 07 12:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 07 12:18:10 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2784, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 12:18:10 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 07 12:18:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 07 12:18:10 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2784 (ref=pe_calc-dc-1728274690-37358) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 12:18:10 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2784 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 07 12:18:10 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 07 12:18:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 07 12:18:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.310000
Oct 07 12:18:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.420000
Oct 07 12:19:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.270000
Oct 07 12:19:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 12:19:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.950000
Oct 07 12:20:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.010000
Oct 07 12:20:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 07 12:21:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.360000
Oct 07 12:21:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 07 12:21:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.140000
Oct 07 12:21:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 12:22:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 07 12:23:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.450000
Oct 07 12:23:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 07 12:24:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.820000
Oct 07 12:24:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 12:24:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.540000
Oct 07 12:24:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 12:25:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.300000
Oct 07 12:25:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 12:25:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.260000
Oct 07 12:25:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 12:26:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 07 12:26:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.250000
Oct 07 12:26:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 07 12:27:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.490000
Oct 07 12:27:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.450000
Oct 07 12:27:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 12:28:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.720000
Oct 07 12:28:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 12.750000
Oct 07 12:29:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.750000
Oct 07 12:29:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.170000
Oct 07 12:30:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.710000
Oct 07 12:30:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 12:30:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 07 12:31:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.760000
Oct 07 12:31:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 07 12:32:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.190000
Oct 07 12:32:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 12:32:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.980000
Oct 07 12:32:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 12:33:10 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 07 12:33:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 07 12:33:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 07 12:33:10 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 07 12:33:10 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 07 12:33:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 07 12:33:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 07 12:33:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 07 12:33:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 07 12:33:10 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 12:33:10 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 12:33:10 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 07 12:33:10 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 07 12:33:10 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 07 12:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 07 12:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 07 12:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 07 12:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 07 12:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 07 12:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 07 12:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 07 12:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 07 12:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 07 12:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 07 12:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 07 12:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 07 12:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 07 12:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 07 12:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 07 12:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 07 12:33:10 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2785, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 12:33:10 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 07 12:33:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 07 12:33:10 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2785 (ref=pe_calc-dc-1728275590-37377) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 12:33:10 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2785 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 07 12:33:10 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 07 12:33:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 07 12:33:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.530000
Oct 07 12:33:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 19.480000
Oct 07 12:34:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 14.850000
Oct 07 12:34:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.240000
Oct 07 12:35:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.410000
Oct 07 12:35:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.780000
Oct 07 12:36:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.090000
Oct 07 12:36:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.320000
Oct 07 12:37:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.680000
Oct 07 12:37:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 12:37:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 07 12:38:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.440000
Oct 07 12:38:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 07 12:39:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.890000
Oct 07 12:39:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.640000
Oct 07 12:40:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.620000
Oct 07 12:40:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.980000
Oct 07 12:41:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.600000
Oct 07 12:41:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.850000
Oct 07 12:42:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 07 12:42:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.790000
Oct 07 12:42:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 07 12:43:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.260000
Oct 07 12:43:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 12:43:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.810000
Oct 07 12:43:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 12:44:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.550000
Oct 07 12:44:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 12:44:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.610000
Oct 07 12:44:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 12:45:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.120000
Oct 07 12:45:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.700000
Oct 07 12:45:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 12:46:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 07 12:47:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.540000
Oct 07 12:47:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 07 12:47:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.750000
Oct 07 12:48:10 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 07 12:48:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 07 12:48:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 07 12:48:10 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 07 12:48:10 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 07 12:48:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 07 12:48:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 07 12:48:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 07 12:48:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 07 12:48:10 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 12:48:10 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 12:48:10 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 07 12:48:10 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 07 12:48:10 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 07 12:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 07 12:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 07 12:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 07 12:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 07 12:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 07 12:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 07 12:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 07 12:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 07 12:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 07 12:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 07 12:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 07 12:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 07 12:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 07 12:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 07 12:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 07 12:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 07 12:48:10 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2786, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 12:48:10 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 07 12:48:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 07 12:48:10 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2786 (ref=pe_calc-dc-1728276490-37390) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 12:48:10 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2786 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 07 12:48:10 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 07 12:48:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 07 12:48:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.330000
Oct 07 12:48:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 12:48:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 07 12:49:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 07 12:49:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.370000
Oct 07 12:49:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was negligible)
Oct 07 12:50:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.770000
Oct 07 12:50:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.500000
Oct 07 12:51:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.090000
Oct 07 12:51:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.710000
Oct 07 12:52:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.730000
Oct 07 12:52:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 12:52:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.250000
Oct 07 12:52:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 12:53:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.060000
Oct 07 12:53:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 12:53:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.160000
Oct 07 12:53:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 12:54:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.180000
Oct 07 12:54:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 12:54:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.180000
Oct 07 12:55:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 07 12:55:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.750000
Oct 07 12:55:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 07 12:56:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.370000
Oct 07 12:56:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 12:56:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.250000
Oct 07 12:57:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.430000
Oct 07 12:57:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 12:57:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 12.460000
Oct 07 12:58:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.820000
Oct 07 12:58:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.950000
Oct 07 12:59:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.760000
Oct 07 12:59:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.720000
Oct 07 13:00:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.520000
Oct 07 13:00:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.590000
Oct 07 13:01:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.870000
Oct 07 13:01:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 14.000000
Oct 07 13:02:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.170000
Oct 07 13:02:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.870000
Oct 07 13:03:10 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 07 13:03:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 07 13:03:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 07 13:03:10 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 07 13:03:10 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 07 13:03:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 07 13:03:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 07 13:03:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 07 13:03:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 07 13:03:10 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 13:03:10 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 13:03:10 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 07 13:03:10 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 07 13:03:10 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 07 13:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 07 13:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 07 13:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 07 13:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 07 13:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 07 13:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 07 13:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 07 13:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 07 13:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 07 13:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 07 13:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 07 13:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 07 13:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 07 13:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 07 13:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 07 13:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 07 13:03:10 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2787, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 13:03:10 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 07 13:03:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 07 13:03:10 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2787 (ref=pe_calc-dc-1728277390-37404) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 13:03:10 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2787 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 07 13:03:10 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 07 13:03:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 07 13:03:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 07 13:03:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.090000
Oct 07 13:03:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 07 13:04:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.560000
Oct 07 13:04:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 13.010000
Oct 07 13:05:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 12.530000
Oct 07 13:05:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 13.860000
Oct 07 13:06:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.260000
Oct 07 13:06:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.030000
Oct 07 13:07:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 13.890000
Oct 07 13:07:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.290000
Oct 07 13:08:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.040000
Oct 07 13:08:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.290000
Oct 07 13:09:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.660000
Oct 07 13:09:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.970000
Oct 07 13:10:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.380000
Oct 07 13:10:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 13:10:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.740000
Oct 07 13:10:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 13:11:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.480000
Oct 07 13:11:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.700000
Oct 07 13:11:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 13:12:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.560000
Oct 07 13:12:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.130000
Oct 07 13:13:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.240000
Oct 07 13:13:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.890000
Oct 07 13:13:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 13:14:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.220000
Oct 07 13:14:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.500000
Oct 07 13:15:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.230000
Oct 07 13:15:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.620000
Oct 07 13:16:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.490000
Oct 07 13:16:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.680000
Oct 07 13:17:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.960000
Oct 07 13:17:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 12.090000
Oct 07 13:18:10 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 07 13:18:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 07 13:18:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 07 13:18:10 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 07 13:18:10 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 07 13:18:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 07 13:18:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 07 13:18:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 07 13:18:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 07 13:18:10 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 13:18:10 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 13:18:10 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 07 13:18:10 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 07 13:18:10 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 07 13:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 07 13:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 07 13:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 07 13:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 07 13:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 07 13:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 07 13:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 07 13:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 07 13:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 07 13:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 07 13:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 07 13:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 07 13:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 07 13:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 07 13:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 07 13:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 07 13:18:10 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2788, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 13:18:10 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 07 13:18:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 07 13:18:10 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2788 (ref=pe_calc-dc-1728278290-37411) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 13:18:10 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2788 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 07 13:18:10 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 07 13:18:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 07 13:18:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.590000
Oct 07 13:18:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.530000
Oct 07 13:19:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.610000
Oct 07 13:19:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.500000
Oct 07 13:20:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 07 13:20:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.690000
Oct 07 13:20:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 07 13:21:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.550000
Oct 07 13:21:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 07 13:22:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.870000
Oct 07 13:22:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 07 13:22:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.740000
Oct 07 13:22:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 13:23:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.500000
Oct 07 13:23:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 14.840000
Oct 07 13:24:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.650000
Oct 07 13:24:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 14.180000
Oct 07 13:25:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 13.560000
Oct 07 13:25:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.010000
Oct 07 13:26:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.740000
Oct 07 13:26:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.010000
Oct 07 13:27:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.500000
Oct 07 13:27:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 13.950000
Oct 07 13:28:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.180000
Oct 07 13:28:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.050000
Oct 07 13:29:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.910000
Oct 07 13:29:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 13:29:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 07 13:30:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.270000
Oct 07 13:30:11 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 07 13:30:41 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.470000
Oct 07 13:30:41 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 13:31:11 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.650000
Oct 07 13:31:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.820000
Oct 07 13:32:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.530000
Oct 07 13:32:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 13:32:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 14.240000
Oct 07 13:32:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 13:33:10 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 07 13:33:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 07 13:33:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 07 13:33:10 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 07 13:33:10 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 07 13:33:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 07 13:33:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 07 13:33:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 07 13:33:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 07 13:33:10 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 13:33:10 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 13:33:10 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 07 13:33:10 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 07 13:33:10 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 07 13:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 07 13:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 07 13:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 07 13:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 07 13:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 07 13:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 07 13:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 07 13:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 07 13:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 07 13:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 07 13:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 07 13:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 07 13:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 07 13:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 07 13:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 07 13:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 07 13:33:10 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2789, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 13:33:10 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 07 13:33:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 07 13:33:10 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2789 (ref=pe_calc-dc-1728279190-37423) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 13:33:10 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2789 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 07 13:33:10 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 07 13:33:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 07 13:33:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.440000
Oct 07 13:33:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.470000
Oct 07 13:34:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.430000
Oct 07 13:34:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.990000
Oct 07 13:35:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.910000
Oct 07 13:35:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 07 13:36:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.990000
Oct 07 13:36:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 07 13:36:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.750000
Oct 07 13:37:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.610000
Oct 07 13:37:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.320000
Oct 07 13:37:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 13:38:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 07 13:38:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 07 13:39:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.370000
Oct 07 13:39:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was negligible)
Oct 07 13:39:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.360000
Oct 07 13:40:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.940000
Oct 07 13:40:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.460000
Oct 07 13:40:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 13:41:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.640000
Oct 07 13:41:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 07 13:42:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 07 13:42:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.700000
Oct 07 13:42:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was negligible)
Oct 07 13:43:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.980000
Oct 07 13:43:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 13:43:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 07 13:44:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 07 13:46:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.790000
Oct 07 13:46:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was negligible)
Oct 07 13:46:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 07 13:47:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.680000
Oct 07 13:47:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 07 13:48:10 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 07 13:48:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 07 13:48:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 07 13:48:10 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 07 13:48:10 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 07 13:48:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 07 13:48:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 07 13:48:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 07 13:48:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 07 13:48:10 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 13:48:10 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 13:48:10 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 07 13:48:10 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 07 13:48:10 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 07 13:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 07 13:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 07 13:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 07 13:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 07 13:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 07 13:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 07 13:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 07 13:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 07 13:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 07 13:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 07 13:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 07 13:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 07 13:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 07 13:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 07 13:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 07 13:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 07 13:48:10 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2790, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 13:48:10 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 07 13:48:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 07 13:48:10 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2790 (ref=pe_calc-dc-1728280090-37440) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 13:48:10 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2790 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 07 13:48:10 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 07 13:48:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 07 13:48:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 07 13:48:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.010000
Oct 07 13:48:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 07 13:49:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.360000
Oct 07 13:49:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.210000
Oct 07 13:49:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 13:50:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 07 13:50:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.000000
Oct 07 13:50:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 07 13:51:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.060000
Oct 07 13:51:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.990000
Oct 07 13:51:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 13:52:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 07 13:52:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.360000
Oct 07 13:52:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 07 13:53:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.330000
Oct 07 13:53:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 07 13:54:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.280000
Oct 07 13:54:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 07 13:54:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.600000
Oct 07 13:54:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 13:55:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.000000
Oct 07 13:55:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.380000
Oct 07 13:55:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 13:56:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.510000
Oct 07 13:56:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 13:56:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 18.280001
Oct 07 13:57:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 17.030001
Oct 07 13:57:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 14.400000
Oct 07 13:58:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.560000
Oct 07 13:58:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.160000
Oct 07 13:59:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.740000
Oct 07 13:59:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.800000
Oct 07 14:00:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.110000
Oct 07 14:00:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.880000
Oct 07 14:01:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.780000
Oct 07 14:01:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.340000
Oct 07 14:01:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 14:02:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.760000
Oct 07 14:02:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.340000
Oct 07 14:02:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 14:03:10 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 07 14:03:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 07 14:03:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 07 14:03:10 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 07 14:03:10 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 07 14:03:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 07 14:03:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 07 14:03:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 07 14:03:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 07 14:03:10 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 14:03:10 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 14:03:10 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 07 14:03:10 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 07 14:03:10 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 07 14:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 07 14:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 07 14:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 07 14:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 07 14:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 07 14:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 07 14:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 07 14:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 07 14:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 07 14:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 07 14:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 07 14:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 07 14:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 07 14:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 07 14:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 07 14:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 07 14:03:10 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2791, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 14:03:10 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 07 14:03:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 07 14:03:10 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2791 (ref=pe_calc-dc-1728280990-37456) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 14:03:10 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2791 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 07 14:03:10 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 07 14:03:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 07 14:03:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.910000
Oct 07 14:03:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 12.520000
Oct 07 14:04:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.150000
Oct 07 14:04:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.430000
Oct 07 14:05:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.900000
Oct 07 14:05:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 07 14:06:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.800000
Oct 07 14:06:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 07 14:06:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.580000
Oct 07 14:06:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 14:07:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.860000
Oct 07 14:07:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 14:07:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.350000
Oct 07 14:08:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.700000
Oct 07 14:08:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 14:08:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.910000
Oct 07 14:09:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.580000
Oct 07 14:09:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.620000
Oct 07 14:10:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.560000
Oct 07 14:10:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.500000
Oct 07 14:11:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.450000
Oct 07 14:11:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 14:11:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 14.430000
Oct 07 14:11:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 14:12:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.900000
Oct 07 14:12:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.540000
Oct 07 14:13:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.030000
Oct 07 14:13:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.650000
Oct 07 14:14:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.190000
Oct 07 14:14:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 14:14:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.020000
Oct 07 14:15:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.500000
Oct 07 14:15:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 14:15:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.130000
Oct 07 14:15:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 14:16:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 07 14:16:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.340000
Oct 07 14:16:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 07 14:17:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.200000
Oct 07 14:17:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.680000
Oct 07 14:17:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 14:18:10 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 07 14:18:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 07 14:18:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 07 14:18:10 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 07 14:18:10 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 07 14:18:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 07 14:18:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 07 14:18:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 07 14:18:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 07 14:18:10 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 14:18:10 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 14:18:10 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 07 14:18:10 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 07 14:18:10 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 07 14:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 07 14:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 07 14:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 07 14:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 07 14:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 07 14:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 07 14:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 07 14:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 07 14:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 07 14:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 07 14:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 07 14:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 07 14:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 07 14:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 07 14:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 07 14:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 07 14:18:10 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2792, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 14:18:10 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 07 14:18:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 07 14:18:10 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2792 (ref=pe_calc-dc-1728281890-37470) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 14:18:10 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2792 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 07 14:18:10 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 07 14:18:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 07 14:18:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.620000
Oct 07 14:18:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.220000
Oct 07 14:19:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 07 14:20:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.130000
Oct 07 14:20:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 07 14:21:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.670000
Oct 07 14:21:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.780000
Oct 07 14:21:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 14:22:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.240000
Oct 07 14:22:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 14:22:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 07 14:23:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 07 14:23:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.150000
Oct 07 14:23:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was negligible)
Oct 07 14:24:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.210000
Oct 07 14:24:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.270000
Oct 07 14:25:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.690000
Oct 07 14:25:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 14.600000
Oct 07 14:26:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.160000
Oct 07 14:26:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 13.880000
Oct 07 14:27:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 15.850000
Oct 07 14:27:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 12.720000
Oct 07 14:28:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.910000
Oct 07 14:28:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.320000
Oct 07 14:29:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.720000
Oct 07 14:29:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.530000
Oct 07 14:30:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.790000
Oct 07 14:30:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.550000
Oct 07 14:31:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.580000
Oct 07 14:31:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.490000
Oct 07 14:32:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.970000
Oct 07 14:32:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 14:32:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.370000
Oct 07 14:32:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 14:33:10 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 07 14:33:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 07 14:33:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 07 14:33:10 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 07 14:33:10 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 07 14:33:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 07 14:33:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 07 14:33:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 07 14:33:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 07 14:33:10 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 14:33:10 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 14:33:10 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 07 14:33:10 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 07 14:33:10 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 07 14:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 07 14:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 07 14:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 07 14:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 07 14:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 07 14:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 07 14:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 07 14:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 07 14:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 07 14:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 07 14:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 07 14:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 07 14:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 07 14:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 07 14:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 07 14:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 07 14:33:10 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2793, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 14:33:10 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 07 14:33:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 07 14:33:10 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2793 (ref=pe_calc-dc-1728282790-37480) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 14:33:10 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2793 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 07 14:33:10 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 07 14:33:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 07 14:33:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.270000
Oct 07 14:33:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.960000
Oct 07 14:34:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.060000
Oct 07 14:34:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.960000
Oct 07 14:35:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.490000
Oct 07 14:35:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.510000
Oct 07 14:36:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.980000
Oct 07 14:36:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.880000
Oct 07 14:37:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.340000
Oct 07 14:37:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 14:37:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.720000
Oct 07 14:37:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 14:38:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.290000
Oct 07 14:38:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 14.300000
Oct 07 14:39:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.950000
Oct 07 14:39:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.250000
Oct 07 14:40:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.810000
Oct 07 14:40:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.900000
Oct 07 14:41:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.710000
Oct 07 14:41:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.040000
Oct 07 14:42:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.080000
Oct 07 14:42:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.460000
Oct 07 14:43:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.370000
Oct 07 14:43:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.320000
Oct 07 14:44:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.670000
Oct 07 14:44:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 14.170000
Oct 07 14:45:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 17.190001
Oct 07 14:45:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 12.250000
Oct 07 14:46:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 13.180000
Oct 07 14:46:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 13.680000
Oct 07 14:47:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.600000
Oct 07 14:47:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.840000
Oct 07 14:48:10 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 07 14:48:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 07 14:48:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 07 14:48:10 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 07 14:48:10 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 07 14:48:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 07 14:48:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 07 14:48:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 07 14:48:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 07 14:48:10 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 14:48:10 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 14:48:10 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 07 14:48:10 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 07 14:48:10 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 07 14:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 07 14:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 07 14:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 07 14:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 07 14:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 07 14:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 07 14:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 07 14:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 07 14:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 07 14:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 07 14:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 07 14:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 07 14:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 07 14:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 07 14:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 07 14:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 07 14:48:10 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2794, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 14:48:10 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 07 14:48:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 07 14:48:10 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2794 (ref=pe_calc-dc-1728283690-37483) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 14:48:10 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2794 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 07 14:48:10 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 07 14:48:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 07 14:48:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.620000
Oct 07 14:48:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.290000
Oct 07 14:48:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 14:49:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 07 14:49:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.900000
Oct 07 14:49:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 07 14:50:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.950000
Oct 07 14:50:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.840000
Oct 07 14:50:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 14:51:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 07 14:51:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.310000
Oct 07 14:51:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 07 14:52:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 07 14:52:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.990000
Oct 07 14:52:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 07 14:53:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.230000
Oct 07 14:53:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.130000
Oct 07 14:54:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.750000
Oct 07 14:54:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.630000
Oct 07 14:55:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 07 14:55:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.090000
Oct 07 14:55:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 07 14:56:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 07 14:57:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 07 14:57:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was negligible)
Oct 07 14:58:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 07 14:58:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.040000
Oct 07 14:58:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was negligible)
Oct 07 14:59:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 07 15:00:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.150000
Oct 07 15:00:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 07 15:00:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.090000
Oct 07 15:00:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 15:01:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.370000
Oct 07 15:01:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.660000
Oct 07 15:02:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.150000
Oct 07 15:02:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.750000
Oct 07 15:03:10 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 07 15:03:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 07 15:03:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 07 15:03:10 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 07 15:03:10 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 07 15:03:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 07 15:03:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 07 15:03:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 07 15:03:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 07 15:03:10 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 15:03:10 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 15:03:10 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 07 15:03:10 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 07 15:03:10 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 07 15:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 07 15:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 07 15:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 07 15:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 07 15:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 07 15:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 07 15:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 07 15:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 07 15:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 07 15:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 07 15:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 07 15:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 07 15:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 07 15:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 07 15:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 07 15:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 07 15:03:10 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2795, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 15:03:10 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 07 15:03:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 07 15:03:10 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2795 (ref=pe_calc-dc-1728284590-37502) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 15:03:10 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2795 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 07 15:03:10 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 07 15:03:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 07 15:03:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.140000
Oct 07 15:03:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.900000
Oct 07 15:04:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.330000
Oct 07 15:04:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 15:04:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.590000
Oct 07 15:04:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 15:05:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.230000
Oct 07 15:05:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.250000
Oct 07 15:06:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.670000
Oct 07 15:06:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.220000
Oct 07 15:06:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 15:07:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.230000
Oct 07 15:07:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 07 15:08:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.870000
Oct 07 15:08:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 07 15:08:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.480000
Oct 07 15:09:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.760000
Oct 07 15:09:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.740000
Oct 07 15:10:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.640000
Oct 07 15:10:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.540000
Oct 07 15:11:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.260000
Oct 07 15:11:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.800000
Oct 07 15:12:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.520000
Oct 07 15:12:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.150000
Oct 07 15:13:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 07 15:13:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.840000
Oct 07 15:13:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 07 15:14:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.300000
Oct 07 15:14:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 15:14:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.740000
Oct 07 15:15:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.190000
Oct 07 15:15:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.600000
Oct 07 15:16:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.490000
Oct 07 15:16:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.510000
Oct 07 15:17:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.320000
Oct 07 15:17:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.220000
Oct 07 15:17:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 15:18:10 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 07 15:18:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 07 15:18:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 07 15:18:10 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 07 15:18:10 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 07 15:18:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 07 15:18:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 07 15:18:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 07 15:18:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 07 15:18:10 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 15:18:10 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 15:18:10 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 07 15:18:10 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 07 15:18:10 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 07 15:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 07 15:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 07 15:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 07 15:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 07 15:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 07 15:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 07 15:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 07 15:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 07 15:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 07 15:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 07 15:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 07 15:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 07 15:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 07 15:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 07 15:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 07 15:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 07 15:18:10 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2796, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 15:18:10 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 07 15:18:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 07 15:18:10 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2796 (ref=pe_calc-dc-1728285490-37512) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 15:18:10 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2796 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 07 15:18:10 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 07 15:18:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 07 15:18:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was medium)
Oct 07 15:19:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was negligible)
Oct 07 15:19:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.010000
Oct 07 15:19:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 07 15:20:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.780000
Oct 07 15:20:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.100000
Oct 07 15:21:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.350000
Oct 07 15:21:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 15:21:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.140000
Oct 07 15:21:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 15:22:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.830000
Oct 07 15:22:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 15:22:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.850000
Oct 07 15:22:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 15:23:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.080000
Oct 07 15:23:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 15:23:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.000000
Oct 07 15:23:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 15:24:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.390000
Oct 07 15:24:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 15:24:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 07 15:25:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 07 15:25:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.380000
Oct 07 15:25:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was negligible)
Oct 07 15:26:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 07 15:28:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 07 15:28:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was negligible)
Oct 07 15:29:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 07 15:30:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was negligible)
Oct 07 15:31:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.930000
Oct 07 15:31:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 07 15:31:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 16.270000
Oct 07 15:32:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.030000
Oct 07 15:32:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.940000
Oct 07 15:33:10 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 07 15:33:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 07 15:33:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 07 15:33:10 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 07 15:33:10 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 07 15:33:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 07 15:33:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 07 15:33:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 07 15:33:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 07 15:33:10 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 15:33:10 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 15:33:10 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 07 15:33:10 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 07 15:33:10 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 07 15:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 07 15:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 07 15:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 07 15:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 07 15:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 07 15:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 07 15:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 07 15:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 07 15:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 07 15:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 07 15:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 07 15:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 07 15:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 07 15:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 07 15:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 07 15:33:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 07 15:33:10 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2797, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 15:33:10 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 07 15:33:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 07 15:33:10 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2797 (ref=pe_calc-dc-1728286390-37532) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 15:33:10 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2797 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 07 15:33:10 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 07 15:33:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 07 15:33:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.670000
Oct 07 15:33:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.740000
Oct 07 15:34:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.380000
Oct 07 15:34:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 15:34:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.430000
Oct 07 15:34:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 15:35:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.250000
Oct 07 15:35:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.530000
Oct 07 15:36:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.160000
Oct 07 15:36:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 15:36:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.680000
Oct 07 15:36:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 15:37:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.560000
Oct 07 15:37:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.910000
Oct 07 15:37:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 15:38:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.240000
Oct 07 15:38:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.380000
Oct 07 15:38:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 15:39:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.710000
Oct 07 15:39:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 14.470000
Oct 07 15:40:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.560000
Oct 07 15:40:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 13.750000
Oct 07 15:41:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.530000
Oct 07 15:41:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.350000
Oct 07 15:42:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 12.930000
Oct 07 15:42:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 12.790000
Oct 07 15:43:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.230000
Oct 07 15:43:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.970000
Oct 07 15:44:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 12.750000
Oct 07 15:44:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 13.650000
Oct 07 15:45:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.210000
Oct 07 15:45:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 13.380000
Oct 07 15:46:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.880000
Oct 07 15:46:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.310000
Oct 07 15:47:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.360000
Oct 07 15:47:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.700000
Oct 07 15:48:10 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 07 15:48:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 07 15:48:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 07 15:48:10 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 07 15:48:10 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 07 15:48:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 07 15:48:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 07 15:48:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 07 15:48:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 07 15:48:10 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 15:48:10 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 15:48:10 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 07 15:48:10 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 07 15:48:10 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 07 15:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 07 15:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 07 15:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 07 15:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 07 15:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 07 15:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 07 15:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 07 15:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 07 15:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 07 15:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 07 15:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 07 15:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 07 15:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 07 15:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 07 15:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 07 15:48:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 07 15:48:10 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2798, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 15:48:10 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 07 15:48:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 07 15:48:10 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2798 (ref=pe_calc-dc-1728287290-37539) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 15:48:10 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2798 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 07 15:48:10 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 07 15:48:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 07 15:48:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 07 15:49:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.890000
Oct 07 15:49:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 07 15:49:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.870000
Oct 07 15:49:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 15:50:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 07 15:50:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.880000
Oct 07 15:50:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 07 15:51:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.030000
Oct 07 15:51:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.740000
Oct 07 15:52:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.340000
Oct 07 15:52:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.730000
Oct 07 15:53:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.260000
Oct 07 15:53:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.570000
Oct 07 15:53:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 15:54:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.380000
Oct 07 15:54:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 15:54:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 12.530000
Oct 07 15:55:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.290000
Oct 07 15:55:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.750000
Oct 07 15:56:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.730000
Oct 07 15:56:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 15:56:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 07 15:59:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.330000
Oct 07 15:59:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 07 15:59:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.620000
Oct 07 16:00:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.370000
Oct 07 16:00:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.620000
Oct 07 16:01:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.860000
Oct 07 16:01:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.430000
Oct 07 16:02:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.170000
Oct 07 16:02:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.240000
Oct 07 16:03:10 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 07 16:03:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 07 16:03:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 07 16:03:10 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 07 16:03:10 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 07 16:03:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 07 16:03:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 07 16:03:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 07 16:03:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 07 16:03:10 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 16:03:10 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 16:03:10 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 07 16:03:10 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 07 16:03:10 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 07 16:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 07 16:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 07 16:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 07 16:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 07 16:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 07 16:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 07 16:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 07 16:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 07 16:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 07 16:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 07 16:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 07 16:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 07 16:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 07 16:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 07 16:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 07 16:03:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 07 16:03:10 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2799, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 16:03:10 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 07 16:03:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 07 16:03:10 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2799 (ref=pe_calc-dc-1728288190-37550) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 16:03:10 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2799 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 07 16:03:10 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 07 16:03:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 07 16:03:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.880000
Oct 07 16:03:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.530000
Oct 07 16:04:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.360000
Oct 07 16:04:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 13.200000
Oct 07 16:05:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.370000
Oct 07 16:05:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.860000
Oct 07 16:06:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.020000
Oct 07 16:06:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 16:06:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.110000
Oct 07 16:07:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.260000
Oct 07 16:07:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 16:07:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.530000
Oct 07 16:07:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 16:08:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was medium)
Oct 07 16:09:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.530000
Oct 07 16:09:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was negligible)
Oct 07 16:09:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.070000
Oct 07 16:10:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.140000
Oct 07 16:10:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.800000
Oct 07 16:10:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 16:11:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.750000
Oct 07 16:11:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 16:11:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.230000
Oct 07 16:12:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 12.890000
Oct 07 16:12:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 17.059999
Oct 07 16:13:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.830000
Oct 07 16:13:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.890000
Oct 07 16:14:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.550000
Oct 07 16:14:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.620000
Oct 07 16:14:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 16:15:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.140000
Oct 07 16:15:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.780000
Oct 07 16:15:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 16:16:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.040000
Oct 07 16:16:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 16.100000
Oct 07 16:17:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.650000
Oct 07 16:17:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.870000
Oct 07 16:18:10 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 07 16:18:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 07 16:18:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 07 16:18:10 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 07 16:18:10 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 07 16:18:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 07 16:18:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 07 16:18:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 07 16:18:10 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 07 16:18:10 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 16:18:10 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 16:18:10 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 07 16:18:10 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 07 16:18:10 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 07 16:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 07 16:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 07 16:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 07 16:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 07 16:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 07 16:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 07 16:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 07 16:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 07 16:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 07 16:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 07 16:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 07 16:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 07 16:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 07 16:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 07 16:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 07 16:18:10 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 07 16:18:10 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2800, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 16:18:10 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 07 16:18:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 07 16:18:10 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2800 (ref=pe_calc-dc-1728289090-37560) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 16:18:10 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2800 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 07 16:18:10 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 07 16:18:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 07 16:18:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.460000
Oct 07 16:18:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.740000
Oct 07 16:19:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.350000
Oct 07 16:19:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.870000
Oct 07 16:20:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.240000
Oct 07 16:20:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.260000
Oct 07 16:20:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 16:21:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was medium)
Oct 07 16:21:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was negligible)
Oct 07 16:22:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.470000
Oct 07 16:22:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 07 16:22:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 07 16:24:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 07 16:25:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.240000
Oct 07 16:25:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was negligible)
Oct 07 16:25:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.520000
Oct 07 16:26:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.990000
Oct 07 16:26:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 16:26:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 07 16:27:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.660000
Oct 07 16:27:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 07 16:27:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.660000
Oct 07 16:28:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.310000
Oct 07 16:28:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 16:28:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 07 16:29:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.120000
Oct 07 16:29:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 07 16:30:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.910000
Oct 07 16:30:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 16:30:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.510000
Oct 07 16:30:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 16:31:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.440000
Oct 07 16:31:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.970000
Oct 07 16:32:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.050000
Oct 07 16:32:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.910000
Oct 07 16:33:10 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 07 16:33:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 07 16:33:10 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 07 16:33:11 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 07 16:33:11 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 07 16:33:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 07 16:33:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 07 16:33:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 07 16:33:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 07 16:33:11 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 16:33:11 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 16:33:11 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 07 16:33:11 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 07 16:33:11 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 07 16:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 07 16:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 07 16:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 07 16:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 07 16:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 07 16:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 07 16:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 07 16:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 07 16:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 07 16:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 07 16:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 07 16:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 07 16:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 07 16:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 07 16:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 07 16:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 07 16:33:11 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2801, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 16:33:11 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 07 16:33:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 07 16:33:11 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2801 (ref=pe_calc-dc-1728289990-37576) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 16:33:11 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2801 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 07 16:33:11 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 07 16:33:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 07 16:33:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.000000
Oct 07 16:33:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.790000
Oct 07 16:34:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 07 16:34:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.150000
Oct 07 16:34:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 07 16:35:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 07 16:36:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.210000
Oct 07 16:36:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 07 16:36:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.040000
Oct 07 16:37:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 07 16:37:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.650000
Oct 07 16:37:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 07 16:38:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.680000
Oct 07 16:38:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 16:38:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.400000
Oct 07 16:38:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 16:39:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.450000
Oct 07 16:39:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.840000
Oct 07 16:40:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was medium)
Oct 07 16:41:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was negligible)
Oct 07 16:43:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.910000
Oct 07 16:43:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 07 16:43:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.430000
Oct 07 16:44:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 07 16:44:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.190000
Oct 07 16:44:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 07 16:45:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 07 16:46:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.450000
Oct 07 16:46:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 07 16:47:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 07 16:47:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.160000
Oct 07 16:47:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 07 16:48:11 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 07 16:48:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 07 16:48:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 07 16:48:11 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 07 16:48:11 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 07 16:48:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 07 16:48:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 07 16:48:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 07 16:48:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 07 16:48:11 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 16:48:11 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 16:48:11 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 07 16:48:11 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 07 16:48:11 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 07 16:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 07 16:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 07 16:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 07 16:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 07 16:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 07 16:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 07 16:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 07 16:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 07 16:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 07 16:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 07 16:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 07 16:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 07 16:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 07 16:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 07 16:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 07 16:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 07 16:48:11 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2802, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 16:48:11 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 07 16:48:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 07 16:48:11 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2802 (ref=pe_calc-dc-1728290891-37594) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 16:48:11 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2802 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 07 16:48:11 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 07 16:48:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 07 16:48:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.740000
Oct 07 16:48:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.220000
Oct 07 16:49:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.870000
Oct 07 16:49:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.610000
Oct 07 16:49:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 16:50:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 07 16:50:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 07 16:51:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was negligible)
Oct 07 16:52:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.990000
Oct 07 16:52:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 07 16:53:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.450000
Oct 07 16:53:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.390000
Oct 07 16:54:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.740000
Oct 07 16:54:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 16:54:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 07 16:55:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.320000
Oct 07 16:55:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 07 16:55:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.340000
Oct 07 16:55:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 16:56:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 12.390000
Oct 07 16:56:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.750000
Oct 07 16:57:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.430000
Oct 07 16:57:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.630000
Oct 07 16:58:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.900000
Oct 07 16:58:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.480000
Oct 07 16:59:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.920000
Oct 07 16:59:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 16:59:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 07 17:00:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.090000
Oct 07 17:00:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 07 17:00:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.950000
Oct 07 17:00:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 17:01:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.480000
Oct 07 17:01:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.980000
Oct 07 17:02:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.120000
Oct 07 17:02:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 17:02:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.200000
Oct 07 17:03:11 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 07 17:03:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 07 17:03:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 07 17:03:11 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 07 17:03:11 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 07 17:03:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 07 17:03:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 07 17:03:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 07 17:03:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 07 17:03:11 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 17:03:11 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 17:03:11 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 07 17:03:11 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 07 17:03:11 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 07 17:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 07 17:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 07 17:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 07 17:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 07 17:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 07 17:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 07 17:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 07 17:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 07 17:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 07 17:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 07 17:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 07 17:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 07 17:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 07 17:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 07 17:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 07 17:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 07 17:03:11 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2803, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 17:03:11 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 07 17:03:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 07 17:03:11 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2803 (ref=pe_calc-dc-1728291791-37609) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 17:03:11 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2803 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 07 17:03:11 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 07 17:03:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 07 17:03:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.340000
Oct 07 17:03:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 07 17:04:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 07 17:04:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.790000
Oct 07 17:04:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was negligible)
Oct 07 17:05:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.620000
Oct 07 17:05:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.510000
Oct 07 17:06:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.700000
Oct 07 17:06:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.310000
Oct 07 17:07:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.910000
Oct 07 17:07:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 07 17:08:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.520000
Oct 07 17:08:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 07 17:08:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.800000
Oct 07 17:09:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.670000
Oct 07 17:09:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.710000
Oct 07 17:10:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 07 17:12:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.700000
Oct 07 17:12:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 07 17:12:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 07 17:14:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 07 17:15:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.540000
Oct 07 17:15:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was negligible)
Oct 07 17:15:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.460000
Oct 07 17:15:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 17:16:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.170000
Oct 07 17:16:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 07 17:17:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 07 17:18:11 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 07 17:18:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 07 17:18:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 07 17:18:11 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 07 17:18:11 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 07 17:18:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 07 17:18:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 07 17:18:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 07 17:18:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 07 17:18:11 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 17:18:11 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 17:18:11 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 07 17:18:11 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 07 17:18:11 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 07 17:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 07 17:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 07 17:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 07 17:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 07 17:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 07 17:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 07 17:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 07 17:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 07 17:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 07 17:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 07 17:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 07 17:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 07 17:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 07 17:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 07 17:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 07 17:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 07 17:18:11 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2804, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 17:18:11 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 07 17:18:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 07 17:18:11 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2804 (ref=pe_calc-dc-1728292691-37623) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 17:18:11 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2804 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 07 17:18:11 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 07 17:18:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 07 17:18:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.740000
Oct 07 17:18:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was negligible)
Oct 07 17:18:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.480000
Oct 07 17:19:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.850000
Oct 07 17:19:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 17:19:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.440000
Oct 07 17:20:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 14.850000
Oct 07 17:20:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.060000
Oct 07 17:21:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.530000
Oct 07 17:21:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.530000
Oct 07 17:22:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.730000
Oct 07 17:22:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.740000
Oct 07 17:23:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.080000
Oct 07 17:23:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 17:23:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 07 17:24:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.630000
Oct 07 17:24:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 07 17:24:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.390000
Oct 07 17:24:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 17:25:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.970000
Oct 07 17:25:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.850000
Oct 07 17:25:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 17:26:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 07 17:27:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 07 17:29:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was negligible)
Oct 07 17:29:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.820000
Oct 07 17:29:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 07 17:30:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.980000
Oct 07 17:30:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 17:30:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.680000
Oct 07 17:30:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 17:31:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.130000
Oct 07 17:31:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 17:31:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.440000
Oct 07 17:31:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 17:32:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.740000
Oct 07 17:32:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 17:32:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.370000
Oct 07 17:32:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 17:33:11 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 07 17:33:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 07 17:33:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 07 17:33:11 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 07 17:33:11 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 07 17:33:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 07 17:33:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 07 17:33:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 07 17:33:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 07 17:33:11 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 17:33:11 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 17:33:11 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 07 17:33:11 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 07 17:33:11 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 07 17:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 07 17:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 07 17:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 07 17:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 07 17:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 07 17:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 07 17:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 07 17:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 07 17:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 07 17:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 07 17:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 07 17:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 07 17:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 07 17:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 07 17:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 07 17:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 07 17:33:11 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2805, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 17:33:11 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 07 17:33:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 07 17:33:11 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2805 (ref=pe_calc-dc-1728293591-37641) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 17:33:11 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2805 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 07 17:33:11 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 07 17:33:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 07 17:33:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.750000
Oct 07 17:33:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.040000
Oct 07 17:34:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.680000
Oct 07 17:34:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 07 17:35:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.550000
Oct 07 17:35:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 07 17:35:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.890000
Oct 07 17:36:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.570000
Oct 07 17:36:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.280000
Oct 07 17:37:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.320000
Oct 07 17:37:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.310000
Oct 07 17:38:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.780000
Oct 07 17:38:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.790000
Oct 07 17:39:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.060000
Oct 07 17:39:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.350000
Oct 07 17:39:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 17:40:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.650000
Oct 07 17:40:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 17:40:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.250000
Oct 07 17:40:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 17:41:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was medium)
Oct 07 17:41:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was negligible)
Oct 07 17:42:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.750000
Oct 07 17:42:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 07 17:42:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 07 17:43:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 07 17:43:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was negligible)
Oct 07 17:44:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.740000
Oct 07 17:44:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 07 17:44:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 07 17:46:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.480000
Oct 07 17:46:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 07 17:46:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 07 17:47:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.250000
Oct 07 17:47:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 07 17:47:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.800000
Oct 07 17:47:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 17:48:11 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 07 17:48:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 07 17:48:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 07 17:48:11 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 07 17:48:11 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 07 17:48:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 07 17:48:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 07 17:48:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 07 17:48:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 07 17:48:11 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 17:48:11 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 17:48:11 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 07 17:48:11 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 07 17:48:11 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 07 17:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 07 17:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 07 17:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 07 17:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 07 17:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 07 17:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 07 17:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 07 17:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 07 17:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 07 17:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 07 17:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 07 17:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 07 17:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 07 17:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 07 17:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 07 17:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 07 17:48:11 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2806, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 17:48:11 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 07 17:48:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 07 17:48:11 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2806 (ref=pe_calc-dc-1728294491-37659) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 17:48:11 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2806 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 07 17:48:11 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 07 17:48:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 07 17:48:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.080000
Oct 07 17:48:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 16.059999
Oct 07 17:49:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.590000
Oct 07 17:49:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.680000
Oct 07 17:50:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.480000
Oct 07 17:50:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.730000
Oct 07 17:51:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.240000
Oct 07 17:51:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 17:51:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 07 17:52:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.820000
Oct 07 17:52:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 07 17:52:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.730000
Oct 07 17:53:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.210000
Oct 07 17:53:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.140000
Oct 07 17:54:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.920000
Oct 07 17:54:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 17:54:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 07 17:55:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.610000
Oct 07 17:55:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 07 17:56:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.400000
Oct 07 17:56:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 17:56:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.940000
Oct 07 17:56:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 17:57:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.370000
Oct 07 17:57:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 17:57:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.020000
Oct 07 17:57:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 17:58:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.010000
Oct 07 17:58:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.150000
Oct 07 17:59:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.340000
Oct 07 17:59:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 17:59:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 07 18:00:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.970000
Oct 07 18:00:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 07 18:00:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.200000
Oct 07 18:00:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 18:01:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.530000
Oct 07 18:01:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.440000
Oct 07 18:02:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.860000
Oct 07 18:02:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 18:02:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.170000
Oct 07 18:02:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 18:03:11 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 07 18:03:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 07 18:03:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 07 18:03:11 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 07 18:03:11 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 07 18:03:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 07 18:03:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 07 18:03:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 07 18:03:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 07 18:03:11 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 18:03:11 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 18:03:11 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 07 18:03:11 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 07 18:03:11 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 07 18:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 07 18:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 07 18:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 07 18:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 07 18:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 07 18:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 07 18:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 07 18:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 07 18:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 07 18:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 07 18:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 07 18:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 07 18:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 07 18:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 07 18:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 07 18:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 07 18:03:11 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2807, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 18:03:11 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 07 18:03:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 07 18:03:11 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2807 (ref=pe_calc-dc-1728295391-37676) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 18:03:11 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2807 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 07 18:03:11 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 07 18:03:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 07 18:03:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 07 18:04:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.990000
Oct 07 18:04:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 07 18:04:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 07 18:05:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 07 18:05:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was negligible)
Oct 07 18:06:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 07 18:07:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was negligible)
Oct 07 18:08:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.250000
Oct 07 18:08:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 07 18:09:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.880000
Oct 07 18:09:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.080000
Oct 07 18:09:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 18:10:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 07 18:10:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 07 18:11:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.100000
Oct 07 18:11:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was negligible)
Oct 07 18:12:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 07 18:12:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.510000
Oct 07 18:12:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 07 18:13:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 07 18:13:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 07 18:16:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.920000
Oct 07 18:16:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was negligible)
Oct 07 18:17:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.360000
Oct 07 18:17:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.780000
Oct 07 18:18:11 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 07 18:18:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 07 18:18:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 07 18:18:11 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 07 18:18:11 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 07 18:18:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 07 18:18:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 07 18:18:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 07 18:18:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 07 18:18:11 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 18:18:11 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 18:18:11 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 07 18:18:11 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 07 18:18:11 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 07 18:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 07 18:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 07 18:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 07 18:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 07 18:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 07 18:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 07 18:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 07 18:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 07 18:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 07 18:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 07 18:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 07 18:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 07 18:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 07 18:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 07 18:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 07 18:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 07 18:18:11 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2808, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 18:18:11 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 07 18:18:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 07 18:18:11 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2808 (ref=pe_calc-dc-1728296291-37694) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 18:18:11 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2808 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 07 18:18:11 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 07 18:18:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 07 18:18:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 07 18:19:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 07 18:20:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was negligible)
Oct 07 18:20:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 07 18:21:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was negligible)
Oct 07 18:22:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.150000
Oct 07 18:22:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 07 18:22:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.670000
Oct 07 18:22:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 18:23:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.230000
Oct 07 18:23:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 07 18:24:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.050000
Oct 07 18:24:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 07 18:24:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.110000
Oct 07 18:25:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.630000
Oct 07 18:25:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 18:25:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.190000
Oct 07 18:26:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.460000
Oct 07 18:26:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.500000
Oct 07 18:27:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.560000
Oct 07 18:27:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.030000
Oct 07 18:27:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 18:28:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.290000
Oct 07 18:28:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 18:28:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.230000
Oct 07 18:28:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 18:29:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.180000
Oct 07 18:29:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was medium)
Oct 07 18:30:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was negligible)
Oct 07 18:30:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 07 18:31:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was negligible)
Oct 07 18:31:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 07 18:32:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.960000
Oct 07 18:32:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was negligible)
Oct 07 18:33:11 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 07 18:33:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 07 18:33:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 07 18:33:11 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 07 18:33:11 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 07 18:33:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 07 18:33:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 07 18:33:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 07 18:33:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 07 18:33:11 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 18:33:11 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 18:33:11 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 07 18:33:11 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 07 18:33:11 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 07 18:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 07 18:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 07 18:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 07 18:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 07 18:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 07 18:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 07 18:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 07 18:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 07 18:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 07 18:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 07 18:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 07 18:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 07 18:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 07 18:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 07 18:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 07 18:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 07 18:33:11 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2809, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 18:33:11 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 07 18:33:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 07 18:33:11 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2809 (ref=pe_calc-dc-1728297191-37714) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 18:33:11 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2809 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 07 18:33:11 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 07 18:33:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 07 18:33:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 07 18:33:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.670000
Oct 07 18:33:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 07 18:34:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.700000
Oct 07 18:34:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.230000
Oct 07 18:34:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 18:35:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 07 18:36:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 07 18:36:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was negligible)
Oct 07 18:38:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 07 18:38:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.910000
Oct 07 18:38:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was negligible)
Oct 07 18:39:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.600000
Oct 07 18:39:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.430000
Oct 07 18:40:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 07 18:41:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.620000
Oct 07 18:41:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 07 18:42:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was medium)
Oct 07 18:42:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.330000
Oct 07 18:42:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was negligible)
Oct 07 18:43:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.700000
Oct 07 18:43:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 18:43:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.160000
Oct 07 18:44:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.400000
Oct 07 18:44:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 18:44:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 07 18:45:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 07 18:46:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was negligible)
Oct 07 18:47:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 07 18:48:11 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 07 18:48:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 07 18:48:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 07 18:48:11 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 07 18:48:11 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 07 18:48:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 07 18:48:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 07 18:48:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 07 18:48:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 07 18:48:11 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 18:48:11 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 18:48:11 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 07 18:48:11 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 07 18:48:11 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 07 18:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 07 18:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 07 18:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 07 18:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 07 18:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 07 18:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 07 18:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 07 18:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 07 18:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 07 18:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 07 18:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 07 18:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 07 18:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 07 18:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 07 18:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 07 18:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 07 18:48:11 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2810, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 18:48:11 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 07 18:48:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 07 18:48:11 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2810 (ref=pe_calc-dc-1728298091-37733) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 18:48:11 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2810 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 07 18:48:11 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 07 18:48:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 07 18:48:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.270000
Oct 07 18:48:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was negligible)
Oct 07 18:48:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 14.610000
Oct 07 18:49:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.090000
Oct 07 18:49:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.190000
Oct 07 18:49:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 18:50:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.630000
Oct 07 18:50:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.820000
Oct 07 18:50:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 18:51:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.760000
Oct 07 18:51:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 07 18:52:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.120000
Oct 07 18:52:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 07 18:52:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.350000
Oct 07 18:52:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 18:53:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.720000
Oct 07 18:53:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.230000
Oct 07 18:53:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 18:54:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.320000
Oct 07 18:54:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.710000
Oct 07 18:54:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 18:55:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 07 18:55:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.180000
Oct 07 18:55:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 07 18:56:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.990000
Oct 07 18:56:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.040000
Oct 07 18:57:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.340000
Oct 07 18:57:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 18:57:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 07 18:58:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.920000
Oct 07 18:58:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 07 18:59:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.910000
Oct 07 18:59:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 18:59:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.130000
Oct 07 18:59:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 19:00:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.630000
Oct 07 19:00:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 07 19:01:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 07 19:01:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was negligible)
Oct 07 19:02:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 07 19:03:11 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 07 19:03:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 07 19:03:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 07 19:03:11 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 07 19:03:11 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 07 19:03:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 07 19:03:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 07 19:03:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 07 19:03:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 07 19:03:11 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 19:03:11 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 19:03:11 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 07 19:03:11 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 07 19:03:11 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 07 19:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 07 19:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 07 19:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 07 19:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 07 19:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 07 19:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 07 19:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 07 19:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 07 19:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 07 19:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 07 19:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 07 19:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 07 19:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 07 19:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 07 19:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 07 19:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 07 19:03:11 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2811, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 19:03:11 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 07 19:03:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 07 19:03:11 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2811 (ref=pe_calc-dc-1728298991-37753) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 19:03:11 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2811 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 07 19:03:11 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 07 19:03:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 07 19:04:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.570000
Oct 07 19:04:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was negligible)
Oct 07 19:05:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 07 19:06:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 07 19:06:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.450000
Oct 07 19:06:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was negligible)
Oct 07 19:07:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.340000
Oct 07 19:07:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 19:07:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.900000
Oct 07 19:08:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.160000
Oct 07 19:08:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.340000
Oct 07 19:09:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.630000
Oct 07 19:09:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.330000
Oct 07 19:09:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 19:10:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 07 19:10:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 07 19:11:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was negligible)
Oct 07 19:11:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.540000
Oct 07 19:11:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 07 19:12:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.210000
Oct 07 19:12:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 19:12:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.990000
Oct 07 19:12:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 19:13:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 07 19:14:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.050000
Oct 07 19:14:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 07 19:14:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.630000
Oct 07 19:14:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 19:15:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.980000
Oct 07 19:15:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 19:15:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.130000
Oct 07 19:16:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.110000
Oct 07 19:16:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 19:16:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.930000
Oct 07 19:16:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 19:17:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.450000
Oct 07 19:17:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.090000
Oct 07 19:17:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 19:18:11 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 07 19:18:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 07 19:18:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 07 19:18:11 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 07 19:18:11 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 07 19:18:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 07 19:18:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 07 19:18:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 07 19:18:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 07 19:18:11 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 19:18:11 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 19:18:11 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 07 19:18:11 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 07 19:18:11 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 07 19:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 07 19:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 07 19:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 07 19:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 07 19:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 07 19:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 07 19:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 07 19:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 07 19:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 07 19:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 07 19:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 07 19:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 07 19:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 07 19:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 07 19:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 07 19:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 07 19:18:11 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2812, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 19:18:11 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 07 19:18:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 07 19:18:11 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2812 (ref=pe_calc-dc-1728299891-37773) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 19:18:11 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2812 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 07 19:18:11 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 07 19:18:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 07 19:18:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 07 19:18:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 07 19:19:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was negligible)
Oct 07 19:20:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.520000
Oct 07 19:20:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 07 19:21:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.650000
Oct 07 19:21:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 19:21:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.890000
Oct 07 19:22:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.280000
Oct 07 19:22:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.860000
Oct 07 19:23:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.560000
Oct 07 19:23:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 07 19:24:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.790000
Oct 07 19:24:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 07 19:25:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.200000
Oct 07 19:25:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 19:25:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.650000
Oct 07 19:25:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 19:26:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.480000
Oct 07 19:26:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.320000
Oct 07 19:26:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 19:27:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.660000
Oct 07 19:27:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 19:27:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.170000
Oct 07 19:28:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.230000
Oct 07 19:28:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 19:28:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 07 19:29:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.650000
Oct 07 19:29:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 07 19:29:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 07 19:30:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.300000
Oct 07 19:30:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 07 19:30:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 07 19:31:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.980000
Oct 07 19:31:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 07 19:31:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 07 19:33:11 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 07 19:33:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 07 19:33:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 07 19:33:11 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 07 19:33:11 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 07 19:33:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 07 19:33:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 07 19:33:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 07 19:33:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 07 19:33:11 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 19:33:11 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 19:33:11 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 07 19:33:11 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 07 19:33:11 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 07 19:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 07 19:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 07 19:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 07 19:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 07 19:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 07 19:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 07 19:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 07 19:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 07 19:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 07 19:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 07 19:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 07 19:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 07 19:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 07 19:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 07 19:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 07 19:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 07 19:33:11 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2813, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 19:33:11 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 07 19:33:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 07 19:33:11 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2813 (ref=pe_calc-dc-1728300791-37793) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 19:33:11 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2813 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 07 19:33:11 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 07 19:33:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 07 19:33:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 07 19:34:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.870000
Oct 07 19:34:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was negligible)
Oct 07 19:35:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.670000
Oct 07 19:35:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 19:35:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.800000
Oct 07 19:35:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 19:36:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.240000
Oct 07 19:36:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 19:36:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.720000
Oct 07 19:37:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 12.460000
Oct 07 19:37:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 19:37:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.670000
Oct 07 19:38:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.770000
Oct 07 19:38:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 07 19:39:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 07 19:40:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.420000
Oct 07 19:40:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was negligible)
Oct 07 19:40:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.960000
Oct 07 19:41:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.690000
Oct 07 19:41:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.130000
Oct 07 19:41:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 19:42:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was medium)
Oct 07 19:43:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.190000
Oct 07 19:43:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was negligible)
Oct 07 19:44:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.620000
Oct 07 19:44:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.470000
Oct 07 19:45:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.170000
Oct 07 19:45:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.200000
Oct 07 19:46:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.770000
Oct 07 19:46:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 19:46:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.440000
Oct 07 19:46:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 19:47:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.070000
Oct 07 19:47:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 19:47:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.140000
Oct 07 19:47:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 19:48:11 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 07 19:48:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 07 19:48:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 07 19:48:11 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 07 19:48:11 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 07 19:48:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 07 19:48:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 07 19:48:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 07 19:48:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 07 19:48:11 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 19:48:11 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 19:48:11 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 07 19:48:11 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 07 19:48:11 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 07 19:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 07 19:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 07 19:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 07 19:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 07 19:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 07 19:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 07 19:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 07 19:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 07 19:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 07 19:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 07 19:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 07 19:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 07 19:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 07 19:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 07 19:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 07 19:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 07 19:48:11 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2814, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 19:48:11 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 07 19:48:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 07 19:48:11 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2814 (ref=pe_calc-dc-1728301691-37810) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 19:48:11 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2814 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 07 19:48:11 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 07 19:48:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 07 19:48:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.910000
Oct 07 19:48:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.970000
Oct 07 19:48:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 19:49:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.710000
Oct 07 19:49:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 07 19:50:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 07 19:51:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was negligible)
Oct 07 19:51:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 07 19:53:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 17.379999
Oct 07 19:53:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was negligible)
Oct 07 19:53:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 13.850000
Oct 07 19:54:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.120000
Oct 07 19:54:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 13.080000
Oct 07 19:55:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.300000
Oct 07 19:55:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.360000
Oct 07 19:56:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.540000
Oct 07 19:56:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 07 19:57:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 07 19:57:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.400000
Oct 07 19:57:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was negligible)
Oct 07 19:58:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.060000
Oct 07 19:58:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 19:58:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.590000
Oct 07 19:59:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 07 19:59:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 07 20:00:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.340000
Oct 07 20:00:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was negligible)
Oct 07 20:01:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.940000
Oct 07 20:01:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 07 20:02:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 07 20:03:11 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 07 20:03:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 07 20:03:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 07 20:03:11 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 07 20:03:11 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 07 20:03:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 07 20:03:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 07 20:03:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 07 20:03:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 07 20:03:11 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 20:03:11 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 20:03:11 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 07 20:03:11 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 07 20:03:11 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 07 20:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 07 20:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 07 20:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 07 20:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 07 20:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 07 20:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 07 20:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 07 20:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 07 20:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 07 20:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 07 20:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 07 20:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 07 20:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 07 20:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 07 20:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 07 20:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 07 20:03:11 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2815, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 20:03:11 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 07 20:03:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 07 20:03:11 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2815 (ref=pe_calc-dc-1728302591-37826) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 20:03:11 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2815 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 07 20:03:11 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 07 20:03:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 07 20:03:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.440000
Oct 07 20:03:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was negligible)
Oct 07 20:04:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.880000
Oct 07 20:04:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.140000
Oct 07 20:04:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 20:05:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 07 20:05:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.180000
Oct 07 20:05:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 07 20:06:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.070000
Oct 07 20:06:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.160000
Oct 07 20:07:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.990000
Oct 07 20:07:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.010000
Oct 07 20:08:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.890000
Oct 07 20:08:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.960000
Oct 07 20:09:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.190000
Oct 07 20:09:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.320000
Oct 07 20:10:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.160000
Oct 07 20:10:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 20:10:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.760000
Oct 07 20:10:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 20:11:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.210000
Oct 07 20:11:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.410000
Oct 07 20:11:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 20:12:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was medium)
Oct 07 20:12:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.790000
Oct 07 20:12:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was negligible)
Oct 07 20:13:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.120000
Oct 07 20:13:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.210000
Oct 07 20:14:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.020000
Oct 07 20:14:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.670000
Oct 07 20:15:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.770000
Oct 07 20:15:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 20:15:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.680000
Oct 07 20:15:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 20:16:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.910000
Oct 07 20:16:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.690000
Oct 07 20:16:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 20:17:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 07 20:17:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 12.410000
Oct 07 20:17:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 07 20:18:11 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 07 20:18:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 07 20:18:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 07 20:18:11 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 07 20:18:11 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 07 20:18:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 07 20:18:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 07 20:18:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 07 20:18:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 07 20:18:11 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 20:18:11 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 20:18:11 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 07 20:18:11 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 07 20:18:11 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 07 20:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 07 20:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 07 20:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 07 20:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 07 20:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 07 20:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 07 20:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 07 20:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 07 20:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 07 20:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 07 20:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 07 20:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 07 20:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 07 20:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 07 20:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 07 20:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 07 20:18:11 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2816, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 20:18:11 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 07 20:18:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 07 20:18:11 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2816 (ref=pe_calc-dc-1728303491-37841) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 20:18:11 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2816 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 07 20:18:11 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 07 20:18:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 07 20:18:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.920000
Oct 07 20:18:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.490000
Oct 07 20:19:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.410000
Oct 07 20:19:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 20:19:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.400000
Oct 07 20:20:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 07 20:20:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.740000
Oct 07 20:20:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 07 20:21:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.070000
Oct 07 20:21:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 20:21:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.230000
Oct 07 20:22:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.340000
Oct 07 20:22:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.130000
Oct 07 20:22:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 20:23:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.430000
Oct 07 20:23:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 13.090000
Oct 07 20:24:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.320000
Oct 07 20:24:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.490000
Oct 07 20:25:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.230000
Oct 07 20:25:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.350000
Oct 07 20:26:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.140000
Oct 07 20:26:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.230000
Oct 07 20:27:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 07 20:27:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.850000
Oct 07 20:27:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 07 20:28:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.680000
Oct 07 20:28:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 12.550000
Oct 07 20:29:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.620000
Oct 07 20:29:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.180000
Oct 07 20:30:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 17.580000
Oct 07 20:30:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 13.720000
Oct 07 20:31:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 12.080000
Oct 07 20:31:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 16.879999
Oct 07 20:32:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 15.940000
Oct 07 20:32:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 12.890000
Oct 07 20:33:11 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 07 20:33:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 07 20:33:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 07 20:33:11 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 07 20:33:11 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 07 20:33:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 07 20:33:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 07 20:33:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 07 20:33:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 07 20:33:11 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 20:33:11 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 20:33:11 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 07 20:33:11 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 07 20:33:11 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 07 20:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 07 20:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 07 20:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 07 20:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 07 20:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 07 20:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 07 20:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 07 20:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 07 20:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 07 20:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 07 20:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 07 20:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 07 20:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 07 20:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 07 20:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 07 20:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 07 20:33:11 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2817, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 20:33:11 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 07 20:33:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 07 20:33:11 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2817 (ref=pe_calc-dc-1728304391-37849) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 20:33:11 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2817 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 07 20:33:11 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 07 20:33:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 07 20:33:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.330000
Oct 07 20:33:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.370000
Oct 07 20:34:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.570000
Oct 07 20:34:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.770000
Oct 07 20:35:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.460000
Oct 07 20:35:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.570000
Oct 07 20:36:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.310000
Oct 07 20:36:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 20:36:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.730000
Oct 07 20:37:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.120000
Oct 07 20:37:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 20:37:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.860000
Oct 07 20:37:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 20:38:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 07 20:38:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.630000
Oct 07 20:38:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 07 20:39:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.960000
Oct 07 20:39:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.300000
Oct 07 20:40:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.390000
Oct 07 20:40:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 20:40:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 07 20:41:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.250000
Oct 07 20:41:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 07 20:41:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.180000
Oct 07 20:42:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.300000
Oct 07 20:42:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.640000
Oct 07 20:43:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.650000
Oct 07 20:43:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 20:43:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.190000
Oct 07 20:44:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 07 20:44:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.970000
Oct 07 20:44:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 07 20:45:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.340000
Oct 07 20:45:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 20:45:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.260000
Oct 07 20:45:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 20:46:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 14.680000
Oct 07 20:46:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.870000
Oct 07 20:47:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 13.790000
Oct 07 20:47:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.000000
Oct 07 20:48:11 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 07 20:48:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 07 20:48:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 07 20:48:11 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 07 20:48:11 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 07 20:48:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 07 20:48:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 07 20:48:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 07 20:48:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 07 20:48:11 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 20:48:11 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 20:48:11 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 07 20:48:11 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 07 20:48:11 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 07 20:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 07 20:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 07 20:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 07 20:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 07 20:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 07 20:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 07 20:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 07 20:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 07 20:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 07 20:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 07 20:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 07 20:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 07 20:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 07 20:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 07 20:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 07 20:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 07 20:48:11 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2818, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 20:48:11 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 07 20:48:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 07 20:48:11 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2818 (ref=pe_calc-dc-1728305291-37863) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 20:48:11 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2818 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 07 20:48:11 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 07 20:48:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 07 20:48:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.470000
Oct 07 20:48:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.940000
Oct 07 20:48:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 20:49:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 07 20:50:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.750000
Oct 07 20:50:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 07 20:50:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.300000
Oct 07 20:50:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 20:51:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 07 20:52:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.610000
Oct 07 20:52:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 07 20:52:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.990000
Oct 07 20:53:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 12.620000
Oct 07 20:53:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.580000
Oct 07 20:54:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.430000
Oct 07 20:54:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.570000
Oct 07 20:55:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.720000
Oct 07 20:55:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.920000
Oct 07 20:56:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.530000
Oct 07 20:56:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.060000
Oct 07 20:57:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.580000
Oct 07 20:57:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.470000
Oct 07 20:58:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 07 20:58:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 07 20:59:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was negligible)
Oct 07 21:00:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.840000
Oct 07 21:00:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 07 21:00:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.200000
Oct 07 21:00:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 21:01:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.930000
Oct 07 21:01:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 21:01:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.270000
Oct 07 21:02:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.520000
Oct 07 21:02:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.770000
Oct 07 21:02:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 21:03:11 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 07 21:03:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 07 21:03:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 07 21:03:11 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 07 21:03:11 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 07 21:03:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 07 21:03:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 07 21:03:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 07 21:03:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 07 21:03:11 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 21:03:11 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 21:03:11 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 07 21:03:11 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 07 21:03:11 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 07 21:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 07 21:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 07 21:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 07 21:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 07 21:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 07 21:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 07 21:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 07 21:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 07 21:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 07 21:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 07 21:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 07 21:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 07 21:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 07 21:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 07 21:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 07 21:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 07 21:03:11 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2819, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 21:03:11 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 07 21:03:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 07 21:03:11 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2819 (ref=pe_calc-dc-1728306191-37877) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 21:03:11 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2819 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 07 21:03:11 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 07 21:03:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 07 21:03:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.660000
Oct 07 21:03:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.740000
Oct 07 21:03:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 21:04:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.460000
Oct 07 21:04:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 21:04:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.420000
Oct 07 21:04:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 21:05:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.990000
Oct 07 21:05:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.820000
Oct 07 21:05:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 21:06:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.760000
Oct 07 21:06:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 21:06:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.460000
Oct 07 21:07:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.990000
Oct 07 21:07:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.110000
Oct 07 21:08:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.890000
Oct 07 21:08:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.100000
Oct 07 21:09:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.720000
Oct 07 21:09:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 21:09:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.130000
Oct 07 21:10:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was medium)
Oct 07 21:10:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.990000
Oct 07 21:10:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was negligible)
Oct 07 21:11:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 14.770000
Oct 07 21:11:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.490000
Oct 07 21:12:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.770000
Oct 07 21:12:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.600000
Oct 07 21:13:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.590000
Oct 07 21:13:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.060000
Oct 07 21:14:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.150000
Oct 07 21:14:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 21:14:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was medium)
Oct 07 21:15:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.190000
Oct 07 21:15:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was negligible)
Oct 07 21:15:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.170000
Oct 07 21:15:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 21:16:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.900000
Oct 07 21:16:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 21:16:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.930000
Oct 07 21:17:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.880000
Oct 07 21:17:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 13.440000
Oct 07 21:18:11 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 07 21:18:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 07 21:18:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 07 21:18:11 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 07 21:18:11 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 07 21:18:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 07 21:18:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 07 21:18:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 07 21:18:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 07 21:18:11 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 21:18:11 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 21:18:11 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 07 21:18:11 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 07 21:18:11 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 07 21:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 07 21:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 07 21:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 07 21:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 07 21:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 07 21:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 07 21:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 07 21:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 07 21:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 07 21:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 07 21:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 07 21:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 07 21:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 07 21:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 07 21:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 07 21:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 07 21:18:11 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2820, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 21:18:11 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 07 21:18:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 07 21:18:11 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2820 (ref=pe_calc-dc-1728307091-37891) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 21:18:11 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2820 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 07 21:18:11 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 07 21:18:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 07 21:18:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.810000
Oct 07 21:18:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.690000
Oct 07 21:19:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.040000
Oct 07 21:19:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.520000
Oct 07 21:20:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.000000
Oct 07 21:20:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.860000
Oct 07 21:21:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.060000
Oct 07 21:21:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 07 21:22:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 07 21:22:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was negligible)
Oct 07 21:23:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.340000
Oct 07 21:23:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 07 21:24:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 07 21:24:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.260000
Oct 07 21:24:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 07 21:25:12 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 07 21:25:42 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.670000
Oct 07 21:25:42 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 07 21:26:12 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.990000
Oct 07 21:26:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.330000
Oct 07 21:27:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 07 21:28:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 07 21:29:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.850000
Oct 07 21:29:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was negligible)
Oct 07 21:30:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 07 21:30:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 07 21:31:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.570000
Oct 07 21:31:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was negligible)
Oct 07 21:32:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.880000
Oct 07 21:32:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 17.080000
Oct 07 21:33:11 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 07 21:33:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 07 21:33:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 07 21:33:11 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 07 21:33:11 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 07 21:33:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 07 21:33:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 07 21:33:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 07 21:33:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 07 21:33:11 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 21:33:11 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 21:33:11 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 07 21:33:11 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 07 21:33:11 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 07 21:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 07 21:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 07 21:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 07 21:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 07 21:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 07 21:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 07 21:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 07 21:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 07 21:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 07 21:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 07 21:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 07 21:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 07 21:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 07 21:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 07 21:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 07 21:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 07 21:33:11 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2821, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 21:33:11 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 07 21:33:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 07 21:33:11 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2821 (ref=pe_calc-dc-1728307991-37906) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 21:33:11 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2821 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 07 21:33:11 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 07 21:33:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 07 21:33:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.430000
Oct 07 21:33:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 13.590000
Oct 07 21:34:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.950000
Oct 07 21:34:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.210000
Oct 07 21:35:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.150000
Oct 07 21:35:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.950000
Oct 07 21:36:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.920000
Oct 07 21:36:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.140000
Oct 07 21:37:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.870000
Oct 07 21:37:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.260000
Oct 07 21:38:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.110000
Oct 07 21:38:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 21:38:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.450000
Oct 07 21:38:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 21:39:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.810000
Oct 07 21:39:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 21:39:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.150000
Oct 07 21:39:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 21:40:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.500000
Oct 07 21:40:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 21:40:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.850000
Oct 07 21:40:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 21:41:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 13.550000
Oct 07 21:41:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.210000
Oct 07 21:42:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 13.310000
Oct 07 21:42:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 14.520000
Oct 07 21:43:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.580000
Oct 07 21:43:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 15.410000
Oct 07 21:44:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.400000
Oct 07 21:44:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.430000
Oct 07 21:45:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.900000
Oct 07 21:45:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 17.840000
Oct 07 21:46:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 12.810000
Oct 07 21:46:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 12.710000
Oct 07 21:47:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 12.020000
Oct 07 21:47:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.700000
Oct 07 21:48:11 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 07 21:48:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 07 21:48:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 07 21:48:11 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 07 21:48:11 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 07 21:48:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 07 21:48:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 07 21:48:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 07 21:48:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 07 21:48:11 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 21:48:11 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 21:48:11 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 07 21:48:11 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 07 21:48:11 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 07 21:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 07 21:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 07 21:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 07 21:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 07 21:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 07 21:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 07 21:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 07 21:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 07 21:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 07 21:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 07 21:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 07 21:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 07 21:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 07 21:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 07 21:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 07 21:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 07 21:48:11 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2822, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 21:48:11 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 07 21:48:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 07 21:48:11 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2822 (ref=pe_calc-dc-1728308891-37913) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 21:48:11 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2822 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 07 21:48:11 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 07 21:48:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 07 21:48:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.550000
Oct 07 21:48:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.370000
Oct 07 21:48:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 21:49:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 07 21:49:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.350000
Oct 07 21:49:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 07 21:50:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.430000
Oct 07 21:50:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.880000
Oct 07 21:51:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.400000
Oct 07 21:51:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.570000
Oct 07 21:52:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.240000
Oct 07 21:52:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.550000
Oct 07 21:53:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.740000
Oct 07 21:53:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 21:53:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.380000
Oct 07 21:54:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 07 21:54:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.010000
Oct 07 21:54:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 07 21:55:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 07 21:55:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.770000
Oct 07 21:55:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 07 21:56:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.210000
Oct 07 21:56:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.150000
Oct 07 21:57:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.150000
Oct 07 21:57:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.350000
Oct 07 21:58:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.630000
Oct 07 21:58:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.450000
Oct 07 21:59:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.510000
Oct 07 21:59:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.530000
Oct 07 22:00:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.400000
Oct 07 22:00:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.800000
Oct 07 22:01:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.050000
Oct 07 22:01:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.460000
Oct 07 22:02:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 12.630000
Oct 07 22:02:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 12.990000
Oct 07 22:03:11 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 07 22:03:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 07 22:03:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 07 22:03:11 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 07 22:03:11 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 07 22:03:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 07 22:03:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 07 22:03:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 07 22:03:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 07 22:03:11 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 22:03:11 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 22:03:11 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 07 22:03:11 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 07 22:03:11 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 07 22:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 07 22:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 07 22:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 07 22:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 07 22:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 07 22:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 07 22:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 07 22:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 07 22:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 07 22:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 07 22:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 07 22:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 07 22:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 07 22:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 07 22:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 07 22:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 07 22:03:11 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2823, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 22:03:11 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 07 22:03:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 07 22:03:11 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2823 (ref=pe_calc-dc-1728309791-37922) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 22:03:11 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2823 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 07 22:03:11 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 07 22:03:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 07 22:03:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.450000
Oct 07 22:03:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.700000
Oct 07 22:04:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.630000
Oct 07 22:04:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.610000
Oct 07 22:05:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.210000
Oct 07 22:05:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 22:05:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.440000
Oct 07 22:06:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 07 22:08:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 07 22:08:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was negligible)
Oct 07 22:09:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 07 22:10:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.040000
Oct 07 22:10:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was negligible)
Oct 07 22:11:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.960000
Oct 07 22:11:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 07 22:12:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 07 22:12:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.490000
Oct 07 22:12:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was negligible)
Oct 07 22:13:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.760000
Oct 07 22:13:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 22:13:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.160000
Oct 07 22:14:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 07 22:14:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.870000
Oct 07 22:14:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 07 22:15:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.860000
Oct 07 22:15:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 22:15:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.350000
Oct 07 22:16:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 07 22:16:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.270000
Oct 07 22:16:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 07 22:17:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.430000
Oct 07 22:17:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 07 22:18:11 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 07 22:18:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 07 22:18:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 07 22:18:11 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 07 22:18:11 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 07 22:18:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 07 22:18:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 07 22:18:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 07 22:18:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 07 22:18:11 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 22:18:11 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 22:18:11 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 07 22:18:11 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 07 22:18:11 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 07 22:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 07 22:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 07 22:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 07 22:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 07 22:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 07 22:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 07 22:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 07 22:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 07 22:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 07 22:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 07 22:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 07 22:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 07 22:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 07 22:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 07 22:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 07 22:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 07 22:18:11 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2824, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 22:18:11 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 07 22:18:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 07 22:18:11 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2824 (ref=pe_calc-dc-1728310691-37939) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 22:18:11 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2824 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 07 22:18:11 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 07 22:18:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 07 22:18:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.950000
Oct 07 22:18:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 07 22:19:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.320000
Oct 07 22:19:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.330000
Oct 07 22:19:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 22:20:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.230000
Oct 07 22:20:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 22:20:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.360000
Oct 07 22:21:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 07 22:21:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 13.690000
Oct 07 22:21:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 07 22:22:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.790000
Oct 07 22:22:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.810000
Oct 07 22:23:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.230000
Oct 07 22:23:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.630000
Oct 07 22:24:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.520000
Oct 07 22:24:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 15.960000
Oct 07 22:25:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 13.900000
Oct 07 22:25:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 12.170000
Oct 07 22:26:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.900000
Oct 07 22:26:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 13.700000
Oct 07 22:27:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.970000
Oct 07 22:27:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.520000
Oct 07 22:28:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.360000
Oct 07 22:28:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 22:28:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.070000
Oct 07 22:28:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 22:29:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 07 22:29:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.110000
Oct 07 22:29:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 07 22:30:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.120000
Oct 07 22:30:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.720000
Oct 07 22:31:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.060000
Oct 07 22:31:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.140000
Oct 07 22:31:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 22:32:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 07 22:33:11 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 07 22:33:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 07 22:33:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 07 22:33:11 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 07 22:33:11 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 07 22:33:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 07 22:33:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 07 22:33:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 07 22:33:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 07 22:33:11 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 22:33:11 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 22:33:11 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 07 22:33:11 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 07 22:33:11 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 07 22:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 07 22:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 07 22:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 07 22:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 07 22:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 07 22:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 07 22:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 07 22:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 07 22:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 07 22:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 07 22:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 07 22:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 07 22:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 07 22:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 07 22:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 07 22:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 07 22:33:11 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2825, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 22:33:11 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 07 22:33:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 07 22:33:11 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2825 (ref=pe_calc-dc-1728311591-37951) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 22:33:11 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2825 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 07 22:33:11 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 07 22:33:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 07 22:33:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 07 22:33:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was negligible)
Oct 07 22:34:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.960000
Oct 07 22:34:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 07 22:35:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 07 22:35:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.310000
Oct 07 22:35:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 07 22:36:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 07 22:36:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.440000
Oct 07 22:36:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 07 22:37:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.500000
Oct 07 22:37:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.380000
Oct 07 22:38:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.100000
Oct 07 22:38:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.470000
Oct 07 22:39:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.270000
Oct 07 22:39:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 22:39:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.760000
Oct 07 22:39:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 22:40:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.930000
Oct 07 22:40:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.610000
Oct 07 22:41:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.230000
Oct 07 22:41:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.260000
Oct 07 22:42:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.850000
Oct 07 22:42:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.910000
Oct 07 22:43:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.450000
Oct 07 22:43:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.820000
Oct 07 22:43:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 22:44:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 07 22:44:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.400000
Oct 07 22:44:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 07 22:45:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.700000
Oct 07 22:45:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.070000
Oct 07 22:46:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.040000
Oct 07 22:46:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.100000
Oct 07 22:47:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.590000
Oct 07 22:47:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.860000
Oct 07 22:48:11 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 07 22:48:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 07 22:48:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 07 22:48:11 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 07 22:48:11 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 07 22:48:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 07 22:48:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 07 22:48:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 07 22:48:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 07 22:48:11 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 22:48:11 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 22:48:11 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 07 22:48:11 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 07 22:48:11 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 07 22:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 07 22:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 07 22:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 07 22:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 07 22:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 07 22:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 07 22:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 07 22:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 07 22:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 07 22:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 07 22:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 07 22:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 07 22:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 07 22:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 07 22:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 07 22:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 07 22:48:11 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2826, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 22:48:11 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 07 22:48:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 07 22:48:11 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2826 (ref=pe_calc-dc-1728312491-37964) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 22:48:11 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2826 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 07 22:48:11 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 07 22:48:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 07 22:48:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.520000
Oct 07 22:48:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 22:48:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 07 22:49:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.150000
Oct 07 22:49:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 07 22:50:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.370000
Oct 07 22:50:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 22:50:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.940000
Oct 07 22:51:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.740000
Oct 07 22:51:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.370000
Oct 07 22:51:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 22:52:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.440000
Oct 07 22:52:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 07 22:53:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 07 22:53:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was negligible)
Oct 07 22:54:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.630000
Oct 07 22:54:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 07 22:55:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 07 22:55:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.900000
Oct 07 22:55:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 07 22:56:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 07 22:56:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.200000
Oct 07 22:56:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 07 22:57:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.290000
Oct 07 22:57:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 22:57:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.190000
Oct 07 22:57:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 22:58:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.710000
Oct 07 22:58:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.010000
Oct 07 22:58:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 22:59:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 07 22:59:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.780000
Oct 07 22:59:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 07 23:00:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.520000
Oct 07 23:00:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 23:00:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.550000
Oct 07 23:00:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 23:01:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.470000
Oct 07 23:01:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.410000
Oct 07 23:02:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.510000
Oct 07 23:02:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 07 23:03:11 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 07 23:03:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 07 23:03:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 07 23:03:11 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 07 23:03:11 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 07 23:03:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 07 23:03:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 07 23:03:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 07 23:03:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 07 23:03:11 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 23:03:11 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 23:03:11 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 07 23:03:11 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 07 23:03:11 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 07 23:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 07 23:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 07 23:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 07 23:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 07 23:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 07 23:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 07 23:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 07 23:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 07 23:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 07 23:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 07 23:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 07 23:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 07 23:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 07 23:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 07 23:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 07 23:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 07 23:03:11 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2827, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 23:03:11 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 07 23:03:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 07 23:03:11 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2827 (ref=pe_calc-dc-1728313391-37986) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 23:03:11 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2827 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 07 23:03:11 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 07 23:03:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 07 23:03:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.100000
Oct 07 23:03:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 07 23:03:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.310000
Oct 07 23:04:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.870000
Oct 07 23:04:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 07 23:05:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.800000
Oct 07 23:05:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 07 23:06:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.420000
Oct 07 23:06:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 23:06:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.940000
Oct 07 23:06:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 23:07:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.480000
Oct 07 23:07:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.220000
Oct 07 23:08:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.830000
Oct 07 23:08:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.030000
Oct 07 23:09:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.500000
Oct 07 23:09:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.220000
Oct 07 23:10:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.470000
Oct 07 23:10:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.860000
Oct 07 23:11:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.600000
Oct 07 23:11:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.640000
Oct 07 23:12:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.810000
Oct 07 23:12:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.820000
Oct 07 23:13:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.770000
Oct 07 23:13:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.670000
Oct 07 23:13:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 23:14:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.090000
Oct 07 23:14:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 23:14:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.390000
Oct 07 23:15:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.440000
Oct 07 23:15:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.450000
Oct 07 23:15:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 23:16:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 07 23:17:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.840000
Oct 07 23:17:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 07 23:17:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.340000
Oct 07 23:18:11 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 07 23:18:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 07 23:18:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 07 23:18:11 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 07 23:18:11 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 07 23:18:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 07 23:18:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 07 23:18:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 07 23:18:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 07 23:18:11 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 23:18:11 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 23:18:11 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 07 23:18:11 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 07 23:18:11 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 07 23:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 07 23:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 07 23:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 07 23:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 07 23:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 07 23:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 07 23:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 07 23:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 07 23:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 07 23:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 07 23:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 07 23:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 07 23:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 07 23:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 07 23:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 07 23:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 07 23:18:11 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2828, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 23:18:11 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 07 23:18:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 07 23:18:11 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2828 (ref=pe_calc-dc-1728314291-37997) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 23:18:11 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2828 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 07 23:18:11 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 07 23:18:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 07 23:18:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.770000
Oct 07 23:18:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.050000
Oct 07 23:19:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.630000
Oct 07 23:19:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 23:19:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.890000
Oct 07 23:20:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.310000
Oct 07 23:20:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.030000
Oct 07 23:20:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 23:21:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.340000
Oct 07 23:21:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.910000
Oct 07 23:22:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.350000
Oct 07 23:22:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.170000
Oct 07 23:23:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 07 23:23:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 07 23:24:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.510000
Oct 07 23:24:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was negligible)
Oct 07 23:25:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.560000
Oct 07 23:25:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.210000
Oct 07 23:26:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.660000
Oct 07 23:26:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.000000
Oct 07 23:27:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.900000
Oct 07 23:27:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.540000
Oct 07 23:28:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 07 23:28:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.940000
Oct 07 23:28:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 07 23:29:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 07 23:29:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.130000
Oct 07 23:29:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 07 23:30:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.790000
Oct 07 23:30:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 07 23:31:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.380000
Oct 07 23:31:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 07 23:32:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.650000
Oct 07 23:32:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 13.460000
Oct 07 23:33:11 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 07 23:33:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 07 23:33:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 07 23:33:11 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 07 23:33:11 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 07 23:33:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 07 23:33:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 07 23:33:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 07 23:33:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 07 23:33:11 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 23:33:11 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 23:33:11 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 07 23:33:11 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 07 23:33:11 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 07 23:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 07 23:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 07 23:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 07 23:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 07 23:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 07 23:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 07 23:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 07 23:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 07 23:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 07 23:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 07 23:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 07 23:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 07 23:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 07 23:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 07 23:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 07 23:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 07 23:33:11 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2829, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 23:33:11 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 07 23:33:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 07 23:33:11 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2829 (ref=pe_calc-dc-1728315191-38009) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 23:33:11 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2829 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 07 23:33:11 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 07 23:33:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 07 23:33:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.250000
Oct 07 23:33:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.960000
Oct 07 23:34:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 07 23:35:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 07 23:35:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.680000
Oct 07 23:35:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was negligible)
Oct 07 23:36:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.200000
Oct 07 23:36:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.090000
Oct 07 23:37:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 14.790000
Oct 07 23:37:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.830000
Oct 07 23:38:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.220000
Oct 07 23:38:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.040000
Oct 07 23:39:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.390000
Oct 07 23:39:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 23:39:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 07 23:40:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 13.500000
Oct 07 23:40:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 07 23:41:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.700000
Oct 07 23:41:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.120000
Oct 07 23:42:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.760000
Oct 07 23:42:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 23:42:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 14.160000
Oct 07 23:42:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 23:43:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.290000
Oct 07 23:43:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.420000
Oct 07 23:44:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.730000
Oct 07 23:44:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 13.300000
Oct 07 23:45:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.910000
Oct 07 23:45:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.840000
Oct 07 23:46:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.210000
Oct 07 23:46:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 07 23:47:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.470000
Oct 07 23:47:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 07 23:48:11 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 07 23:48:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 07 23:48:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 07 23:48:11 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 07 23:48:11 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 07 23:48:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 07 23:48:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 07 23:48:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 07 23:48:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 07 23:48:11 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 23:48:11 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 07 23:48:11 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 07 23:48:11 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 07 23:48:11 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 07 23:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 07 23:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 07 23:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 07 23:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 07 23:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 07 23:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 07 23:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 07 23:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 07 23:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 07 23:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 07 23:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 07 23:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 07 23:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 07 23:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 07 23:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 07 23:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 07 23:48:11 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2830, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 23:48:11 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 07 23:48:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 07 23:48:11 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2830 (ref=pe_calc-dc-1728316091-38020) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 07 23:48:11 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2830 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 07 23:48:11 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 07 23:48:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 07 23:48:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.930000
Oct 07 23:48:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.780000
Oct 07 23:49:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.840000
Oct 07 23:49:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.270000
Oct 07 23:49:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 23:50:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.790000
Oct 07 23:50:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 23:50:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.710000
Oct 07 23:51:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.520000
Oct 07 23:51:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.100000
Oct 07 23:52:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.860000
Oct 07 23:52:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.180000
Oct 07 23:53:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 07 23:53:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.790000
Oct 07 23:53:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 07 23:54:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.580000
Oct 07 23:54:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.590000
Oct 07 23:55:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.160000
Oct 07 23:55:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 07 23:55:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.960000
Oct 07 23:55:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 07 23:56:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.970000
Oct 07 23:56:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.510000
Oct 07 23:57:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 07 23:57:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 07 23:58:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was negligible)
Oct 07 23:58:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.480000
Oct 07 23:58:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 07 23:59:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 13.150000
Oct 07 23:59:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.520000
Oct 08 00:00:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.780000
Oct 08 00:00:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.380000
Oct 08 00:01:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.650000
Oct 08 00:01:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 00:01:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.740000
Oct 08 00:01:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 08 00:02:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.350000
Oct 08 00:02:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 00:02:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.760000
Oct 08 00:03:11 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 08 00:03:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 08 00:03:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 08 00:03:11 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 08 00:03:11 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 08 00:03:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 08 00:03:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 08 00:03:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 08 00:03:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 08 00:03:11 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 08 00:03:11 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 08 00:03:11 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 08 00:03:11 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 08 00:03:11 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 08 00:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 08 00:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 08 00:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 08 00:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 08 00:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 08 00:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 08 00:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 08 00:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 08 00:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 08 00:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 08 00:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 08 00:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 08 00:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 08 00:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 08 00:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 08 00:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 08 00:03:11 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2831, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 08 00:03:11 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 08 00:03:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 08 00:03:11 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2831 (ref=pe_calc-dc-1728316991-38034) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 08 00:03:11 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2831 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 08 00:03:11 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 08 00:03:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 08 00:03:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 08 00:03:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.410000
Oct 08 00:03:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 08 00:04:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.050000
Oct 08 00:04:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.850000
Oct 08 00:05:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.360000
Oct 08 00:05:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 00:05:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.790000
Oct 08 00:05:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 08 00:06:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.590000
Oct 08 00:06:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.190000
Oct 08 00:06:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 00:07:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.430000
Oct 08 00:07:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 08 00:07:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 13.210000
Oct 08 00:08:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.760000
Oct 08 00:08:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.200000
Oct 08 00:09:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.380000
Oct 08 00:09:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.860000
Oct 08 00:10:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.420000
Oct 08 00:10:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 00:10:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 08 00:11:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.510000
Oct 08 00:11:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 08 00:12:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 08 00:12:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 13.390000
Oct 08 00:12:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 08 00:13:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.240000
Oct 08 00:13:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.400000
Oct 08 00:14:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.880000
Oct 08 00:14:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 00:14:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.030000
Oct 08 00:15:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 08 00:15:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 08 00:16:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.860000
Oct 08 00:16:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was negligible)
Oct 08 00:16:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.390000
Oct 08 00:16:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 08 00:17:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.290000
Oct 08 00:17:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 00:17:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.170000
Oct 08 00:18:11 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 08 00:18:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 08 00:18:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 08 00:18:11 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 08 00:18:11 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 08 00:18:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 08 00:18:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 08 00:18:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 08 00:18:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 08 00:18:11 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 08 00:18:11 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 08 00:18:11 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 08 00:18:11 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 08 00:18:11 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 08 00:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 08 00:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 08 00:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 08 00:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 08 00:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 08 00:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 08 00:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 08 00:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 08 00:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 08 00:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 08 00:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 08 00:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 08 00:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 08 00:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 08 00:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 08 00:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 08 00:18:11 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2832, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 08 00:18:11 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 08 00:18:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 08 00:18:11 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2832 (ref=pe_calc-dc-1728317891-38052) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 08 00:18:11 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2832 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 08 00:18:11 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 08 00:18:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 08 00:18:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was medium)
Oct 08 00:22:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.920000
Oct 08 00:22:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was negligible)
Oct 08 00:22:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.100000
Oct 08 00:22:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 00:23:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.820000
Oct 08 00:23:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 08 00:23:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.530000
Oct 08 00:24:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.700000
Oct 08 00:24:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 14.660000
Oct 08 00:25:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.390000
Oct 08 00:25:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 20.510000
Oct 08 00:26:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 13.460000
Oct 08 00:26:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 12.160000
Oct 08 00:27:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.800000
Oct 08 00:27:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.510000
Oct 08 00:28:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 08 00:28:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.730000
Oct 08 00:28:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 08 00:29:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 08 00:30:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 12.310000
Oct 08 00:30:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 08 00:31:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 12.480000
Oct 08 00:31:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 14.750000
Oct 08 00:32:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 12.260000
Oct 08 00:32:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.020000
Oct 08 00:33:11 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 08 00:33:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 08 00:33:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 08 00:33:11 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 08 00:33:11 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 08 00:33:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 08 00:33:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 08 00:33:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 08 00:33:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 08 00:33:11 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 08 00:33:11 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 08 00:33:11 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 08 00:33:11 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 08 00:33:11 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 08 00:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 08 00:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 08 00:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 08 00:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 08 00:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 08 00:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 08 00:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 08 00:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 08 00:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 08 00:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 08 00:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 08 00:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 08 00:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 08 00:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 08 00:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 08 00:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 08 00:33:11 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2833, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 08 00:33:11 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 08 00:33:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 08 00:33:11 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2833 (ref=pe_calc-dc-1728318791-38061) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 08 00:33:11 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2833 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 08 00:33:11 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 08 00:33:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 08 00:33:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.420000
Oct 08 00:33:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 00:33:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.100000
Oct 08 00:33:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 08 00:34:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.200000
Oct 08 00:34:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.880000
Oct 08 00:35:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.070000
Oct 08 00:35:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.490000
Oct 08 00:36:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.480000
Oct 08 00:36:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.090000
Oct 08 00:37:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.710000
Oct 08 00:37:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 00:37:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.010000
Oct 08 00:37:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 08 00:38:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 08 00:38:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.240000
Oct 08 00:38:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 08 00:39:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 08 00:39:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.750000
Oct 08 00:39:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 08 00:40:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 08 00:40:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 08 00:41:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.650000
Oct 08 00:41:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was negligible)
Oct 08 00:42:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.540000
Oct 08 00:42:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 08 00:42:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.720000
Oct 08 00:42:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 00:43:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 08 00:43:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.430000
Oct 08 00:43:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 08 00:44:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.590000
Oct 08 00:44:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 00:44:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.280000
Oct 08 00:45:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 08 00:45:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.520000
Oct 08 00:45:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 08 00:46:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.580000
Oct 08 00:46:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 00:46:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.350000
Oct 08 00:47:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 08 00:48:11 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 08 00:48:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 08 00:48:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 08 00:48:11 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 08 00:48:11 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 08 00:48:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 08 00:48:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 08 00:48:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 08 00:48:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 08 00:48:11 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 08 00:48:11 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 08 00:48:11 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 08 00:48:11 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 08 00:48:11 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 08 00:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 08 00:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 08 00:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 08 00:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 08 00:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 08 00:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 08 00:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 08 00:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 08 00:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 08 00:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 08 00:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 08 00:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 08 00:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 08 00:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 08 00:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 08 00:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 08 00:48:11 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2834, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 08 00:48:11 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 08 00:48:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 08 00:48:11 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2834 (ref=pe_calc-dc-1728319691-38082) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 08 00:48:11 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2834 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 08 00:48:11 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 08 00:48:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 08 00:49:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.780000
Oct 08 00:49:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 08 00:49:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.460000
Oct 08 00:49:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 08 00:50:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.210000
Oct 08 00:50:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.930000
Oct 08 00:51:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.950000
Oct 08 00:51:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.180000
Oct 08 00:51:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 00:52:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.680000
Oct 08 00:52:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 08 00:52:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.860000
Oct 08 00:53:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.780000
Oct 08 00:53:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 08 00:54:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 08 00:54:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.370000
Oct 08 00:54:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was negligible)
Oct 08 00:55:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.520000
Oct 08 00:55:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.480000
Oct 08 00:56:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.110000
Oct 08 00:56:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.890000
Oct 08 00:57:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.250000
Oct 08 00:57:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.980000
Oct 08 00:58:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.130000
Oct 08 00:58:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.990000
Oct 08 00:59:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.330000
Oct 08 00:59:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.830000
Oct 08 01:00:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.500000
Oct 08 01:00:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 14.430000
Oct 08 01:01:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.070000
Oct 08 01:01:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.700000
Oct 08 01:02:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.710000
Oct 08 01:02:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.050000
Oct 08 01:03:11 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 08 01:03:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 08 01:03:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 08 01:03:11 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 08 01:03:11 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 08 01:03:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 08 01:03:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 08 01:03:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 08 01:03:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 08 01:03:11 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 08 01:03:11 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 08 01:03:11 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 08 01:03:11 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 08 01:03:11 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 08 01:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 08 01:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 08 01:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 08 01:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 08 01:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 08 01:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 08 01:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 08 01:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 08 01:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 08 01:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 08 01:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 08 01:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 08 01:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 08 01:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 08 01:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 08 01:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 08 01:03:11 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2835, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 08 01:03:11 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 08 01:03:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 08 01:03:11 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2835 (ref=pe_calc-dc-1728320591-38090) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 08 01:03:11 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2835 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 08 01:03:11 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 08 01:03:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 08 01:03:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.520000
Oct 08 01:03:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 01:03:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.670000
Oct 08 01:03:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 08 01:04:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.530000
Oct 08 01:04:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 01:04:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 08 01:05:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 08 01:06:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was negligible)
Oct 08 01:07:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 08 01:07:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.530000
Oct 08 01:07:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was negligible)
Oct 08 01:08:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.720000
Oct 08 01:08:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.080000
Oct 08 01:08:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 08 01:09:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.850000
Oct 08 01:09:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.590000
Oct 08 01:10:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.490000
Oct 08 01:10:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.710000
Oct 08 01:11:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 08 01:11:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.100000
Oct 08 01:11:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 08 01:12:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.470000
Oct 08 01:12:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.730000
Oct 08 01:13:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.080000
Oct 08 01:13:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 01:13:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.600000
Oct 08 01:13:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 08 01:14:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.730000
Oct 08 01:14:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.830000
Oct 08 01:14:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 01:15:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.690000
Oct 08 01:15:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 08 01:15:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 12.030000
Oct 08 01:16:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.660000
Oct 08 01:16:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.110000
Oct 08 01:17:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.220000
Oct 08 01:17:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.000000
Oct 08 01:18:11 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 08 01:18:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 08 01:18:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 08 01:18:11 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 08 01:18:11 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 08 01:18:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 08 01:18:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 08 01:18:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 08 01:18:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 08 01:18:11 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 08 01:18:11 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 08 01:18:11 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 08 01:18:11 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 08 01:18:11 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 08 01:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 08 01:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 08 01:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 08 01:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 08 01:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 08 01:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 08 01:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 08 01:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 08 01:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 08 01:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 08 01:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 08 01:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 08 01:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 08 01:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 08 01:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 08 01:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 08 01:18:11 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2836, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 08 01:18:11 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 08 01:18:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 08 01:18:11 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2836 (ref=pe_calc-dc-1728321491-38106) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 08 01:18:11 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2836 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 08 01:18:11 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 08 01:18:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 08 01:18:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.850000
Oct 08 01:18:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.960000
Oct 08 01:19:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 08 01:20:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 08 01:20:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was negligible)
Oct 08 01:21:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.960000
Oct 08 01:21:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 08 01:21:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 08 01:22:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 08 01:22:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.650000
Oct 08 01:22:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was negligible)
Oct 08 01:23:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.430000
Oct 08 01:23:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 01:23:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.450000
Oct 08 01:23:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 08 01:24:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.210000
Oct 08 01:24:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.690000
Oct 08 01:25:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 08 01:25:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 08 01:28:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.140000
Oct 08 01:28:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was negligible)
Oct 08 01:28:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.410000
Oct 08 01:29:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.410000
Oct 08 01:29:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 08 01:29:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 08 01:30:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.140000
Oct 08 01:30:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 08 01:30:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.740000
Oct 08 01:31:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.300000
Oct 08 01:31:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.410000
Oct 08 01:32:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.090000
Oct 08 01:32:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.490000
Oct 08 01:33:11 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 08 01:33:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 08 01:33:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 08 01:33:11 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 08 01:33:11 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 08 01:33:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 08 01:33:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 08 01:33:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 08 01:33:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 08 01:33:11 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 08 01:33:11 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 08 01:33:11 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 08 01:33:11 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 08 01:33:11 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 08 01:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 08 01:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 08 01:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 08 01:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 08 01:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 08 01:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 08 01:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 08 01:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 08 01:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 08 01:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 08 01:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 08 01:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 08 01:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 08 01:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 08 01:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 08 01:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 08 01:33:11 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2837, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 08 01:33:11 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 08 01:33:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 08 01:33:11 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2837 (ref=pe_calc-dc-1728322391-38122) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 08 01:33:11 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2837 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 08 01:33:11 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 08 01:33:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 08 01:33:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 08 01:34:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.600000
Oct 08 01:34:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 08 01:35:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.390000
Oct 08 01:35:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.760000
Oct 08 01:36:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.080000
Oct 08 01:36:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.560000
Oct 08 01:37:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 08 01:38:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 08 01:38:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.350000
Oct 08 01:38:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was negligible)
Oct 08 01:39:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.190000
Oct 08 01:39:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 08 01:39:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.550000
Oct 08 01:40:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.830000
Oct 08 01:40:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 01:40:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.090000
Oct 08 01:41:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 08 01:41:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 08 01:42:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.580000
Oct 08 01:42:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was negligible)
Oct 08 01:42:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.640000
Oct 08 01:42:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 01:43:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 08 01:43:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.230000
Oct 08 01:43:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 08 01:44:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 12.450000
Oct 08 01:44:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 17.010000
Oct 08 01:45:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 17.370001
Oct 08 01:45:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 24.080000
Oct 08 01:46:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 22.840000
Oct 08 01:46:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 17.129999
Oct 08 01:47:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 12.030000
Oct 08 01:47:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 15.110000
Oct 08 01:48:11 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 08 01:48:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 08 01:48:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 08 01:48:11 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 08 01:48:11 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 08 01:48:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 08 01:48:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 08 01:48:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 08 01:48:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 08 01:48:11 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 08 01:48:11 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 08 01:48:11 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 08 01:48:11 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 08 01:48:11 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 08 01:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 08 01:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 08 01:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 08 01:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 08 01:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 08 01:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 08 01:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 08 01:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 08 01:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 08 01:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 08 01:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 08 01:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 08 01:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 08 01:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 08 01:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 08 01:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 08 01:48:11 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2838, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 08 01:48:11 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 08 01:48:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 08 01:48:11 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2838 (ref=pe_calc-dc-1728323291-38136) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 08 01:48:11 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2838 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 08 01:48:11 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 08 01:48:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 08 01:48:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 18.360001
Oct 08 01:48:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 16.129999
Oct 08 01:49:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 17.110001
Oct 08 01:49:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 21.100000
Oct 08 01:50:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 13.840000
Oct 08 01:50:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.890000
Oct 08 01:51:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.290000
Oct 08 01:51:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.200000
Oct 08 01:52:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.950000
Oct 08 01:52:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.140000
Oct 08 01:53:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.300000
Oct 08 01:53:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 01:53:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 08 01:54:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 08 01:55:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.750000
Oct 08 01:55:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was negligible)
Oct 08 01:56:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was medium)
Oct 08 01:57:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was negligible)
Oct 08 01:58:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 08 01:58:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was negligible)
Oct 08 01:59:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 08 01:59:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was negligible)
Oct 08 02:00:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 08 02:02:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.340000
Oct 08 02:02:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was negligible)
Oct 08 02:02:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 08 02:03:11 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 08 02:03:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 08 02:03:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 08 02:03:11 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 08 02:03:11 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 08 02:03:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 08 02:03:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 08 02:03:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 08 02:03:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 08 02:03:11 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 08 02:03:11 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 08 02:03:11 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 08 02:03:11 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 08 02:03:11 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 08 02:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 08 02:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 08 02:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 08 02:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 08 02:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 08 02:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 08 02:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 08 02:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 08 02:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 08 02:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 08 02:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 08 02:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 08 02:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 08 02:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 08 02:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 08 02:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 08 02:03:11 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2839, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 08 02:03:11 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 08 02:03:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 08 02:03:11 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2839 (ref=pe_calc-dc-1728324191-38150) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 08 02:03:11 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2839 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 08 02:03:11 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 08 02:03:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 08 02:04:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 08 02:05:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.870000
Oct 08 02:05:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was negligible)
Oct 08 02:06:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.670000
Oct 08 02:06:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 02:06:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 08 02:07:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.540000
Oct 08 02:07:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 08 02:07:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.330000
Oct 08 02:07:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 02:08:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 08 02:09:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.520000
Oct 08 02:09:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 08 02:09:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 08 02:10:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.250000
Oct 08 02:10:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 08 02:11:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 08 02:11:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 08 02:12:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.880000
Oct 08 02:12:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was negligible)
Oct 08 02:12:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.950000
Oct 08 02:13:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 08 02:14:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 08 02:14:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.010000
Oct 08 02:14:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was negligible)
Oct 08 02:15:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 08 02:15:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.710000
Oct 08 02:15:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 08 02:16:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 08 02:16:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.840000
Oct 08 02:16:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 08 02:17:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.740000
Oct 08 02:17:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.760000
Oct 08 02:18:11 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 08 02:18:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 08 02:18:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 08 02:18:11 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 08 02:18:11 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 08 02:18:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 08 02:18:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 08 02:18:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 08 02:18:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 08 02:18:11 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 08 02:18:11 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 08 02:18:11 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 08 02:18:11 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 08 02:18:11 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 08 02:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 08 02:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 08 02:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 08 02:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 08 02:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 08 02:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 08 02:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 08 02:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 08 02:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 08 02:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 08 02:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 08 02:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 08 02:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 08 02:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 08 02:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 08 02:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 08 02:18:11 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2840, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 08 02:18:11 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 08 02:18:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 08 02:18:11 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2840 (ref=pe_calc-dc-1728325091-38171) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 08 02:18:11 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2840 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 08 02:18:11 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 08 02:18:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 08 02:18:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.020000
Oct 08 02:18:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.080000
Oct 08 02:19:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 08 02:20:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 08 02:20:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was negligible)
Oct 08 02:21:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.940000
Oct 08 02:21:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 08 02:21:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.180000
Oct 08 02:21:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 02:22:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was medium)
Oct 08 02:22:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.230000
Oct 08 02:22:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was negligible)
Oct 08 02:23:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.380000
Oct 08 02:23:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was medium)
Oct 08 02:24:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.820000
Oct 08 02:24:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was negligible)
Oct 08 02:24:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.940000
Oct 08 02:24:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 02:25:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 08 02:26:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 08 02:27:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.240000
Oct 08 02:27:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was negligible)
Oct 08 02:27:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.170000
Oct 08 02:28:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.310000
Oct 08 02:28:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 02:28:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 08 02:29:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.190000
Oct 08 02:29:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 08 02:29:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 08 02:30:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.910000
Oct 08 02:30:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 08 02:30:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.000000
Oct 08 02:30:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 02:31:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 08 02:32:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 08 02:32:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.610000
Oct 08 02:32:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was negligible)
Oct 08 02:33:11 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 08 02:33:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 08 02:33:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 08 02:33:11 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 08 02:33:11 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 08 02:33:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 08 02:33:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 08 02:33:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 08 02:33:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 08 02:33:11 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 08 02:33:11 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 08 02:33:11 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 08 02:33:11 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 08 02:33:11 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 08 02:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 08 02:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 08 02:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 08 02:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 08 02:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 08 02:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 08 02:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 08 02:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 08 02:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 08 02:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 08 02:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 08 02:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 08 02:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 08 02:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 08 02:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 08 02:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 08 02:33:11 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2841, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 08 02:33:11 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 08 02:33:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 08 02:33:11 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2841 (ref=pe_calc-dc-1728325991-38194) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 08 02:33:11 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2841 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 08 02:33:11 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 08 02:33:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 08 02:33:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.170000
Oct 08 02:33:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.860000
Oct 08 02:34:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.540000
Oct 08 02:34:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.220000
Oct 08 02:35:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.970000
Oct 08 02:35:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.940000
Oct 08 02:35:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 02:36:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 08 02:37:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.200000
Oct 08 02:37:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 08 02:37:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.260000
Oct 08 02:37:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 08 02:38:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.330000
Oct 08 02:38:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.840000
Oct 08 02:39:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.910000
Oct 08 02:39:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 02:39:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.330000
Oct 08 02:40:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 08 02:40:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 08 02:41:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.320000
Oct 08 02:41:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was negligible)
Oct 08 02:42:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.380000
Oct 08 02:42:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 02:42:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.250000
Oct 08 02:42:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 08 02:43:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.080000
Oct 08 02:43:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 08 02:44:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 08 02:44:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was negligible)
Oct 08 02:45:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.240000
Oct 08 02:45:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 08 02:45:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.360000
Oct 08 02:45:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 02:46:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.710000
Oct 08 02:46:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 08 02:47:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 08 02:48:11 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 08 02:48:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 08 02:48:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 08 02:48:11 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 08 02:48:11 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 08 02:48:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 08 02:48:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 08 02:48:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 08 02:48:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 08 02:48:11 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 08 02:48:11 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 08 02:48:11 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 08 02:48:11 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 08 02:48:11 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 08 02:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 08 02:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 08 02:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 08 02:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 08 02:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 08 02:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 08 02:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 08 02:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 08 02:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 08 02:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 08 02:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 08 02:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 08 02:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 08 02:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 08 02:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 08 02:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 08 02:48:11 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2842, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 08 02:48:11 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 08 02:48:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 08 02:48:11 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2842 (ref=pe_calc-dc-1728326891-38212) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 08 02:48:11 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2842 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 08 02:48:11 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 08 02:48:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 08 02:48:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was negligible)
Oct 08 02:49:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.350000
Oct 08 02:49:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 08 02:49:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.160000
Oct 08 02:49:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 08 02:50:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.810000
Oct 08 02:50:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.050000
Oct 08 02:50:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 02:51:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.620000
Oct 08 02:51:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 08 02:51:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.290000
Oct 08 02:52:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.270000
Oct 08 02:52:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 02:52:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 08 02:53:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.870000
Oct 08 02:53:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 08 02:53:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.910000
Oct 08 02:54:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.340000
Oct 08 02:54:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.270000
Oct 08 02:55:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.390000
Oct 08 02:55:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.820000
Oct 08 02:55:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 02:56:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.270000
Oct 08 02:56:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.020000
Oct 08 02:57:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.210000
Oct 08 02:57:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 08 02:57:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.300000
Oct 08 02:58:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.010000
Oct 08 02:58:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 02:58:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.320000
Oct 08 02:59:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.940000
Oct 08 02:59:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 08 03:00:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 08 03:00:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.300000
Oct 08 03:00:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was negligible)
Oct 08 03:01:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.840000
Oct 08 03:01:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 03:01:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 08 03:02:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.820000
Oct 08 03:02:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 08 03:02:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.030000
Oct 08 03:03:11 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 08 03:03:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 08 03:03:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 08 03:03:11 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 08 03:03:11 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 08 03:03:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 08 03:03:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 08 03:03:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 08 03:03:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 08 03:03:11 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 08 03:03:11 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 08 03:03:11 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 08 03:03:11 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 08 03:03:11 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 08 03:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 08 03:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 08 03:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 08 03:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 08 03:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 08 03:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 08 03:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 08 03:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 08 03:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 08 03:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 08 03:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 08 03:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 08 03:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 08 03:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 08 03:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 08 03:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 08 03:03:11 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2843, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 08 03:03:11 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 08 03:03:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 08 03:03:11 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2843 (ref=pe_calc-dc-1728327791-38230) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 08 03:03:11 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2843 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 08 03:03:11 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 08 03:03:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 08 03:03:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.600000
Oct 08 03:03:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.600000
Oct 08 03:04:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.140000
Oct 08 03:04:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 03:04:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.300000
Oct 08 03:04:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 08 03:05:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.700000
Oct 08 03:05:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.690000
Oct 08 03:06:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.320000
Oct 08 03:06:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.320000
Oct 08 03:07:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 08 03:07:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.600000
Oct 08 03:07:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 08 03:08:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.140000
Oct 08 03:08:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 08 03:08:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.210000
Oct 08 03:09:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.910000
Oct 08 03:09:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 03:09:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.390000
Oct 08 03:10:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 08 03:10:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.620000
Oct 08 03:10:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 08 03:11:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.700000
Oct 08 03:11:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 08 03:11:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.300000
Oct 08 03:11:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 03:12:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.290000
Oct 08 03:12:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 08 03:13:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 08 03:14:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.250000
Oct 08 03:14:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was negligible)
Oct 08 03:14:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.930000
Oct 08 03:14:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 08 03:15:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 12.290000
Oct 08 03:15:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.390000
Oct 08 03:16:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.690000
Oct 08 03:16:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.760000
Oct 08 03:17:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 16.820000
Oct 08 03:17:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 13.110000
Oct 08 03:18:11 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 08 03:18:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 08 03:18:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 08 03:18:11 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 08 03:18:11 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 08 03:18:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 08 03:18:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 08 03:18:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 08 03:18:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 08 03:18:11 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 08 03:18:11 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 08 03:18:11 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 08 03:18:11 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 08 03:18:11 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 08 03:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 08 03:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 08 03:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 08 03:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 08 03:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 08 03:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 08 03:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 08 03:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 08 03:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 08 03:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 08 03:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 08 03:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 08 03:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 08 03:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 08 03:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 08 03:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 08 03:18:11 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2844, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 08 03:18:11 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 08 03:18:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 08 03:18:11 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2844 (ref=pe_calc-dc-1728328691-38245) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 08 03:18:11 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2844 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 08 03:18:11 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 08 03:18:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 08 03:18:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.350000
Oct 08 03:18:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.830000
Oct 08 03:19:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.730000
Oct 08 03:19:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.540000
Oct 08 03:20:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.150000
Oct 08 03:20:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.960000
Oct 08 03:20:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 03:21:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 08 03:21:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 08 03:22:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was negligible)
Oct 08 03:22:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.680000
Oct 08 03:22:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 08 03:23:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.980000
Oct 08 03:23:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.150000
Oct 08 03:24:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.260000
Oct 08 03:24:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 14.400000
Oct 08 03:25:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.380000
Oct 08 03:25:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.200000
Oct 08 03:26:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.640000
Oct 08 03:26:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.190000
Oct 08 03:27:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.860000
Oct 08 03:27:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 03:27:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.590000
Oct 08 03:27:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 08 03:28:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.250000
Oct 08 03:28:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 15.020000
Oct 08 03:29:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.950000
Oct 08 03:29:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.790000
Oct 08 03:30:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.070000
Oct 08 03:30:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.940000
Oct 08 03:31:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.670000
Oct 08 03:31:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.330000
Oct 08 03:32:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.800000
Oct 08 03:32:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.710000
Oct 08 03:33:11 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 08 03:33:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 08 03:33:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 08 03:33:11 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 08 03:33:11 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 08 03:33:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 08 03:33:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 08 03:33:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 08 03:33:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 08 03:33:11 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 08 03:33:11 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 08 03:33:11 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 08 03:33:11 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 08 03:33:11 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 08 03:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 08 03:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 08 03:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 08 03:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 08 03:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 08 03:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 08 03:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 08 03:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 08 03:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 08 03:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 08 03:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 08 03:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 08 03:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 08 03:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 08 03:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 08 03:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 08 03:33:11 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2845, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 08 03:33:11 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 08 03:33:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 08 03:33:11 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2845 (ref=pe_calc-dc-1728329591-38253) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 08 03:33:11 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2845 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 08 03:33:11 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 08 03:33:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 08 03:33:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.870000
Oct 08 03:33:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.050000
Oct 08 03:34:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.270000
Oct 08 03:34:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.790000
Oct 08 03:34:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 03:35:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 08 03:35:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.490000
Oct 08 03:35:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 08 03:36:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 08 03:36:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.590000
Oct 08 03:36:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 08 03:37:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.020000
Oct 08 03:37:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.470000
Oct 08 03:38:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.660000
Oct 08 03:38:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.460000
Oct 08 03:39:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.770000
Oct 08 03:39:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.870000
Oct 08 03:40:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.500000
Oct 08 03:40:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.640000
Oct 08 03:40:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 03:41:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 08 03:41:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.140000
Oct 08 03:41:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 08 03:42:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.540000
Oct 08 03:42:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.140000
Oct 08 03:42:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 03:43:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.730000
Oct 08 03:43:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 08 03:43:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.600000
Oct 08 03:44:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.540000
Oct 08 03:44:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.310000
Oct 08 03:45:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.970000
Oct 08 03:45:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.220000
Oct 08 03:46:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.290000
Oct 08 03:46:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.900000
Oct 08 03:47:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.540000
Oct 08 03:47:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 03:47:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 08 03:48:11 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 08 03:48:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 08 03:48:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 08 03:48:11 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 08 03:48:11 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 08 03:48:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 08 03:48:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 08 03:48:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 08 03:48:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 08 03:48:11 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 08 03:48:11 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 08 03:48:11 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 08 03:48:11 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 08 03:48:11 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 08 03:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 08 03:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 08 03:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 08 03:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 08 03:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 08 03:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 08 03:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 08 03:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 08 03:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 08 03:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 08 03:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 08 03:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 08 03:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 08 03:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 08 03:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 08 03:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 08 03:48:11 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2846, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 08 03:48:11 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 08 03:48:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 08 03:48:11 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2846 (ref=pe_calc-dc-1728330491-38266) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 08 03:48:11 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2846 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 08 03:48:11 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 08 03:48:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 08 03:48:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.340000
Oct 08 03:48:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 08 03:48:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.320000
Oct 08 03:49:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.160000
Oct 08 03:49:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 12.280000
Oct 08 03:50:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 13.340000
Oct 08 03:50:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.660000
Oct 08 03:51:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.730000
Oct 08 03:51:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.500000
Oct 08 03:52:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.820000
Oct 08 03:52:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 13.460000
Oct 08 03:53:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.570000
Oct 08 03:53:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.240000
Oct 08 03:54:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.060000
Oct 08 03:54:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 03:54:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.310000
Oct 08 03:54:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 08 03:55:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 12.180000
Oct 08 03:55:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.420000
Oct 08 03:56:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.860000
Oct 08 03:56:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 03:56:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.490000
Oct 08 03:57:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 08 03:57:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.510000
Oct 08 03:57:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 08 03:58:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 08 03:58:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.110000
Oct 08 03:58:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 08 03:59:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.540000
Oct 08 03:59:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 08 03:59:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.930000
Oct 08 04:00:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.830000
Oct 08 04:00:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 04:00:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.760000
Oct 08 04:00:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 08 04:01:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.700000
Oct 08 04:01:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 04:01:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.640000
Oct 08 04:01:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 08 04:02:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.510000
Oct 08 04:02:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.080000
Oct 08 04:02:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 04:03:11 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 08 04:03:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 08 04:03:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 08 04:03:11 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 08 04:03:11 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 08 04:03:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 08 04:03:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 08 04:03:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 08 04:03:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 08 04:03:11 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 08 04:03:11 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 08 04:03:11 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 08 04:03:11 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 08 04:03:11 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 08 04:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 08 04:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 08 04:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 08 04:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 08 04:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 08 04:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 08 04:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 08 04:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 08 04:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 08 04:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 08 04:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 08 04:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 08 04:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 08 04:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 08 04:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 08 04:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 08 04:03:11 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2847, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 08 04:03:11 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 08 04:03:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 08 04:03:11 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2847 (ref=pe_calc-dc-1728331391-38281) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 08 04:03:11 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2847 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 08 04:03:11 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 08 04:03:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 08 04:03:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 08 04:04:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 08 04:04:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.000000
Oct 08 04:04:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was negligible)
Oct 08 04:05:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 08 04:05:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.860000
Oct 08 04:05:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 08 04:06:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.460000
Oct 08 04:06:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 16.250000
Oct 08 04:07:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.330000
Oct 08 04:07:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.390000
Oct 08 04:08:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.610000
Oct 08 04:08:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 13.280000
Oct 08 04:09:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.300000
Oct 08 04:09:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.090000
Oct 08 04:10:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.360000
Oct 08 04:10:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 08 04:11:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.720000
Oct 08 04:11:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 08 04:11:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.200000
Oct 08 04:11:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 08 04:12:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.990000
Oct 08 04:12:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.370000
Oct 08 04:13:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.920000
Oct 08 04:13:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.700000
Oct 08 04:14:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.430000
Oct 08 04:14:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.160000
Oct 08 04:14:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 04:15:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.280000
Oct 08 04:15:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 08 04:15:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.880000
Oct 08 04:16:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.150000
Oct 08 04:16:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 04:16:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.290000
Oct 08 04:17:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was medium)
Oct 08 04:17:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.890000
Oct 08 04:17:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was negligible)
Oct 08 04:18:11 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 08 04:18:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 08 04:18:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 08 04:18:11 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 08 04:18:11 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 08 04:18:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 08 04:18:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 08 04:18:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 08 04:18:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 08 04:18:11 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 08 04:18:11 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 08 04:18:11 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 08 04:18:11 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 08 04:18:11 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 08 04:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 08 04:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 08 04:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 08 04:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 08 04:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 08 04:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 08 04:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 08 04:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 08 04:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 08 04:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 08 04:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 08 04:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 08 04:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 08 04:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 08 04:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 08 04:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 08 04:18:11 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2848, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 08 04:18:11 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 08 04:18:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 08 04:18:11 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2848 (ref=pe_calc-dc-1728332291-38295) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 08 04:18:11 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2848 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 08 04:18:11 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 08 04:18:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 08 04:18:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 08 04:18:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.640000
Oct 08 04:18:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 08 04:19:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.140000
Oct 08 04:19:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.020000
Oct 08 04:20:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.300000
Oct 08 04:20:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 04:20:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.520000
Oct 08 04:20:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 08 04:21:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.990000
Oct 08 04:21:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.420000
Oct 08 04:22:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.590000
Oct 08 04:22:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 04:22:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.460000
Oct 08 04:22:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 08 04:23:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.430000
Oct 08 04:23:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 04:23:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.910000
Oct 08 04:24:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 08 04:24:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.860000
Oct 08 04:24:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 08 04:25:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.460000
Oct 08 04:25:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.280000
Oct 08 04:26:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.720000
Oct 08 04:26:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 04:26:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 08 04:27:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 08 04:27:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was negligible)
Oct 08 04:28:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.090000
Oct 08 04:28:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 08 04:28:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 12.260000
Oct 08 04:28:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 08 04:29:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.860000
Oct 08 04:29:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.130000
Oct 08 04:29:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 04:30:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.580000
Oct 08 04:30:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.050000
Oct 08 04:30:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 08 04:31:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.580000
Oct 08 04:31:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.510000
Oct 08 04:32:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.900000
Oct 08 04:32:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.860000
Oct 08 04:33:11 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 08 04:33:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 08 04:33:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 08 04:33:11 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 08 04:33:11 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 08 04:33:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 08 04:33:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 08 04:33:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 08 04:33:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 08 04:33:11 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 08 04:33:11 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 08 04:33:11 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 08 04:33:11 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 08 04:33:11 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 08 04:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 08 04:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 08 04:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 08 04:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 08 04:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 08 04:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 08 04:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 08 04:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 08 04:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 08 04:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 08 04:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 08 04:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 08 04:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 08 04:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 08 04:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 08 04:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 08 04:33:11 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2849, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 08 04:33:11 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 08 04:33:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 08 04:33:11 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2849 (ref=pe_calc-dc-1728333191-38313) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 08 04:33:11 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2849 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 08 04:33:11 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 08 04:33:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 08 04:33:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.800000
Oct 08 04:33:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.700000
Oct 08 04:34:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.090000
Oct 08 04:34:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 04:34:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.750000
Oct 08 04:34:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 08 04:35:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.890000
Oct 08 04:35:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 04:35:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.900000
Oct 08 04:35:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 08 04:36:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.750000
Oct 08 04:36:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 12.540000
Oct 08 04:37:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.060000
Oct 08 04:37:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.030000
Oct 08 04:38:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.780000
Oct 08 04:38:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.690000
Oct 08 04:39:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 12.720000
Oct 08 04:39:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.420000
Oct 08 04:40:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.750000
Oct 08 04:40:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 04:40:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.320000
Oct 08 04:41:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 08 04:42:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.550000
Oct 08 04:42:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 08 04:42:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.660000
Oct 08 04:43:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.500000
Oct 08 04:43:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.120000
Oct 08 04:44:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.880000
Oct 08 04:44:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.790000
Oct 08 04:45:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 13.540000
Oct 08 04:45:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 18.750000
Oct 08 04:46:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 12.700000
Oct 08 04:46:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 12.360000
Oct 08 04:47:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.220000
Oct 08 04:47:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.550000
Oct 08 04:47:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 04:48:11 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 08 04:48:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 08 04:48:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 08 04:48:11 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 08 04:48:11 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 08 04:48:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 08 04:48:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 08 04:48:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 08 04:48:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 08 04:48:11 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 08 04:48:11 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 08 04:48:11 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 08 04:48:11 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 08 04:48:11 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 08 04:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 08 04:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 08 04:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 08 04:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 08 04:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 08 04:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 08 04:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 08 04:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 08 04:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 08 04:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 08 04:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 08 04:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 08 04:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 08 04:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 08 04:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 08 04:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 08 04:48:11 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2850, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 08 04:48:11 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 08 04:48:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 08 04:48:11 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2850 (ref=pe_calc-dc-1728334091-38322) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 08 04:48:11 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2850 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 08 04:48:11 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 08 04:48:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 08 04:48:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.970000
Oct 08 04:48:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 08 04:48:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.190000
Oct 08 04:48:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 04:49:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 08 04:50:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 08 04:50:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.000000
Oct 08 04:50:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was negligible)
Oct 08 04:51:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.840000
Oct 08 04:51:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.930000
Oct 08 04:52:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 08 04:52:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 08 04:53:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.340000
Oct 08 04:53:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was negligible)
Oct 08 04:54:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.710000
Oct 08 04:54:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 08 04:54:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.400000
Oct 08 04:54:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 04:55:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 08 04:55:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.790000
Oct 08 04:55:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 08 04:56:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.210000
Oct 08 04:56:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.780000
Oct 08 04:57:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.560000
Oct 08 04:57:13 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 04:57:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.580000
Oct 08 04:57:43 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 08 04:58:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.970000
Oct 08 04:58:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 12.390000
Oct 08 04:59:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.720000
Oct 08 04:59:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.840000
Oct 08 05:00:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.810000
Oct 08 05:00:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.850000
Oct 08 05:01:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.840000
Oct 08 05:01:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.990000
Oct 08 05:02:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.970000
Oct 08 05:02:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.320000
Oct 08 05:03:11 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 08 05:03:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 08 05:03:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 08 05:03:11 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 08 05:03:11 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 08 05:03:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 08 05:03:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 08 05:03:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 08 05:03:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 08 05:03:11 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 08 05:03:11 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 08 05:03:11 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 08 05:03:11 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 08 05:03:11 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 08 05:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 08 05:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 08 05:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 08 05:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 08 05:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 08 05:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 08 05:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 08 05:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 08 05:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 08 05:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 08 05:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 08 05:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 08 05:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 08 05:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 08 05:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 08 05:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 08 05:03:11 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2851, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 08 05:03:11 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 08 05:03:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 08 05:03:11 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2851 (ref=pe_calc-dc-1728334991-38337) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 08 05:03:11 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2851 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 08 05:03:11 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 08 05:03:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 08 05:03:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.250000
Oct 08 05:03:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 14.790000
Oct 08 05:04:13 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.230000
Oct 08 05:04:43 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.400000
Oct 08 05:05:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.490000
Oct 08 05:05:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.580000
Oct 08 05:06:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.410000
Oct 08 05:06:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 12.960000
Oct 08 05:07:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 12.360000
Oct 08 05:07:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.200000
Oct 08 05:08:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.410000
Oct 08 05:08:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.910000
Oct 08 05:09:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.090000
Oct 08 05:09:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.220000
Oct 08 05:10:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.000000
Oct 08 05:10:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.260000
Oct 08 05:11:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.880000
Oct 08 05:11:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.880000
Oct 08 05:12:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.060000
Oct 08 05:12:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.840000
Oct 08 05:12:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 05:13:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.830000
Oct 08 05:13:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 08 05:13:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.770000
Oct 08 05:14:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.610000
Oct 08 05:14:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 08 05:15:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 08 05:16:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.560000
Oct 08 05:16:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was negligible)
Oct 08 05:16:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.470000
Oct 08 05:16:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 05:17:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 08 05:18:11 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 08 05:18:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 08 05:18:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 08 05:18:11 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 08 05:18:11 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 08 05:18:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 08 05:18:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 08 05:18:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 08 05:18:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 08 05:18:11 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 08 05:18:11 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 08 05:18:11 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 08 05:18:11 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 08 05:18:11 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 08 05:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 08 05:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 08 05:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 08 05:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 08 05:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 08 05:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 08 05:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 08 05:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 08 05:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 08 05:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 08 05:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 08 05:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 08 05:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 08 05:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 08 05:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 08 05:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 08 05:18:11 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2852, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 08 05:18:11 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 08 05:18:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 08 05:18:11 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2852 (ref=pe_calc-dc-1728335891-38345) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 08 05:18:11 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2852 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 08 05:18:11 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 08 05:18:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 08 05:18:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 08 05:19:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.450000
Oct 08 05:19:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was negligible)
Oct 08 05:19:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.220000
Oct 08 05:20:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.140000
Oct 08 05:20:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.810000
Oct 08 05:21:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.180000
Oct 08 05:21:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 05:21:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.970000
Oct 08 05:22:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 13.130000
Oct 08 05:22:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 08 05:22:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.020000
Oct 08 05:23:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.450000
Oct 08 05:23:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.020000
Oct 08 05:23:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 05:24:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 08 05:24:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.630000
Oct 08 05:24:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 08 05:25:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.740000
Oct 08 05:25:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 05:25:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.810000
Oct 08 05:25:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 08 05:26:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.150000
Oct 08 05:26:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 08 05:27:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.310000
Oct 08 05:27:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 08 05:28:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.550000
Oct 08 05:28:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 08 05:28:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.710000
Oct 08 05:29:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.780000
Oct 08 05:29:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.250000
Oct 08 05:30:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.720000
Oct 08 05:30:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.450000
Oct 08 05:31:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.610000
Oct 08 05:31:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 05:31:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.570000
Oct 08 05:31:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 08 05:32:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.780000
Oct 08 05:32:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 05:32:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.400000
Oct 08 05:33:11 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 08 05:33:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 08 05:33:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 08 05:33:11 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 08 05:33:11 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 08 05:33:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 08 05:33:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 08 05:33:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 08 05:33:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 08 05:33:11 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 08 05:33:11 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 08 05:33:11 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 08 05:33:11 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 08 05:33:11 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 08 05:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 08 05:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 08 05:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 08 05:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 08 05:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 08 05:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 08 05:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 08 05:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 08 05:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 08 05:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 08 05:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 08 05:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 08 05:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 08 05:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 08 05:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 08 05:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 08 05:33:11 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2853, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 08 05:33:11 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 08 05:33:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 08 05:33:11 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2853 (ref=pe_calc-dc-1728336791-38361) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 08 05:33:11 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2853 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 08 05:33:11 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 08 05:33:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 08 05:33:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 08 05:33:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.680000
Oct 08 05:33:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 08 05:34:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 08 05:35:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.710000
Oct 08 05:35:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 08 05:36:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.000000
Oct 08 05:36:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.860000
Oct 08 05:37:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.360000
Oct 08 05:37:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.910000
Oct 08 05:38:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.070000
Oct 08 05:38:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.160000
Oct 08 05:39:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.130000
Oct 08 05:39:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.660000
Oct 08 05:40:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.800000
Oct 08 05:40:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.100000
Oct 08 05:41:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.970000
Oct 08 05:41:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 05:41:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 08 05:42:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.340000
Oct 08 05:42:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 08 05:42:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.330000
Oct 08 05:43:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.190000
Oct 08 05:43:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 05:43:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 08 05:45:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.750000
Oct 08 05:45:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 08 05:46:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.300000
Oct 08 05:46:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 08 05:47:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.560000
Oct 08 05:47:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 08 05:47:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.640000
Oct 08 05:48:11 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 08 05:48:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 08 05:48:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 08 05:48:11 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 08 05:48:11 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 08 05:48:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 08 05:48:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 08 05:48:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 08 05:48:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 08 05:48:11 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 08 05:48:11 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 08 05:48:11 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 08 05:48:11 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 08 05:48:11 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 08 05:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 08 05:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 08 05:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 08 05:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 08 05:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 08 05:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 08 05:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 08 05:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 08 05:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 08 05:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 08 05:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 08 05:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 08 05:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 08 05:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 08 05:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 08 05:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 08 05:48:11 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2854, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 08 05:48:11 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 08 05:48:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 08 05:48:11 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2854 (ref=pe_calc-dc-1728337691-38374) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 08 05:48:11 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2854 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 08 05:48:11 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 08 05:48:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 08 05:48:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.530000
Oct 08 05:48:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.330000
Oct 08 05:49:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.310000
Oct 08 05:49:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 08 05:50:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.910000
Oct 08 05:50:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 08 05:50:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.450000
Oct 08 05:51:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 08 05:51:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.430000
Oct 08 05:51:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 08 05:52:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.370000
Oct 08 05:52:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.840000
Oct 08 05:53:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.410000
Oct 08 05:53:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.990000
Oct 08 05:54:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.920000
Oct 08 05:54:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 08 05:55:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 08 05:55:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.500000
Oct 08 05:55:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was negligible)
Oct 08 05:56:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 08 05:56:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.870000
Oct 08 05:56:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 08 05:57:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.670000
Oct 08 05:57:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.630000
Oct 08 05:58:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.960000
Oct 08 05:58:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.340000
Oct 08 05:59:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.320000
Oct 08 05:59:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 05:59:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.580000
Oct 08 06:00:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.280000
Oct 08 06:00:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 08 06:00:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.230000
Oct 08 06:01:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.620000
Oct 08 06:01:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.380000
Oct 08 06:02:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.900000
Oct 08 06:02:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 12.290000
Oct 08 06:03:11 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 08 06:03:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 08 06:03:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 08 06:03:11 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 08 06:03:11 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 08 06:03:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 08 06:03:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 08 06:03:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 08 06:03:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 08 06:03:11 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 08 06:03:11 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 08 06:03:11 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 08 06:03:11 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 08 06:03:11 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 08 06:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 08 06:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 08 06:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 08 06:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 08 06:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 08 06:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 08 06:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 08 06:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 08 06:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 08 06:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 08 06:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 08 06:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 08 06:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 08 06:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 08 06:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 08 06:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 08 06:03:11 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2855, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 08 06:03:11 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 08 06:03:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 08 06:03:11 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2855 (ref=pe_calc-dc-1728338591-38386) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 08 06:03:11 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2855 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 08 06:03:11 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 08 06:03:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 08 06:03:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.790000
Oct 08 06:03:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 14.820000
Oct 08 06:04:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.230000
Oct 08 06:04:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 13.490000
Oct 08 06:05:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.980000
Oct 08 06:05:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.230000
Oct 08 06:06:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.510000
Oct 08 06:06:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.850000
Oct 08 06:07:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.510000
Oct 08 06:07:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.580000
Oct 08 06:08:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.630000
Oct 08 06:08:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.320000
Oct 08 06:09:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.360000
Oct 08 06:09:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.750000
Oct 08 06:10:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.900000
Oct 08 06:10:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 06:10:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 08 06:11:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 08 06:11:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.960000
Oct 08 06:11:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was negligible)
Oct 08 06:12:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.150000
Oct 08 06:12:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 06:12:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.140000
Oct 08 06:12:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 08 06:13:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.120000
Oct 08 06:13:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 06:13:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.480000
Oct 08 06:13:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 08 06:14:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.260000
Oct 08 06:14:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.190000
Oct 08 06:15:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.860000
Oct 08 06:15:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.350000
Oct 08 06:16:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.800000
Oct 08 06:16:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 12.810000
Oct 08 06:17:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.440000
Oct 08 06:17:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 12.160000
Oct 08 06:18:11 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 08 06:18:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 08 06:18:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 08 06:18:11 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 08 06:18:11 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 08 06:18:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 08 06:18:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 08 06:18:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 08 06:18:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 08 06:18:11 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 08 06:18:11 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 08 06:18:11 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 08 06:18:11 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 08 06:18:11 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 08 06:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 08 06:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 08 06:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 08 06:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 08 06:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 08 06:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 08 06:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 08 06:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 08 06:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 08 06:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 08 06:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 08 06:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 08 06:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 08 06:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 08 06:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 08 06:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 08 06:18:11 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2856, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 08 06:18:11 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 08 06:18:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 08 06:18:11 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2856 (ref=pe_calc-dc-1728339491-38395) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 08 06:18:11 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2856 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 08 06:18:11 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 08 06:18:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 08 06:18:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.430000
Oct 08 06:18:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 15.080000
Oct 08 06:19:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.470000
Oct 08 06:19:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.860000
Oct 08 06:20:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 08 06:20:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.090000
Oct 08 06:20:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 08 06:21:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.300000
Oct 08 06:21:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 06:21:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 08 06:22:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.260000
Oct 08 06:22:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 08 06:22:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 08 06:23:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.760000
Oct 08 06:23:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 08 06:24:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.320000
Oct 08 06:24:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.370000
Oct 08 06:25:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.220000
Oct 08 06:25:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.690000
Oct 08 06:26:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.430000
Oct 08 06:26:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 06:26:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was medium)
Oct 08 06:27:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was negligible)
Oct 08 06:27:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.150000
Oct 08 06:27:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 08 06:28:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.100000
Oct 08 06:28:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 08 06:28:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.960000
Oct 08 06:29:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.220000
Oct 08 06:29:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.520000
Oct 08 06:30:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.120000
Oct 08 06:30:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 06:30:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.140000
Oct 08 06:31:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.740000
Oct 08 06:31:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 08 06:31:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.790000
Oct 08 06:32:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.730000
Oct 08 06:32:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.420000
Oct 08 06:33:11 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 08 06:33:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 08 06:33:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 08 06:33:11 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 08 06:33:11 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 08 06:33:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 08 06:33:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 08 06:33:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 08 06:33:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 08 06:33:11 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 08 06:33:11 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 08 06:33:11 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 08 06:33:11 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 08 06:33:11 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 08 06:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 08 06:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 08 06:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 08 06:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 08 06:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 08 06:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 08 06:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 08 06:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 08 06:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 08 06:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 08 06:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 08 06:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 08 06:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 08 06:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 08 06:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 08 06:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 08 06:33:11 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2857, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 08 06:33:11 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 08 06:33:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 08 06:33:11 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2857 (ref=pe_calc-dc-1728340391-38410) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 08 06:33:11 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2857 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 08 06:33:11 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 08 06:33:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 08 06:33:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.660000
Oct 08 06:33:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 06:33:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 12.810000
Oct 08 06:33:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 08 06:34:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 12.820000
Oct 08 06:34:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.900000
Oct 08 06:35:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.130000
Oct 08 06:35:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.960000
Oct 08 06:36:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.230000
Oct 08 06:36:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.990000
Oct 08 06:37:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.300000
Oct 08 06:37:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 06:37:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.600000
Oct 08 06:37:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 08 06:38:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.220000
Oct 08 06:38:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.970000
Oct 08 06:39:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.100000
Oct 08 06:39:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.210000
Oct 08 06:40:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.490000
Oct 08 06:40:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 08 06:41:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 08 06:42:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.160000
Oct 08 06:42:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was negligible)
Oct 08 06:42:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.690000
Oct 08 06:42:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 08 06:43:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.590000
Oct 08 06:43:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.680000
Oct 08 06:44:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 08 06:44:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 08 06:45:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 14.220000
Oct 08 06:45:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was negligible)
Oct 08 06:45:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.260000
Oct 08 06:46:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.630000
Oct 08 06:46:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.860000
Oct 08 06:47:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.190000
Oct 08 06:47:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 06:47:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 08 06:48:11 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 08 06:48:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 08 06:48:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 08 06:48:11 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 08 06:48:11 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 08 06:48:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 08 06:48:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 08 06:48:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 08 06:48:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 08 06:48:11 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 08 06:48:11 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 08 06:48:11 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 08 06:48:11 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 08 06:48:11 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 08 06:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 08 06:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 08 06:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 08 06:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 08 06:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 08 06:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 08 06:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 08 06:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 08 06:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 08 06:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 08 06:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 08 06:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 08 06:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 08 06:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 08 06:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 08 06:48:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 08 06:48:11 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2858, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 08 06:48:11 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 08 06:48:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 08 06:48:11 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2858 (ref=pe_calc-dc-1728341291-38424) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 08 06:48:11 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2858 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 08 06:48:11 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 08 06:48:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 08 06:48:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.530000
Oct 08 06:48:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 08 06:49:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.460000
Oct 08 06:49:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 08 06:49:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.490000
Oct 08 06:50:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.420000
Oct 08 06:50:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.150000
Oct 08 06:50:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 06:51:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.520000
Oct 08 06:51:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 08 06:51:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 08 06:52:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.420000
Oct 08 06:52:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 08 06:52:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.030000
Oct 08 06:52:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 06:53:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 08 06:53:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.350000
Oct 08 06:53:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 08 06:54:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.650000
Oct 08 06:54:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.150000
Oct 08 06:54:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 06:55:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.750000
Oct 08 06:55:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 08 06:55:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.180000
Oct 08 06:55:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 06:56:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.530000
Oct 08 06:56:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 08 06:56:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.780000
Oct 08 06:57:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.360000
Oct 08 06:57:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.710000
Oct 08 06:58:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 08 06:58:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 08 06:59:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.120000
Oct 08 06:59:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was negligible)
Oct 08 06:59:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.480000
Oct 08 06:59:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 08 07:00:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.710000
Oct 08 07:00:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 08 07:01:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.420000
Oct 08 07:01:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 08 07:02:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.780000
Oct 08 07:02:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 08 07:03:11 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 08 07:03:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 08 07:03:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 08 07:03:11 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 08 07:03:11 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 08 07:03:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 08 07:03:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 08 07:03:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 08 07:03:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 08 07:03:11 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 08 07:03:11 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 08 07:03:11 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 08 07:03:11 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 08 07:03:11 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 08 07:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 08 07:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 08 07:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 08 07:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 08 07:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 08 07:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 08 07:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 08 07:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 08 07:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 08 07:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 08 07:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 08 07:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 08 07:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 08 07:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 08 07:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 08 07:03:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 08 07:03:11 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2859, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 08 07:03:11 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 08 07:03:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 08 07:03:11 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2859 (ref=pe_calc-dc-1728342191-38445) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 08 07:03:11 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2859 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 08 07:03:11 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 08 07:03:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 08 07:03:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 08 07:06:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.150000
Oct 08 07:06:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was negligible)
Oct 08 07:06:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 08 07:07:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.580000
Oct 08 07:07:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 08 07:07:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 14.920000
Oct 08 07:07:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 08 07:08:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.480000
Oct 08 07:08:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.760000
Oct 08 07:09:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.290000
Oct 08 07:09:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.210000
Oct 08 07:09:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 07:10:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was medium)
Oct 08 07:11:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.630000
Oct 08 07:11:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was negligible)
Oct 08 07:11:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 08 07:13:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 08 07:14:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.570000
Oct 08 07:14:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was negligible)
Oct 08 07:14:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.850000
Oct 08 07:15:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.490000
Oct 08 07:15:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.240000
Oct 08 07:16:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.680000
Oct 08 07:16:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.670000
Oct 08 07:17:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.160000
Oct 08 07:17:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.190000
Oct 08 07:18:11 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 08 07:18:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 08 07:18:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 08 07:18:11 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 08 07:18:11 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 08 07:18:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 08 07:18:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 08 07:18:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 08 07:18:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 08 07:18:11 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 08 07:18:11 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 08 07:18:11 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 08 07:18:11 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 08 07:18:11 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 08 07:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 08 07:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 08 07:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 08 07:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 08 07:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 08 07:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 08 07:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 08 07:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 08 07:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 08 07:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 08 07:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 08 07:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 08 07:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 08 07:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 08 07:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 08 07:18:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 08 07:18:11 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2860, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 08 07:18:11 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 08 07:18:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 08 07:18:11 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2860 (ref=pe_calc-dc-1728343091-38457) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 08 07:18:11 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2860 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 08 07:18:11 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 08 07:18:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 08 07:18:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.580000
Oct 08 07:18:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.910000
Oct 08 07:18:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 07:19:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 08 07:19:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.050000
Oct 08 07:19:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 08 07:20:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 08 07:20:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.560000
Oct 08 07:20:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 08 07:21:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 08 07:21:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.310000
Oct 08 07:21:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 08 07:22:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.210000
Oct 08 07:22:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 07:22:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.230000
Oct 08 07:23:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.180000
Oct 08 07:23:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 08 07:24:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.380000
Oct 08 07:24:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 08 07:24:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was medium)
Oct 08 07:25:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.290000
Oct 08 07:25:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was negligible)
Oct 08 07:25:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was medium)
Oct 08 07:26:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.310000
Oct 08 07:26:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was negligible)
Oct 08 07:26:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 08 07:27:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.410000
Oct 08 07:27:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 08 07:28:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.040000
Oct 08 07:28:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 08 07:28:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.950000
Oct 08 07:28:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 07:29:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 12.140000
Oct 08 07:29:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 08 07:29:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.340000
Oct 08 07:30:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.370000
Oct 08 07:30:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.250000
Oct 08 07:31:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.780000
Oct 08 07:31:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 08 07:32:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 08 07:32:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.000000
Oct 08 07:32:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was negligible)
Oct 08 07:33:11 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 08 07:33:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 08 07:33:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 08 07:33:11 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 08 07:33:11 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 08 07:33:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 08 07:33:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 08 07:33:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 08 07:33:11 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 08 07:33:11 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 08 07:33:11 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 08 07:33:11 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 08 07:33:11 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 08 07:33:11 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 08 07:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 08 07:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 08 07:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 08 07:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 08 07:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 08 07:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 08 07:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 08 07:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 08 07:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 08 07:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 08 07:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 08 07:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 08 07:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 08 07:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 08 07:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 08 07:33:11 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 08 07:33:11 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2861, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 08 07:33:11 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 08 07:33:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 08 07:33:11 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2861 (ref=pe_calc-dc-1728343991-38480) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 08 07:33:11 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2861 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 08 07:33:11 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 08 07:33:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 08 07:33:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.620000
Oct 08 07:33:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.370000
Oct 08 07:33:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 07:34:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was medium)
Oct 08 07:34:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was negligible)
Oct 08 07:35:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 08 07:36:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.150000
Oct 08 07:36:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was negligible)
Oct 08 07:36:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.730000
Oct 08 07:37:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.740000
Oct 08 07:37:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 08 07:38:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.840000
Oct 08 07:38:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 08 07:38:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.790000
Oct 08 07:39:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.430000
Oct 08 07:39:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.610000
Oct 08 07:39:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 08 07:40:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.230000
Oct 08 07:40:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 08 07:41:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 08 07:42:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.680000
Oct 08 07:42:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was negligible)
Oct 08 07:42:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.550000
Oct 08 07:43:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.300000
Oct 08 07:43:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.260000
Oct 08 07:43:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 07:44:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was medium)
Oct 08 07:44:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.130000
Oct 08 07:44:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was negligible)
Oct 08 07:45:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.960000
Oct 08 07:45:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.290000
Oct 08 07:46:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.200000
Oct 08 07:46:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.560000
Oct 08 07:47:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 13.100000
Oct 08 07:47:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 12.450000
Oct 08 07:48:11 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 08 07:48:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 08 07:48:11 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 08 07:48:12 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 08 07:48:12 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 08 07:48:12 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 08 07:48:12 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 08 07:48:12 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 08 07:48:12 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 08 07:48:12 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 08 07:48:12 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 08 07:48:12 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 08 07:48:12 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 08 07:48:12 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 08 07:48:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 08 07:48:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 08 07:48:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 08 07:48:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 08 07:48:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 08 07:48:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 08 07:48:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 08 07:48:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 08 07:48:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 08 07:48:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 08 07:48:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 08 07:48:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 08 07:48:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 08 07:48:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 08 07:48:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 08 07:48:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 08 07:48:12 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2862, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 08 07:48:12 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 08 07:48:12 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 08 07:48:12 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2862 (ref=pe_calc-dc-1728344891-38495) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 08 07:48:12 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2862 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 08 07:48:12 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 08 07:48:12 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 08 07:48:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.030000
Oct 08 07:48:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.800000
Oct 08 07:49:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.770000
Oct 08 07:49:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 07:49:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 08 07:50:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.880000
Oct 08 07:50:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 08 07:50:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.570000
Oct 08 07:50:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 07:51:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 08 07:51:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 08 07:53:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.980000
Oct 08 07:53:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was negligible)
Oct 08 07:53:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.420000
Oct 08 07:54:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.400000
Oct 08 07:54:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 08 07:54:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.410000
Oct 08 07:55:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.580000
Oct 08 07:55:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 08 07:56:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 08 07:56:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.640000
Oct 08 07:56:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was negligible)
Oct 08 07:57:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was medium)
Oct 08 07:57:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.120000
Oct 08 07:57:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was negligible)
Oct 08 07:58:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.550000
Oct 08 07:58:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 07:58:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 08 07:59:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.620000
Oct 08 07:59:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 08 07:59:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 08 08:00:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 08 08:00:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.160000
Oct 08 08:00:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was negligible)
Oct 08 08:01:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.390000
Oct 08 08:01:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 08 08:01:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.540000
Oct 08 08:02:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.130000
Oct 08 08:02:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 08 08:03:12 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 08 08:03:12 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 08 08:03:12 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 08 08:03:12 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 08 08:03:12 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 08 08:03:12 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 08 08:03:12 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 08 08:03:12 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 08 08:03:12 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 08 08:03:12 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 08 08:03:12 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 08 08:03:12 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 08 08:03:12 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 08 08:03:12 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 08 08:03:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 08 08:03:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 08 08:03:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 08 08:03:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 08 08:03:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 08 08:03:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 08 08:03:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 08 08:03:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 08 08:03:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 08 08:03:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 08 08:03:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 08 08:03:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 08 08:03:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 08 08:03:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 08 08:03:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 08 08:03:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 08 08:03:12 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2863, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 08 08:03:12 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 08 08:03:12 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 08 08:03:12 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2863 (ref=pe_calc-dc-1728345792-38517) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 08 08:03:12 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2863 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 08 08:03:12 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 08 08:03:12 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 08 08:03:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.780000
Oct 08 08:03:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 08 08:04:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 12.370000
Oct 08 08:04:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.240000
Oct 08 08:05:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.250000
Oct 08 08:05:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 08:05:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 08 08:06:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.440000
Oct 08 08:06:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 08 08:06:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.130000
Oct 08 08:07:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.170000
Oct 08 08:07:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 08:07:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.220000
Oct 08 08:08:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 08 08:08:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 08 08:09:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.460000
Oct 08 08:09:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was negligible)
Oct 08 08:10:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.550000
Oct 08 08:10:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 08 08:10:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.430000
Oct 08 08:11:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 08 08:11:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 08 08:13:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.550000
Oct 08 08:13:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was negligible)
Oct 08 08:13:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.740000
Oct 08 08:13:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 08:14:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.520000
Oct 08 08:14:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 08 08:14:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 08 08:15:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 08 08:16:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.030000
Oct 08 08:16:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was negligible)
Oct 08 08:16:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.640000
Oct 08 08:16:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 08 08:17:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.750000
Oct 08 08:17:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.090000
Oct 08 08:18:12 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 08 08:18:12 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 08 08:18:12 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 08 08:18:12 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 08 08:18:12 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 08 08:18:12 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 08 08:18:12 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 08 08:18:12 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 08 08:18:12 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 08 08:18:12 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 08 08:18:12 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 08 08:18:12 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 08 08:18:12 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 08 08:18:12 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 08 08:18:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 08 08:18:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 08 08:18:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 08 08:18:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 08 08:18:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 08 08:18:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 08 08:18:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 08 08:18:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 08 08:18:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 08 08:18:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 08 08:18:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 08 08:18:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 08 08:18:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 08 08:18:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 08 08:18:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 08 08:18:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 08 08:18:12 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2864, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 08 08:18:12 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 08 08:18:12 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 08 08:18:12 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2864 (ref=pe_calc-dc-1728346692-38536) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 08 08:18:12 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2864 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 08 08:18:12 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 08 08:18:12 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 08 08:18:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.930000
Oct 08 08:18:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.840000
Oct 08 08:19:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.860000
Oct 08 08:19:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.790000
Oct 08 08:19:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 08:20:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 08 08:20:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.730000
Oct 08 08:20:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 08 08:21:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 08 08:22:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 08 08:24:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.210000
Oct 08 08:24:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was negligible)
Oct 08 08:24:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.110000
Oct 08 08:25:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.450000
Oct 08 08:25:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 08 08:26:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.440000
Oct 08 08:26:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 08 08:26:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.170000
Oct 08 08:26:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 08:27:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was medium)
Oct 08 08:27:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was negligible)
Oct 08 08:28:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.350000
Oct 08 08:28:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 08 08:28:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 08 08:29:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.920000
Oct 08 08:29:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 08 08:29:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.890000
Oct 08 08:29:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 08 08:30:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.300000
Oct 08 08:30:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.340000
Oct 08 08:30:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 08:31:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 08 08:31:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 08 08:32:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.240000
Oct 08 08:32:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was negligible)
Oct 08 08:33:12 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 08 08:33:12 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 08 08:33:12 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 08 08:33:12 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 08 08:33:12 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 08 08:33:12 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 08 08:33:12 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 08 08:33:12 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 08 08:33:12 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 08 08:33:12 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 08 08:33:12 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 08 08:33:12 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 08 08:33:12 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 08 08:33:12 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 08 08:33:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 08 08:33:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 08 08:33:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 08 08:33:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 08 08:33:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 08 08:33:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 08 08:33:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 08 08:33:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 08 08:33:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 08 08:33:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 08 08:33:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 08 08:33:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 08 08:33:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 08 08:33:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 08 08:33:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 08 08:33:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 08 08:33:12 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2865, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 08 08:33:12 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 08 08:33:12 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 08 08:33:12 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2865 (ref=pe_calc-dc-1728347592-38556) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 08 08:33:12 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2865 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 08 08:33:12 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 08 08:33:12 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 08 08:33:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.280000
Oct 08 08:33:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.120000
Oct 08 08:34:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.640000
Oct 08 08:34:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 08 08:35:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.350000
Oct 08 08:35:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 08 08:35:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.850000
Oct 08 08:35:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 08 08:36:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.400000
Oct 08 08:36:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 08:36:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.260000
Oct 08 08:37:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.010000
Oct 08 08:37:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 08 08:37:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 08 08:38:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.580000
Oct 08 08:38:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 08 08:38:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 08 08:39:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.990000
Oct 08 08:39:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 08 08:40:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.020000
Oct 08 08:40:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 08:40:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.530000
Oct 08 08:41:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.360000
Oct 08 08:41:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.670000
Oct 08 08:41:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 08 08:42:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 08 08:42:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.370000
Oct 08 08:42:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 08 08:43:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 08 08:43:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 08 08:44:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was negligible)
Oct 08 08:44:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.750000
Oct 08 08:44:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 08 08:45:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.410000
Oct 08 08:45:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 08 08:46:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.040000
Oct 08 08:46:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 08 08:46:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.920000
Oct 08 08:47:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.190000
Oct 08 08:47:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 08:47:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.220000
Oct 08 08:47:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 08 08:48:12 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 08 08:48:12 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 08 08:48:12 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 08 08:48:12 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 08 08:48:12 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 08 08:48:12 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 08 08:48:12 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 08 08:48:12 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 08 08:48:12 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 08 08:48:12 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 08 08:48:12 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 08 08:48:12 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 08 08:48:12 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 08 08:48:12 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 08 08:48:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 08 08:48:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 08 08:48:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 08 08:48:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 08 08:48:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 08 08:48:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 08 08:48:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 08 08:48:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 08 08:48:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 08 08:48:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 08 08:48:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 08 08:48:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 08 08:48:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 08 08:48:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 08 08:48:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 08 08:48:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 08 08:48:12 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2866, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 08 08:48:12 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 08 08:48:12 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 08 08:48:12 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2866 (ref=pe_calc-dc-1728348492-38578) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 08 08:48:12 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2866 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 08 08:48:12 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 08 08:48:12 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 08 08:48:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.080000
Oct 08 08:48:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.970000
Oct 08 08:49:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 08 08:49:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.410000
Oct 08 08:49:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 08 08:50:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 08 08:50:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.020000
Oct 08 08:50:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 08 08:51:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.850000
Oct 08 08:51:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.570000
Oct 08 08:51:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 08:52:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 08 08:52:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 08 08:53:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was negligible)
Oct 08 08:53:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.050000
Oct 08 08:53:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 08 08:54:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 08 08:54:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.320000
Oct 08 08:54:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 08 08:55:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.800000
Oct 08 08:55:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 08 08:55:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.740000
Oct 08 08:56:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.110000
Oct 08 08:56:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.840000
Oct 08 08:57:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.870000
Oct 08 08:57:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 08:57:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.610000
Oct 08 08:57:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 08 08:58:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.540000
Oct 08 08:58:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.610000
Oct 08 08:59:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.200000
Oct 08 08:59:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 08:59:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 08 09:00:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.710000
Oct 08 09:00:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 08 09:00:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.910000
Oct 08 09:01:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.720000
Oct 08 09:01:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.310000
Oct 08 09:02:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.880000
Oct 08 09:02:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.890000
Oct 08 09:02:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 09:03:12 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 08 09:03:12 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 08 09:03:12 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 08 09:03:12 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 08 09:03:12 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 08 09:03:12 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 08 09:03:12 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 08 09:03:12 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 08 09:03:12 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 08 09:03:12 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 08 09:03:12 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 08 09:03:12 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 08 09:03:12 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 08 09:03:12 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 08 09:03:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 08 09:03:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 08 09:03:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 08 09:03:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 08 09:03:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 08 09:03:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 08 09:03:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 08 09:03:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 08 09:03:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 08 09:03:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 08 09:03:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 08 09:03:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 08 09:03:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 08 09:03:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 08 09:03:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 08 09:03:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 08 09:03:12 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2867, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 08 09:03:12 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 08 09:03:12 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 08 09:03:12 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2867 (ref=pe_calc-dc-1728349392-38597) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 08 09:03:12 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2867 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 08 09:03:12 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 08 09:03:12 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 08 09:03:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 08 09:03:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 08 09:04:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.870000
Oct 08 09:04:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was negligible)
Oct 08 09:04:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.260000
Oct 08 09:05:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.000000
Oct 08 09:05:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.520000
Oct 08 09:06:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.540000
Oct 08 09:06:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 09:06:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 08 09:08:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.630000
Oct 08 09:08:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 08 09:08:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 12.590000
Oct 08 09:09:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.500000
Oct 08 09:09:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.950000
Oct 08 09:10:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.410000
Oct 08 09:10:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.070000
Oct 08 09:11:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.080000
Oct 08 09:11:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.820000
Oct 08 09:12:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.670000
Oct 08 09:12:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.800000
Oct 08 09:13:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.930000
Oct 08 09:13:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 08 09:14:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 08 09:14:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.170000
Oct 08 09:14:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was negligible)
Oct 08 09:15:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 08 09:16:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.710000
Oct 08 09:16:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 08 09:16:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 14.770000
Oct 08 09:16:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 08 09:17:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 14.770000
Oct 08 09:17:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.890000
Oct 08 09:18:12 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 08 09:18:12 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 08 09:18:12 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 08 09:18:12 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 08 09:18:12 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 08 09:18:12 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 08 09:18:12 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 08 09:18:12 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 08 09:18:12 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 08 09:18:12 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 08 09:18:12 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 08 09:18:12 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 08 09:18:12 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 08 09:18:12 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 08 09:18:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 08 09:18:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 08 09:18:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 08 09:18:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 08 09:18:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 08 09:18:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 08 09:18:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 08 09:18:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 08 09:18:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 08 09:18:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 08 09:18:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 08 09:18:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 08 09:18:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 08 09:18:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 08 09:18:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 08 09:18:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 08 09:18:12 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2868, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 08 09:18:12 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 08 09:18:12 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 08 09:18:12 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2868 (ref=pe_calc-dc-1728350292-38610) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 08 09:18:12 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2868 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 08 09:18:12 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 08 09:18:12 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 08 09:18:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.190000
Oct 08 09:18:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.790000
Oct 08 09:19:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.080000
Oct 08 09:19:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.250000
Oct 08 09:20:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.470000
Oct 08 09:20:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.320000
Oct 08 09:21:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.780000
Oct 08 09:21:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 09:21:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 08 09:22:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 13.080000
Oct 08 09:22:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 08 09:22:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 12.070000
Oct 08 09:23:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.250000
Oct 08 09:23:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.380000
Oct 08 09:24:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.320000
Oct 08 09:24:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 08 09:25:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.200000
Oct 08 09:25:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 08 09:25:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was medium)
Oct 08 09:26:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was negligible)
Oct 08 09:26:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.530000
Oct 08 09:26:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 08 09:27:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 08 09:29:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.730000
Oct 08 09:29:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 08 09:29:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.830000
Oct 08 09:29:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 08 09:30:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.470000
Oct 08 09:30:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.780000
Oct 08 09:31:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.320000
Oct 08 09:31:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.750000
Oct 08 09:32:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 08 09:33:12 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 08 09:33:12 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 08 09:33:12 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 08 09:33:12 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 08 09:33:12 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 08 09:33:12 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 08 09:33:12 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 08 09:33:12 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 08 09:33:12 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 08 09:33:12 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 08 09:33:12 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 08 09:33:12 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 08 09:33:12 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 08 09:33:12 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 08 09:33:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 08 09:33:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 08 09:33:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 08 09:33:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 08 09:33:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 08 09:33:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 08 09:33:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 08 09:33:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 08 09:33:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 08 09:33:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 08 09:33:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 08 09:33:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 08 09:33:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 08 09:33:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 08 09:33:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 08 09:33:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 08 09:33:12 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2869, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 08 09:33:12 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 08 09:33:12 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 08 09:33:12 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2869 (ref=pe_calc-dc-1728351192-38623) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 08 09:33:12 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2869 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 08 09:33:12 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 08 09:33:12 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 08 09:33:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.980000
Oct 08 09:33:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 08 09:34:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.830000
Oct 08 09:34:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 08 09:35:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.060000
Oct 08 09:35:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 08 09:35:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.480000
Oct 08 09:35:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 09:36:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 08 09:36:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.970000
Oct 08 09:36:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 08 09:37:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.580000
Oct 08 09:37:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.230000
Oct 08 09:38:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.640000
Oct 08 09:38:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 12.420000
Oct 08 09:39:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.810000
Oct 08 09:39:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.700000
Oct 08 09:40:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.370000
Oct 08 09:40:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.950000
Oct 08 09:41:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.350000
Oct 08 09:41:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 09:41:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.420000
Oct 08 09:41:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 08 09:42:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.040000
Oct 08 09:42:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.690000
Oct 08 09:43:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.350000
Oct 08 09:43:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 09:43:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.160000
Oct 08 09:43:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 08 09:44:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.870000
Oct 08 09:44:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.200000
Oct 08 09:45:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.860000
Oct 08 09:45:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.920000
Oct 08 09:46:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.530000
Oct 08 09:46:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.170000
Oct 08 09:47:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.000000
Oct 08 09:47:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.840000
Oct 08 09:47:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 09:48:12 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 08 09:48:12 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 08 09:48:12 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 08 09:48:12 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 08 09:48:12 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 08 09:48:12 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 08 09:48:12 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 08 09:48:12 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 08 09:48:12 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 08 09:48:12 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 08 09:48:12 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 08 09:48:12 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 08 09:48:12 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 08 09:48:12 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 08 09:48:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 08 09:48:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 08 09:48:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 08 09:48:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 08 09:48:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 08 09:48:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 08 09:48:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 08 09:48:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 08 09:48:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 08 09:48:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 08 09:48:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 08 09:48:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 08 09:48:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 08 09:48:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 08 09:48:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 08 09:48:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 08 09:48:12 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2870, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 08 09:48:12 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 08 09:48:12 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 08 09:48:12 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2870 (ref=pe_calc-dc-1728352092-38635) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 08 09:48:12 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2870 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 08 09:48:12 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 08 09:48:12 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 08 09:48:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.800000
Oct 08 09:48:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 08 09:48:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.770000
Oct 08 09:49:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.850000
Oct 08 09:49:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 08 09:50:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.010000
Oct 08 09:50:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 08 09:51:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 08 09:51:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.800000
Oct 08 09:51:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 08 09:52:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 13.030000
Oct 08 09:52:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.380000
Oct 08 09:53:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.920000
Oct 08 09:53:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.760000
Oct 08 09:54:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.110000
Oct 08 09:54:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.250000
Oct 08 09:55:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.840000
Oct 08 09:55:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 09:55:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.430000
Oct 08 09:55:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 08 09:56:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.750000
Oct 08 09:56:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.430000
Oct 08 09:57:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.920000
Oct 08 09:57:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.840000
Oct 08 09:58:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.030000
Oct 08 09:58:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.880000
Oct 08 09:59:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.790000
Oct 08 09:59:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 09:59:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.740000
Oct 08 09:59:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 08 10:00:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.650000
Oct 08 10:00:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.910000
Oct 08 10:01:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.870000
Oct 08 10:01:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.280000
Oct 08 10:02:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.700000
Oct 08 10:02:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.030000
Oct 08 10:03:12 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 08 10:03:12 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 08 10:03:12 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 08 10:03:12 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 08 10:03:12 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 08 10:03:12 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 08 10:03:12 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 08 10:03:12 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 08 10:03:12 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 08 10:03:12 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 08 10:03:12 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 08 10:03:12 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 08 10:03:12 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 08 10:03:12 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 08 10:03:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 08 10:03:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 08 10:03:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 08 10:03:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 08 10:03:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 08 10:03:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 08 10:03:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 08 10:03:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 08 10:03:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 08 10:03:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 08 10:03:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 08 10:03:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 08 10:03:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 08 10:03:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 08 10:03:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 08 10:03:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 08 10:03:12 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2871, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 08 10:03:12 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 08 10:03:12 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 08 10:03:12 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2871 (ref=pe_calc-dc-1728352992-38645) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 08 10:03:12 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2871 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 08 10:03:12 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 08 10:03:12 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 08 10:03:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.370000
Oct 08 10:03:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.270000
Oct 08 10:03:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 10:04:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was medium)
Oct 08 10:07:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was negligible)
Oct 08 10:08:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 08 10:09:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.350000
Oct 08 10:09:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was negligible)
Oct 08 10:09:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.600000
Oct 08 10:09:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 10:10:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 08 10:10:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.320000
Oct 08 10:10:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 08 10:11:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.420000
Oct 08 10:11:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.160000
Oct 08 10:12:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.400000
Oct 08 10:12:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 08 10:13:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 08 10:14:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.180000
Oct 08 10:14:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was negligible)
Oct 08 10:14:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.970000
Oct 08 10:15:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.480000
Oct 08 10:15:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 10:15:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 08 10:16:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 08 10:17:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.100000
Oct 08 10:17:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was negligible)
Oct 08 10:18:12 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 08 10:18:12 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 08 10:18:12 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 08 10:18:12 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 08 10:18:12 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 08 10:18:12 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 08 10:18:12 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 08 10:18:12 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 08 10:18:12 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 08 10:18:12 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 08 10:18:12 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 08 10:18:12 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 08 10:18:12 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 08 10:18:12 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 08 10:18:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 08 10:18:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 08 10:18:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 08 10:18:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 08 10:18:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 08 10:18:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 08 10:18:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 08 10:18:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 08 10:18:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 08 10:18:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 08 10:18:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 08 10:18:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 08 10:18:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 08 10:18:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 08 10:18:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 08 10:18:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 08 10:18:12 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2872, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 08 10:18:12 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 08 10:18:12 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 08 10:18:12 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2872 (ref=pe_calc-dc-1728353892-38661) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 08 10:18:12 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2872 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 08 10:18:12 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 08 10:18:12 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 08 10:18:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 08 10:18:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 13.190000
Oct 08 10:18:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 08 10:19:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.210000
Oct 08 10:19:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.000000
Oct 08 10:20:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.120000
Oct 08 10:20:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 10:20:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.190000
Oct 08 10:21:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.050000
Oct 08 10:21:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.350000
Oct 08 10:21:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 08 10:22:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.470000
Oct 08 10:22:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 10:22:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was medium)
Oct 08 10:23:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was negligible)
Oct 08 10:24:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.460000
Oct 08 10:24:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 08 10:24:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.590000
Oct 08 10:25:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.140000
Oct 08 10:25:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 10:25:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 12.070000
Oct 08 10:25:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 08 10:26:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 12.300000
Oct 08 10:26:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.910000
Oct 08 10:27:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.490000
Oct 08 10:27:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 08 10:28:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 08 10:28:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.420000
Oct 08 10:28:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was negligible)
Oct 08 10:29:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 08 10:29:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.380000
Oct 08 10:29:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 08 10:30:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was medium)
Oct 08 10:31:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.290000
Oct 08 10:31:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was negligible)
Oct 08 10:32:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.490000
Oct 08 10:32:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.330000
Oct 08 10:33:12 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 08 10:33:12 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 08 10:33:12 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 08 10:33:12 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 08 10:33:12 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 08 10:33:12 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 08 10:33:12 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 08 10:33:12 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 08 10:33:12 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 08 10:33:12 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 08 10:33:12 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 08 10:33:12 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 08 10:33:12 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 08 10:33:12 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 08 10:33:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 08 10:33:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 08 10:33:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 08 10:33:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 08 10:33:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 08 10:33:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 08 10:33:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 08 10:33:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 08 10:33:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 08 10:33:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 08 10:33:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 08 10:33:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 08 10:33:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 08 10:33:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 08 10:33:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 08 10:33:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 08 10:33:12 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2873, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 08 10:33:12 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 08 10:33:12 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 08 10:33:12 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2873 (ref=pe_calc-dc-1728354792-38679) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 08 10:33:12 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2873 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 08 10:33:12 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 08 10:33:12 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 08 10:33:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.330000
Oct 08 10:33:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.660000
Oct 08 10:33:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 08 10:34:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.960000
Oct 08 10:34:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.630000
Oct 08 10:35:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 08 10:36:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.430000
Oct 08 10:36:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 08 10:36:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.200000
Oct 08 10:36:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 10:37:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 08 10:37:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.050000
Oct 08 10:37:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 08 10:38:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.020000
Oct 08 10:38:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.770000
Oct 08 10:39:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.810000
Oct 08 10:39:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 10:39:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.750000
Oct 08 10:39:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 08 10:40:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.830000
Oct 08 10:40:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.100000
Oct 08 10:41:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.890000
Oct 08 10:41:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.290000
Oct 08 10:42:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.880000
Oct 08 10:42:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 12.580000
Oct 08 10:43:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.540000
Oct 08 10:43:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.700000
Oct 08 10:44:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.500000
Oct 08 10:44:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 10:44:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.850000
Oct 08 10:45:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 13.350000
Oct 08 10:45:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 08 10:45:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.360000
Oct 08 10:46:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 12.140000
Oct 08 10:46:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 12.580000
Oct 08 10:47:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.180000
Oct 08 10:47:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.160000
Oct 08 10:48:12 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 08 10:48:12 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 08 10:48:12 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 08 10:48:12 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 08 10:48:12 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 08 10:48:12 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 08 10:48:12 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 08 10:48:12 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 08 10:48:12 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 08 10:48:12 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 08 10:48:12 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 08 10:48:12 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 08 10:48:12 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 08 10:48:12 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 08 10:48:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 08 10:48:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 08 10:48:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 08 10:48:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 08 10:48:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 08 10:48:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 08 10:48:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 08 10:48:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 08 10:48:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 08 10:48:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 08 10:48:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 08 10:48:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 08 10:48:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 08 10:48:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 08 10:48:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 08 10:48:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 08 10:48:12 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2874, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 08 10:48:12 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 08 10:48:12 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 08 10:48:12 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2874 (ref=pe_calc-dc-1728355692-38690) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 08 10:48:12 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2874 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 08 10:48:12 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 08 10:48:12 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 08 10:48:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.180000
Oct 08 10:48:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.430000
Oct 08 10:49:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.070000
Oct 08 10:49:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.130000
Oct 08 10:50:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.380000
Oct 08 10:50:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.530000
Oct 08 10:51:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.450000
Oct 08 10:51:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.360000
Oct 08 10:52:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.950000
Oct 08 10:52:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.330000
Oct 08 10:52:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 10:53:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 08 10:54:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.940000
Oct 08 10:54:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 08 10:54:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.580000
Oct 08 10:54:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 08 10:55:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 08 10:56:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.820000
Oct 08 10:56:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 08 10:56:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.960000
Oct 08 10:56:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 08 10:57:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.750000
Oct 08 10:57:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 10:57:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 08 10:58:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 08 10:59:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.290000
Oct 08 10:59:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was negligible)
Oct 08 10:59:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.410000
Oct 08 10:59:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 08 11:00:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.840000
Oct 08 11:00:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 12.500000
Oct 08 11:01:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.650000
Oct 08 11:01:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.260000
Oct 08 11:02:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.410000
Oct 08 11:02:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 13.860000
Oct 08 11:03:12 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 08 11:03:12 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 08 11:03:12 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 08 11:03:12 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 08 11:03:12 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 08 11:03:12 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 08 11:03:12 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 08 11:03:12 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 08 11:03:12 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 08 11:03:12 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 08 11:03:12 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 08 11:03:12 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 08 11:03:12 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 08 11:03:12 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 08 11:03:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 08 11:03:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 08 11:03:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 08 11:03:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 08 11:03:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 08 11:03:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 08 11:03:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 08 11:03:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 08 11:03:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 08 11:03:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 08 11:03:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 08 11:03:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 08 11:03:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 08 11:03:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 08 11:03:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 08 11:03:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 08 11:03:12 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2875, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 08 11:03:12 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 08 11:03:12 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 08 11:03:12 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2875 (ref=pe_calc-dc-1728356592-38703) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 08 11:03:12 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2875 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 08 11:03:12 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 08 11:03:12 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 08 11:03:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.150000
Oct 08 11:03:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 13.530000
Oct 08 11:04:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.970000
Oct 08 11:04:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.450000
Oct 08 11:05:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 08 11:05:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.330000
Oct 08 11:05:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 08 11:06:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.850000
Oct 08 11:06:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 14.230000
Oct 08 11:06:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 08 11:07:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.860000
Oct 08 11:07:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 12.200000
Oct 08 11:08:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.580000
Oct 08 11:08:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.190000
Oct 08 11:09:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.400000
Oct 08 11:09:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.260000
Oct 08 11:10:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.880000
Oct 08 11:10:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.620000
Oct 08 11:11:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.070000
Oct 08 11:11:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.720000
Oct 08 11:12:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.940000
Oct 08 11:12:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.610000
Oct 08 11:12:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 11:13:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.850000
Oct 08 11:13:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 08 11:13:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.510000
Oct 08 11:14:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.300000
Oct 08 11:14:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 11:14:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.320000
Oct 08 11:15:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was medium)
Oct 08 11:15:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was negligible)
Oct 08 11:16:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.710000
Oct 08 11:16:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 08 11:16:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.910000
Oct 08 11:17:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.090000
Oct 08 11:17:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.330000
Oct 08 11:18:12 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 08 11:18:12 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 08 11:18:12 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 08 11:18:12 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 08 11:18:12 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 08 11:18:12 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 08 11:18:12 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 08 11:18:12 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 08 11:18:12 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 08 11:18:12 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 08 11:18:12 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 08 11:18:12 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 08 11:18:12 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 08 11:18:12 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 08 11:18:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 08 11:18:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 08 11:18:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 08 11:18:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 08 11:18:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 08 11:18:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 08 11:18:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 08 11:18:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 08 11:18:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 08 11:18:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 08 11:18:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 08 11:18:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 08 11:18:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 08 11:18:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 08 11:18:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 08 11:18:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 08 11:18:12 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2876, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 08 11:18:12 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 08 11:18:12 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 08 11:18:12 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2876 (ref=pe_calc-dc-1728357492-38713) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 08 11:18:12 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2876 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 08 11:18:12 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 08 11:18:12 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 08 11:18:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.390000
Oct 08 11:18:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 11:18:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was medium)
Oct 08 11:19:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.750000
Oct 08 11:19:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was negligible)
Oct 08 11:19:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.000000
Oct 08 11:20:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.810000
Oct 08 11:20:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 08 11:21:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.490000
Oct 08 11:21:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 08 11:21:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.830000
Oct 08 11:22:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.860000
Oct 08 11:22:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.350000
Oct 08 11:23:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.550000
Oct 08 11:23:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.520000
Oct 08 11:24:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.660000
Oct 08 11:24:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.980000
Oct 08 11:25:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.100000
Oct 08 11:25:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.720000
Oct 08 11:26:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.950000
Oct 08 11:26:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.050000
Oct 08 11:27:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.550000
Oct 08 11:27:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 08 11:28:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.670000
Oct 08 11:28:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 08 11:29:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.560000
Oct 08 11:29:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.620000
Oct 08 11:30:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.460000
Oct 08 11:30:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 11:30:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 08 11:31:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.570000
Oct 08 11:31:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 08 11:31:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.060000
Oct 08 11:31:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 08 11:32:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.090000
Oct 08 11:32:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.870000
Oct 08 11:33:12 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 08 11:33:12 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 08 11:33:12 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 08 11:33:12 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 08 11:33:12 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 08 11:33:12 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 08 11:33:12 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 08 11:33:12 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 08 11:33:12 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 08 11:33:12 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 08 11:33:12 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 08 11:33:12 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 08 11:33:12 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 08 11:33:12 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 08 11:33:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 08 11:33:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 08 11:33:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 08 11:33:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 08 11:33:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 08 11:33:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 08 11:33:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 08 11:33:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 08 11:33:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 08 11:33:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 08 11:33:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 08 11:33:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 08 11:33:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 08 11:33:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 08 11:33:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 08 11:33:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 08 11:33:12 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2877, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 08 11:33:12 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 08 11:33:12 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 08 11:33:12 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2877 (ref=pe_calc-dc-1728358392-38725) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 08 11:33:12 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2877 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 08 11:33:12 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 08 11:33:12 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 08 11:33:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.610000
Oct 08 11:33:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 11:33:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.340000
Oct 08 11:34:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.700000
Oct 08 11:34:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.170000
Oct 08 11:35:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.160000
Oct 08 11:35:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 08 11:35:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.530000
Oct 08 11:36:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.410000
Oct 08 11:36:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.770000
Oct 08 11:37:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.740000
Oct 08 11:37:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.040000
Oct 08 11:38:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.250000
Oct 08 11:38:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 13.190000
Oct 08 11:39:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.030000
Oct 08 11:39:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 15.400000
Oct 08 11:40:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.800000
Oct 08 11:40:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.510000
Oct 08 11:41:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.100000
Oct 08 11:41:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.050000
Oct 08 11:42:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.370000
Oct 08 11:42:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 11:42:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.720000
Oct 08 11:42:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 08 11:43:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.970000
Oct 08 11:43:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.670000
Oct 08 11:44:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.490000
Oct 08 11:44:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.220000
Oct 08 11:44:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 11:45:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.350000
Oct 08 11:45:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 08 11:45:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.450000
Oct 08 11:46:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.900000
Oct 08 11:46:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.960000
Oct 08 11:47:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.400000
Oct 08 11:47:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.080000
Oct 08 11:47:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 11:48:12 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 08 11:48:12 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 08 11:48:12 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 08 11:48:12 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 08 11:48:12 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 08 11:48:12 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 08 11:48:12 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 08 11:48:12 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 08 11:48:12 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 08 11:48:12 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 08 11:48:12 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 08 11:48:12 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 08 11:48:12 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 08 11:48:12 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 08 11:48:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 08 11:48:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 08 11:48:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 08 11:48:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 08 11:48:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 08 11:48:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 08 11:48:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 08 11:48:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 08 11:48:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 08 11:48:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 08 11:48:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 08 11:48:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 08 11:48:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 08 11:48:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 08 11:48:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 08 11:48:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 08 11:48:12 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2878, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 08 11:48:12 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 08 11:48:12 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 08 11:48:12 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2878 (ref=pe_calc-dc-1728359292-38733) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 08 11:48:12 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2878 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 08 11:48:12 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 08 11:48:12 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 08 11:48:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 08 11:48:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.420000
Oct 08 11:48:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 08 11:49:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.590000
Oct 08 11:49:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 11:49:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 08 11:50:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.030000
Oct 08 11:50:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 08 11:50:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.440000
Oct 08 11:51:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.040000
Oct 08 11:51:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.730000
Oct 08 11:52:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.220000
Oct 08 11:52:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.830000
Oct 08 11:53:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.480000
Oct 08 11:53:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.270000
Oct 08 11:53:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 11:54:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 08 11:55:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.890000
Oct 08 11:55:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 08 11:55:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 14.770000
Oct 08 11:55:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 08 11:56:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.840000
Oct 08 11:56:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.440000
Oct 08 11:57:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.400000
Oct 08 11:57:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 12.160000
Oct 08 11:58:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.670000
Oct 08 11:58:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 12.480000
Oct 08 11:59:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 13.120000
Oct 08 11:59:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.410000
Oct 08 12:00:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.410000
Oct 08 12:00:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.390000
Oct 08 12:01:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.450000
Oct 08 12:01:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.290000
Oct 08 12:02:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.590000
Oct 08 12:02:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 12:02:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 08 12:03:12 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 08 12:03:12 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 08 12:03:12 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 08 12:03:12 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 08 12:03:12 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 08 12:03:12 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 08 12:03:12 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 08 12:03:12 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 08 12:03:12 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 08 12:03:12 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 08 12:03:12 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 08 12:03:12 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 08 12:03:12 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 08 12:03:12 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 08 12:03:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 08 12:03:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 08 12:03:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 08 12:03:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 08 12:03:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 08 12:03:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 08 12:03:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 08 12:03:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 08 12:03:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 08 12:03:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 08 12:03:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 08 12:03:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 08 12:03:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 08 12:03:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 08 12:03:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 08 12:03:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 08 12:03:12 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2879, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 08 12:03:12 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 08 12:03:12 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 08 12:03:12 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2879 (ref=pe_calc-dc-1728360192-38745) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 08 12:03:12 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2879 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 08 12:03:12 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 08 12:03:12 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 08 12:03:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 08 12:03:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was negligible)
Oct 08 12:04:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 08 12:04:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 13.710000
Oct 08 12:04:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was negligible)
Oct 08 12:05:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 12.960000
Oct 08 12:05:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 17.040001
Oct 08 12:06:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.010000
Oct 08 12:06:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 12.510000
Oct 08 12:07:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.700000
Oct 08 12:07:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.200000
Oct 08 12:08:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.410000
Oct 08 12:08:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 15.000000
Oct 08 12:09:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.210000
Oct 08 12:09:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 12.600000
Oct 08 12:10:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 12.070000
Oct 08 12:10:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.050000
Oct 08 12:11:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.840000
Oct 08 12:11:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.040000
Oct 08 12:11:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 12:12:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 08 12:12:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.860000
Oct 08 12:12:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 08 12:13:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 08 12:14:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 08 12:14:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.950000
Oct 08 12:14:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was negligible)
Oct 08 12:15:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.230000
Oct 08 12:15:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 12:15:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 14.740000
Oct 08 12:15:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 08 12:16:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 14.200000
Oct 08 12:16:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 13.430000
Oct 08 12:17:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.010000
Oct 08 12:17:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.530000
Oct 08 12:18:12 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 08 12:18:12 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 08 12:18:12 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 08 12:18:12 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 08 12:18:12 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 08 12:18:12 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 08 12:18:12 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 08 12:18:12 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 08 12:18:12 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 08 12:18:12 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 08 12:18:12 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 08 12:18:12 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 08 12:18:12 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 08 12:18:12 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 08 12:18:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 08 12:18:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 08 12:18:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 08 12:18:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 08 12:18:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 08 12:18:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 08 12:18:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 08 12:18:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 08 12:18:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 08 12:18:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 08 12:18:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 08 12:18:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 08 12:18:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 08 12:18:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 08 12:18:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 08 12:18:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 08 12:18:12 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2880, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 08 12:18:12 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 08 12:18:12 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 08 12:18:12 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2880 (ref=pe_calc-dc-1728361092-38758) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 08 12:18:12 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2880 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 08 12:18:12 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 08 12:18:12 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 08 12:18:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.560000
Oct 08 12:18:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.720000
Oct 08 12:19:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.450000
Oct 08 12:19:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.550000
Oct 08 12:20:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 08 12:21:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.000000
Oct 08 12:21:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 08 12:21:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.140000
Oct 08 12:22:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.180000
Oct 08 12:22:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.240000
Oct 08 12:23:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 08 12:23:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.930000
Oct 08 12:23:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 08 12:24:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.270000
Oct 08 12:24:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 12:24:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.250000
Oct 08 12:25:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.690000
Oct 08 12:25:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 08 12:25:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.730000
Oct 08 12:25:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 12:26:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.460000
Oct 08 12:26:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 08 12:26:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.450000
Oct 08 12:27:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.880000
Oct 08 12:27:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.610000
Oct 08 12:27:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 12:28:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.970000
Oct 08 12:28:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 08 12:28:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.470000
Oct 08 12:29:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.820000
Oct 08 12:29:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 12:29:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 08 12:30:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 08 12:30:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was negligible)
Oct 08 12:31:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.160000
Oct 08 12:31:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 08 12:32:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was medium)
Oct 08 12:32:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was negligible)
Oct 08 12:33:12 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 08 12:33:12 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 08 12:33:12 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 08 12:33:12 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 08 12:33:12 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 08 12:33:12 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 08 12:33:12 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 08 12:33:12 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 08 12:33:12 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 08 12:33:12 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 08 12:33:12 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 08 12:33:12 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 08 12:33:12 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 08 12:33:12 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 08 12:33:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 08 12:33:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 08 12:33:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 08 12:33:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 08 12:33:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 08 12:33:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 08 12:33:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 08 12:33:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 08 12:33:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 08 12:33:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 08 12:33:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 08 12:33:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 08 12:33:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 08 12:33:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 08 12:33:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 08 12:33:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 08 12:33:12 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2881, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 08 12:33:12 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 08 12:33:12 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 08 12:33:12 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2881 (ref=pe_calc-dc-1728361992-38776) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 08 12:33:12 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2881 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 08 12:33:12 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 08 12:33:12 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 08 12:33:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 12.160000
Oct 08 12:33:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 08 12:34:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.330000
Oct 08 12:34:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.210000
Oct 08 12:34:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 12:35:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.380000
Oct 08 12:35:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 08 12:35:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.610000
Oct 08 12:35:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 12:36:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.230000
Oct 08 12:36:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.170000
Oct 08 12:37:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.020000
Oct 08 12:37:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 08 12:37:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.140000
Oct 08 12:38:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.730000
Oct 08 12:38:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.440000
Oct 08 12:39:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.750000
Oct 08 12:39:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.340000
Oct 08 12:40:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.470000
Oct 08 12:40:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.980000
Oct 08 12:41:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.520000
Oct 08 12:41:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.320000
Oct 08 12:42:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.290000
Oct 08 12:42:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.570000
Oct 08 12:43:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.150000
Oct 08 12:43:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.370000
Oct 08 12:44:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.440000
Oct 08 12:44:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.730000
Oct 08 12:45:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.030000
Oct 08 12:45:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.660000
Oct 08 12:46:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 08 12:46:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.250000
Oct 08 12:46:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 08 12:47:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.200000
Oct 08 12:47:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 12:47:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.580000
Oct 08 12:47:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 08 12:48:12 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 08 12:48:12 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 08 12:48:12 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 08 12:48:12 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 08 12:48:12 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 08 12:48:12 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 08 12:48:12 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 08 12:48:12 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 08 12:48:12 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 08 12:48:12 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 08 12:48:12 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 08 12:48:12 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 08 12:48:12 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 08 12:48:12 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 08 12:48:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 08 12:48:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 08 12:48:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 08 12:48:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 08 12:48:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 08 12:48:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 08 12:48:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 08 12:48:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 08 12:48:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 08 12:48:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 08 12:48:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 08 12:48:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 08 12:48:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 08 12:48:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 08 12:48:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 08 12:48:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 08 12:48:12 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2882, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 08 12:48:12 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 08 12:48:12 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 08 12:48:12 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2882 (ref=pe_calc-dc-1728362892-38786) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 08 12:48:12 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2882 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 08 12:48:12 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 08 12:48:12 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 08 12:48:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.390000
Oct 08 12:48:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.150000
Oct 08 12:48:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 12:49:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was medium)
Oct 08 12:49:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was negligible)
Oct 08 12:50:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.100000
Oct 08 12:50:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 08 12:51:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 08 12:51:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 08 12:52:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.540000
Oct 08 12:52:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was negligible)
Oct 08 12:52:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 08 12:53:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 08 12:53:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was negligible)
Oct 08 12:54:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.510000
Oct 08 12:54:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 08 12:54:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.480000
Oct 08 12:55:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.250000
Oct 08 12:55:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.590000
Oct 08 12:56:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.460000
Oct 08 12:56:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 12:56:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.270000
Oct 08 12:57:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.420000
Oct 08 12:57:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 08 12:58:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 08 12:59:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.480000
Oct 08 12:59:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was negligible)
Oct 08 13:00:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.100000
Oct 08 13:00:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.160000
Oct 08 13:00:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 08 13:01:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.390000
Oct 08 13:01:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.930000
Oct 08 13:02:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.830000
Oct 08 13:02:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 13:02:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 08 13:03:12 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 08 13:03:12 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 08 13:03:12 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 08 13:03:12 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 08 13:03:12 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 08 13:03:12 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 08 13:03:12 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 08 13:03:12 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 08 13:03:12 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 08 13:03:12 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 08 13:03:12 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 08 13:03:12 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 08 13:03:12 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 08 13:03:12 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 08 13:03:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 08 13:03:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 08 13:03:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 08 13:03:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 08 13:03:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 08 13:03:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 08 13:03:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 08 13:03:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 08 13:03:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 08 13:03:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 08 13:03:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 08 13:03:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 08 13:03:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 08 13:03:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 08 13:03:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 08 13:03:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 08 13:03:12 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2883, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 08 13:03:12 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 08 13:03:12 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 08 13:03:12 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2883 (ref=pe_calc-dc-1728363792-38805) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 08 13:03:12 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2883 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 08 13:03:12 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 08 13:03:12 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 08 13:04:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.360000
Oct 08 13:04:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 08 13:04:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 08 13:05:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 08 13:06:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was negligible)
Oct 08 13:07:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.430000
Oct 08 13:07:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 08 13:07:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.150000
Oct 08 13:08:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.090000
Oct 08 13:08:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 12.020000
Oct 08 13:09:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 17.920000
Oct 08 13:09:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 18.260000
Oct 08 13:10:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 13.260000
Oct 08 13:10:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.000000
Oct 08 13:11:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.630000
Oct 08 13:11:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.340000
Oct 08 13:12:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 13.130000
Oct 08 13:12:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.700000
Oct 08 13:13:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.790000
Oct 08 13:13:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 13.090000
Oct 08 13:14:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.180000
Oct 08 13:14:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.850000
Oct 08 13:15:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 14.700000
Oct 08 13:15:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.280000
Oct 08 13:16:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.870000
Oct 08 13:16:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 13:16:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.490000
Oct 08 13:17:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.790000
Oct 08 13:17:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.980000
Oct 08 13:17:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 08 13:18:12 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 08 13:18:12 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 08 13:18:12 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 08 13:18:12 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 08 13:18:12 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 08 13:18:12 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 08 13:18:12 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 08 13:18:12 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 08 13:18:12 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 08 13:18:12 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 08 13:18:12 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 08 13:18:12 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 08 13:18:12 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 08 13:18:12 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 08 13:18:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 08 13:18:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 08 13:18:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 08 13:18:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 08 13:18:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 08 13:18:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 08 13:18:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 08 13:18:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 08 13:18:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 08 13:18:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 08 13:18:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 08 13:18:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 08 13:18:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 08 13:18:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 08 13:18:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 08 13:18:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 08 13:18:12 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2884, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 08 13:18:12 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 08 13:18:12 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 08 13:18:12 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2884 (ref=pe_calc-dc-1728364692-38813) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 08 13:18:12 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2884 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 08 13:18:12 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 08 13:18:12 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 08 13:18:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.420000
Oct 08 13:18:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.150000
Oct 08 13:19:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.970000
Oct 08 13:19:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.690000
Oct 08 13:20:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.450000
Oct 08 13:20:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.950000
Oct 08 13:20:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 13:21:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.340000
Oct 08 13:21:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.060000
Oct 08 13:21:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 08 13:22:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.350000
Oct 08 13:22:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 13:22:44 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.610000
Oct 08 13:22:44 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 08 13:23:14 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.880000
Oct 08 13:23:14 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 13:23:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.730000
Oct 08 13:24:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.850000
Oct 08 13:24:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.470000
Oct 08 13:24:45 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 08 13:25:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.220000
Oct 08 13:25:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.700000
Oct 08 13:26:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.080000
Oct 08 13:26:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.130000
Oct 08 13:27:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.560000
Oct 08 13:27:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.270000
Oct 08 13:27:45 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 13:28:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.870000
Oct 08 13:28:15 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 08 13:28:45 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 08 13:29:45 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 08 13:30:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.370000
Oct 08 13:30:45 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was negligible)
Oct 08 13:31:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.450000
Oct 08 13:31:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.540000
Oct 08 13:32:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.550000
Oct 08 13:32:15 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 13:32:45 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 08 13:33:12 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 08 13:33:12 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 08 13:33:12 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 08 13:33:12 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 08 13:33:12 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 08 13:33:12 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 08 13:33:12 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 08 13:33:12 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 08 13:33:12 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 08 13:33:12 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 08 13:33:12 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 08 13:33:12 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 08 13:33:12 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 08 13:33:12 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 08 13:33:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 08 13:33:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 08 13:33:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 08 13:33:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 08 13:33:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 08 13:33:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 08 13:33:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 08 13:33:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 08 13:33:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 08 13:33:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 08 13:33:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 08 13:33:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 08 13:33:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 08 13:33:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 08 13:33:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 08 13:33:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 08 13:33:12 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2885, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 08 13:33:12 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 08 13:33:12 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 08 13:33:12 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2885 (ref=pe_calc-dc-1728365592-38827) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 08 13:33:12 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2885 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 08 13:33:12 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 08 13:33:12 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 08 13:33:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.940000
Oct 08 13:33:15 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 08 13:33:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.340000
Oct 08 13:34:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.000000
Oct 08 13:34:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.930000
Oct 08 13:34:45 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 13:35:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.260000
Oct 08 13:35:15 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 08 13:35:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 12.460000
Oct 08 13:36:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.820000
Oct 08 13:36:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.910000
Oct 08 13:37:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.770000
Oct 08 13:37:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.410000
Oct 08 13:38:15 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 08 13:38:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.850000
Oct 08 13:38:45 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 08 13:39:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.100000
Oct 08 13:39:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.830000
Oct 08 13:40:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.020000
Oct 08 13:40:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.280000
Oct 08 13:41:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.550000
Oct 08 13:41:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.290000
Oct 08 13:41:45 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 13:42:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.410000
Oct 08 13:42:15 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 08 13:42:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.910000
Oct 08 13:43:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.070000
Oct 08 13:43:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.250000
Oct 08 13:43:45 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 13:44:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.030000
Oct 08 13:44:15 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 08 13:44:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.270000
Oct 08 13:45:15 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 08 13:45:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.310000
Oct 08 13:45:45 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 08 13:46:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.500000
Oct 08 13:46:15 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 13:46:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.210000
Oct 08 13:47:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.810000
Oct 08 13:47:45 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 08 13:48:12 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 08 13:48:12 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 08 13:48:12 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 08 13:48:12 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 08 13:48:12 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 08 13:48:12 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 08 13:48:12 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 08 13:48:12 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 08 13:48:12 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 08 13:48:12 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 08 13:48:12 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 08 13:48:12 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 08 13:48:12 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 08 13:48:12 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 08 13:48:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 08 13:48:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 08 13:48:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 08 13:48:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 08 13:48:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 08 13:48:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 08 13:48:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 08 13:48:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 08 13:48:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 08 13:48:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 08 13:48:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 08 13:48:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 08 13:48:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 08 13:48:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 08 13:48:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 08 13:48:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 08 13:48:12 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2886, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 08 13:48:12 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 08 13:48:12 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 08 13:48:12 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2886 (ref=pe_calc-dc-1728366492-38841) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 08 13:48:12 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2886 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 08 13:48:12 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 08 13:48:12 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 08 13:48:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.920000
Oct 08 13:48:15 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 08 13:48:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.060000
Oct 08 13:49:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.490000
Oct 08 13:49:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.220000
Oct 08 13:50:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.670000
Oct 08 13:50:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.990000
Oct 08 13:50:45 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 13:51:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.010000
Oct 08 13:51:15 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 08 13:51:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.450000
Oct 08 13:52:15 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 08 13:53:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.870000
Oct 08 13:53:15 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 08 13:53:45 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 08 13:54:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.980000
Oct 08 13:54:15 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 08 13:54:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.830000
Oct 08 13:55:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.680000
Oct 08 13:55:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 13.150000
Oct 08 13:56:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.160000
Oct 08 13:56:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.500000
Oct 08 13:57:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.430000
Oct 08 13:57:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.940000
Oct 08 13:58:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.540000
Oct 08 13:58:15 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 13:58:45 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 08 13:59:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.590000
Oct 08 13:59:45 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 08 14:00:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.170000
Oct 08 14:00:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.300000
Oct 08 14:01:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 17.250000
Oct 08 14:01:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 12.500000
Oct 08 14:02:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 13.140000
Oct 08 14:02:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 12.410000
Oct 08 14:03:12 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 08 14:03:12 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 08 14:03:12 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 08 14:03:12 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 08 14:03:12 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 08 14:03:12 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 08 14:03:12 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 08 14:03:12 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 08 14:03:12 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 08 14:03:12 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 08 14:03:12 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 08 14:03:12 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 08 14:03:12 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 08 14:03:12 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 08 14:03:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 08 14:03:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 08 14:03:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 08 14:03:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 08 14:03:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 08 14:03:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 08 14:03:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 08 14:03:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 08 14:03:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 08 14:03:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 08 14:03:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 08 14:03:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 08 14:03:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 08 14:03:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 08 14:03:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 08 14:03:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 08 14:03:12 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2887, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 08 14:03:12 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 08 14:03:12 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 08 14:03:12 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2887 (ref=pe_calc-dc-1728367392-38852) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 08 14:03:12 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2887 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 08 14:03:12 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 08 14:03:12 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 08 14:03:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.850000
Oct 08 14:03:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.210000
Oct 08 14:03:45 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 14:04:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.530000
Oct 08 14:04:15 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 08 14:04:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.880000
Oct 08 14:05:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.190000
Oct 08 14:05:15 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 14:05:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.440000
Oct 08 14:06:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.580000
Oct 08 14:06:45 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 08 14:07:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.990000
Oct 08 14:07:15 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 08 14:07:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.540000
Oct 08 14:07:45 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 14:08:15 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 08 14:08:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.110000
Oct 08 14:08:45 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 08 14:09:15 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 08 14:09:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.380000
Oct 08 14:09:45 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 08 14:10:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.390000
Oct 08 14:10:15 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 08 14:10:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.830000
Oct 08 14:11:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 13.700000
Oct 08 14:11:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.790000
Oct 08 14:12:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.960000
Oct 08 14:12:15 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 14:12:45 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 08 14:14:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.230000
Oct 08 14:14:15 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 08 14:14:45 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 08 14:15:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 14.290000
Oct 08 14:15:15 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 08 14:15:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.340000
Oct 08 14:16:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.230000
Oct 08 14:16:15 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 14:16:45 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 08 14:17:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.310000
Oct 08 14:17:15 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 08 14:17:45 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 08 14:18:12 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 08 14:18:12 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 08 14:18:12 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 08 14:18:12 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 08 14:18:12 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 08 14:18:12 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 08 14:18:12 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 08 14:18:12 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 08 14:18:12 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 08 14:18:12 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 08 14:18:12 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 08 14:18:12 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 08 14:18:12 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 08 14:18:12 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 08 14:18:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 08 14:18:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 08 14:18:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 08 14:18:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 08 14:18:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 08 14:18:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 08 14:18:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 08 14:18:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 08 14:18:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 08 14:18:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 08 14:18:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 08 14:18:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 08 14:18:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 08 14:18:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 08 14:18:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 08 14:18:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 08 14:18:12 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2888, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 08 14:18:12 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 08 14:18:12 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 08 14:18:12 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2888 (ref=pe_calc-dc-1728368292-38873) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 08 14:18:12 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2888 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 08 14:18:12 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 08 14:18:12 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 08 14:18:15 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 08 14:20:15 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was negligible)
Oct 08 14:20:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.140000
Oct 08 14:20:45 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 08 14:21:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.870000
Oct 08 14:21:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 12.660000
Oct 08 14:22:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.530000
Oct 08 14:22:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 12.430000
Oct 08 14:23:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.620000
Oct 08 14:23:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.990000
Oct 08 14:23:45 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 14:24:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.380000
Oct 08 14:24:45 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 08 14:25:15 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 08 14:25:45 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was negligible)
Oct 08 14:26:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.600000
Oct 08 14:26:45 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 08 14:27:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.050000
Oct 08 14:27:15 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 08 14:27:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.920000
Oct 08 14:28:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.030000
Oct 08 14:28:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.850000
Oct 08 14:29:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.950000
Oct 08 14:29:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.950000
Oct 08 14:29:45 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 14:30:15 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 08 14:30:45 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 08 14:31:15 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was negligible)
Oct 08 14:31:45 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 08 14:32:45 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was negligible)
Oct 08 14:33:12 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 08 14:33:12 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 08 14:33:12 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 08 14:33:12 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 08 14:33:12 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 08 14:33:12 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 08 14:33:12 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 08 14:33:12 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 08 14:33:12 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 08 14:33:12 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 08 14:33:12 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 08 14:33:12 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 08 14:33:12 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 08 14:33:12 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 08 14:33:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 08 14:33:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 08 14:33:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 08 14:33:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 08 14:33:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 08 14:33:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 08 14:33:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 08 14:33:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 08 14:33:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 08 14:33:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 08 14:33:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 08 14:33:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 08 14:33:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 08 14:33:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 08 14:33:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 08 14:33:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 08 14:33:12 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2889, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 08 14:33:12 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 08 14:33:12 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 08 14:33:12 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2889 (ref=pe_calc-dc-1728369192-38889) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 08 14:33:12 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2889 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 08 14:33:12 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 08 14:33:12 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 08 14:33:15 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 08 14:33:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.840000
Oct 08 14:33:45 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was negligible)
Oct 08 14:34:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.680000
Oct 08 14:34:15 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 14:34:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.320000
Oct 08 14:35:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.620000
Oct 08 14:35:15 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 08 14:35:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.240000
Oct 08 14:35:45 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 14:36:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.310000
Oct 08 14:36:45 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 08 14:37:45 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 08 14:39:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.370000
Oct 08 14:39:45 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was negligible)
Oct 08 14:40:15 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 08 14:40:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.910000
Oct 08 14:40:45 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 08 14:41:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.360000
Oct 08 14:41:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.330000
Oct 08 14:42:15 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 08 14:43:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.630000
Oct 08 14:43:15 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 08 14:43:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.430000
Oct 08 14:43:45 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 14:44:15 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was medium)
Oct 08 14:44:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.860000
Oct 08 14:44:45 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was negligible)
Oct 08 14:45:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.730000
Oct 08 14:45:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.820000
Oct 08 14:46:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.620000
Oct 08 14:46:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.220000
Oct 08 14:47:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.980000
Oct 08 14:47:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.180000
Oct 08 14:48:12 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 08 14:48:12 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 08 14:48:12 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 08 14:48:12 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 08 14:48:12 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 08 14:48:12 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 08 14:48:12 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 08 14:48:12 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 08 14:48:12 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 08 14:48:12 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 08 14:48:12 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 08 14:48:12 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 08 14:48:12 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 08 14:48:12 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 08 14:48:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 08 14:48:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 08 14:48:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 08 14:48:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 08 14:48:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 08 14:48:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 08 14:48:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 08 14:48:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 08 14:48:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 08 14:48:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 08 14:48:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 08 14:48:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 08 14:48:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 08 14:48:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 08 14:48:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 08 14:48:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 08 14:48:12 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2890, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 08 14:48:12 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 08 14:48:12 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 08 14:48:12 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2890 (ref=pe_calc-dc-1728370092-38905) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 08 14:48:12 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2890 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 08 14:48:12 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 08 14:48:12 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 08 14:48:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.540000
Oct 08 14:48:15 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 14:48:45 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 08 14:49:15 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 08 14:49:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.030000
Oct 08 14:49:45 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was negligible)
Oct 08 14:50:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.830000
Oct 08 14:50:15 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 14:50:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.070000
Oct 08 14:51:15 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 08 14:52:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.350000
Oct 08 14:52:15 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 08 14:52:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.820000
Oct 08 14:52:45 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 08 14:53:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.400000
Oct 08 14:53:15 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 14:53:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.510000
Oct 08 14:53:45 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 08 14:54:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.920000
Oct 08 14:54:45 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 08 14:55:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.240000
Oct 08 14:55:15 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 08 14:55:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.830000
Oct 08 14:55:45 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 08 14:56:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.700000
Oct 08 14:56:15 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 14:56:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.290000
Oct 08 14:57:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.500000
Oct 08 14:57:45 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 08 14:58:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.510000
Oct 08 14:58:45 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 08 14:59:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.090000
Oct 08 14:59:15 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 14:59:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.260000
Oct 08 15:00:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.070000
Oct 08 15:00:15 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 08 15:00:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.240000
Oct 08 15:00:45 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 15:01:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.640000
Oct 08 15:01:15 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 08 15:01:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.890000
Oct 08 15:02:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.530000
Oct 08 15:02:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.200000
Oct 08 15:03:12 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 08 15:03:12 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 08 15:03:12 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 08 15:03:12 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 08 15:03:12 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 08 15:03:12 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 08 15:03:12 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 08 15:03:12 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 08 15:03:12 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 08 15:03:12 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 08 15:03:12 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 08 15:03:12 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 08 15:03:12 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 08 15:03:12 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 08 15:03:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 08 15:03:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 08 15:03:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 08 15:03:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 08 15:03:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 08 15:03:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 08 15:03:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 08 15:03:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 08 15:03:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 08 15:03:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 08 15:03:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 08 15:03:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 08 15:03:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 08 15:03:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 08 15:03:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 08 15:03:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 08 15:03:12 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2891, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 08 15:03:12 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 08 15:03:12 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 08 15:03:12 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2891 (ref=pe_calc-dc-1728370992-38926) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 08 15:03:12 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2891 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 08 15:03:12 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 08 15:03:12 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 08 15:03:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.280000
Oct 08 15:03:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.820000
Oct 08 15:03:45 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 15:04:15 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 08 15:04:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.070000
Oct 08 15:04:45 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 08 15:05:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.190000
Oct 08 15:05:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.630000
Oct 08 15:06:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.740000
Oct 08 15:06:15 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 15:06:45 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 08 15:07:15 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 08 15:07:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.390000
Oct 08 15:07:45 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was negligible)
Oct 08 15:08:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.420000
Oct 08 15:08:15 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 08 15:08:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 12.520000
Oct 08 15:09:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.820000
Oct 08 15:09:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.360000
Oct 08 15:10:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.980000
Oct 08 15:10:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.330000
Oct 08 15:10:45 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 15:11:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.640000
Oct 08 15:11:15 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 08 15:11:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.970000
Oct 08 15:12:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.370000
Oct 08 15:12:15 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 15:12:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.160000
Oct 08 15:12:45 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 08 15:13:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.810000
Oct 08 15:13:15 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 15:13:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.340000
Oct 08 15:13:45 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 08 15:14:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.460000
Oct 08 15:14:15 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 15:14:45 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 08 15:15:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.150000
Oct 08 15:15:45 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 08 15:16:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.390000
Oct 08 15:16:45 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was medium)
Oct 08 15:17:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.800000
Oct 08 15:17:45 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was negligible)
Oct 08 15:18:12 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 08 15:18:12 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 08 15:18:12 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 08 15:18:12 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 08 15:18:12 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 08 15:18:12 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 08 15:18:12 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 08 15:18:12 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 08 15:18:12 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 08 15:18:12 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 08 15:18:12 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 08 15:18:12 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 08 15:18:12 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 08 15:18:12 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 08 15:18:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 08 15:18:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 08 15:18:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 08 15:18:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 08 15:18:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 08 15:18:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 08 15:18:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 08 15:18:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 08 15:18:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 08 15:18:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 08 15:18:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 08 15:18:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 08 15:18:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 08 15:18:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 08 15:18:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 08 15:18:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 08 15:18:12 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2892, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 08 15:18:12 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 08 15:18:12 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 08 15:18:12 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2892 (ref=pe_calc-dc-1728371892-38946) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 08 15:18:12 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2892 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 08 15:18:12 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 08 15:18:12 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 08 15:18:15 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 08 15:18:45 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 08 15:19:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.740000
Oct 08 15:19:15 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was negligible)
Oct 08 15:19:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.090000
Oct 08 15:19:45 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 08 15:20:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.160000
Oct 08 15:20:45 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 08 15:21:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.950000
Oct 08 15:21:15 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 08 15:21:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.440000
Oct 08 15:22:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.110000
Oct 08 15:22:15 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 15:22:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.270000
Oct 08 15:23:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.290000
Oct 08 15:23:15 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 08 15:23:45 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 08 15:24:15 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 08 15:24:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.520000
Oct 08 15:24:45 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was negligible)
Oct 08 15:25:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.160000
Oct 08 15:25:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.430000
Oct 08 15:26:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.110000
Oct 08 15:26:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.370000
Oct 08 15:27:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.810000
Oct 08 15:27:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.700000
Oct 08 15:28:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.410000
Oct 08 15:28:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.670000
Oct 08 15:29:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.790000
Oct 08 15:29:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.340000
Oct 08 15:29:45 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 15:30:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.960000
Oct 08 15:30:15 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 08 15:30:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.940000
Oct 08 15:31:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.780000
Oct 08 15:31:15 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 15:31:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.380000
Oct 08 15:31:45 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 08 15:32:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.150000
Oct 08 15:32:15 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 15:32:45 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 08 15:33:12 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 08 15:33:12 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 08 15:33:12 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 08 15:33:12 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 08 15:33:12 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 08 15:33:12 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 08 15:33:12 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 08 15:33:12 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 08 15:33:12 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 08 15:33:12 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 08 15:33:12 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 08 15:33:12 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 08 15:33:12 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 08 15:33:12 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 08 15:33:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 08 15:33:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 08 15:33:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 08 15:33:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 08 15:33:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 08 15:33:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 08 15:33:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 08 15:33:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 08 15:33:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 08 15:33:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 08 15:33:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 08 15:33:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 08 15:33:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 08 15:33:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 08 15:33:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 08 15:33:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 08 15:33:12 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2893, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 08 15:33:12 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 08 15:33:12 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 08 15:33:12 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2893 (ref=pe_calc-dc-1728372792-38964) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 08 15:33:12 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2893 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 08 15:33:12 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 08 15:33:12 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 08 15:33:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.130000
Oct 08 15:33:15 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 08 15:33:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.280000
Oct 08 15:34:15 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 08 15:35:15 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 08 15:35:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.520000
Oct 08 15:35:45 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was negligible)
Oct 08 15:36:15 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was medium)
Oct 08 15:36:45 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was negligible)
Oct 08 15:37:45 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 08 15:38:45 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was negligible)
Oct 08 15:39:45 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 08 15:41:45 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was negligible)
Oct 08 15:42:15 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 08 15:44:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.640000
Oct 08 15:44:45 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was negligible)
Oct 08 15:45:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.660000
Oct 08 15:45:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.080000
Oct 08 15:46:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.490000
Oct 08 15:46:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.620000
Oct 08 15:46:45 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 15:47:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.850000
Oct 08 15:47:15 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 08 15:47:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.980000
Oct 08 15:48:12 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 08 15:48:12 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 08 15:48:12 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 08 15:48:12 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 08 15:48:12 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 08 15:48:12 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 08 15:48:12 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 08 15:48:12 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 08 15:48:12 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 08 15:48:12 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 08 15:48:12 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 08 15:48:12 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 08 15:48:12 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 08 15:48:12 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 08 15:48:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 08 15:48:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 08 15:48:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 08 15:48:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 08 15:48:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 08 15:48:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 08 15:48:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 08 15:48:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 08 15:48:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 08 15:48:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 08 15:48:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 08 15:48:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 08 15:48:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 08 15:48:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 08 15:48:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 08 15:48:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 08 15:48:12 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2894, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 08 15:48:12 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 08 15:48:12 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 08 15:48:12 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2894 (ref=pe_calc-dc-1728373692-38979) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 08 15:48:12 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2894 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 08 15:48:12 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 08 15:48:12 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 08 15:48:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.100000
Oct 08 15:48:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.670000
Oct 08 15:49:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.340000
Oct 08 15:49:15 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 15:49:45 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 08 15:50:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.110000
Oct 08 15:50:15 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 08 15:50:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.540000
Oct 08 15:51:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.110000
Oct 08 15:51:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.990000
Oct 08 15:51:45 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 15:52:15 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 08 15:52:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.950000
Oct 08 15:52:45 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 08 15:53:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.860000
Oct 08 15:53:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.320000
Oct 08 15:54:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.530000
Oct 08 15:54:45 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 08 15:55:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.420000
Oct 08 15:55:45 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 08 15:56:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.910000
Oct 08 15:56:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 15.580000
Oct 08 15:57:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.500000
Oct 08 15:57:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.370000
Oct 08 15:58:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.070000
Oct 08 15:58:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.910000
Oct 08 15:58:45 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 15:59:15 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 08 15:59:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.590000
Oct 08 15:59:45 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 08 16:00:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.140000
Oct 08 16:00:15 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 16:00:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.580000
Oct 08 16:00:45 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 08 16:01:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.320000
Oct 08 16:01:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.340000
Oct 08 16:01:45 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 16:02:15 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 08 16:02:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.700000
Oct 08 16:02:45 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 08 16:03:12 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 08 16:03:12 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 08 16:03:12 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 08 16:03:12 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 08 16:03:12 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 08 16:03:12 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 08 16:03:12 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 08 16:03:12 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 08 16:03:12 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 08 16:03:12 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 08 16:03:12 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 08 16:03:12 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 08 16:03:12 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 08 16:03:12 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 08 16:03:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 08 16:03:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 08 16:03:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 08 16:03:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 08 16:03:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 08 16:03:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 08 16:03:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 08 16:03:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 08 16:03:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 08 16:03:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 08 16:03:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 08 16:03:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 08 16:03:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 08 16:03:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 08 16:03:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 08 16:03:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 08 16:03:12 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2895, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 08 16:03:12 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 08 16:03:12 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 08 16:03:12 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2895 (ref=pe_calc-dc-1728374592-38996) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 08 16:03:12 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2895 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 08 16:03:12 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 08 16:03:12 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 08 16:03:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.320000
Oct 08 16:03:15 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 16:03:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.760000
Oct 08 16:03:45 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 08 16:04:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.460000
Oct 08 16:04:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.080000
Oct 08 16:04:45 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 16:05:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.710000
Oct 08 16:05:15 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 08 16:05:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.340000
Oct 08 16:06:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.950000
Oct 08 16:06:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.120000
Oct 08 16:07:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.620000
Oct 08 16:07:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.430000
Oct 08 16:07:45 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 16:08:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.670000
Oct 08 16:08:45 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 08 16:09:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.180000
Oct 08 16:09:45 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 08 16:10:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.660000
Oct 08 16:10:15 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 16:10:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.560000
Oct 08 16:10:45 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 08 16:11:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 12.010000
Oct 08 16:11:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 12.010000
Oct 08 16:12:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.840000
Oct 08 16:12:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.040000
Oct 08 16:13:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.670000
Oct 08 16:13:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.410000
Oct 08 16:14:15 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 08 16:14:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.910000
Oct 08 16:14:45 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 08 16:15:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.500000
Oct 08 16:15:15 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 16:15:45 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 08 16:16:15 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 08 16:17:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.680000
Oct 08 16:17:15 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was negligible)
Oct 08 16:17:45 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 08 16:18:12 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 08 16:18:12 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 08 16:18:12 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 08 16:18:12 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 08 16:18:12 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 08 16:18:12 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 08 16:18:12 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 08 16:18:12 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 08 16:18:12 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 08 16:18:12 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 08 16:18:12 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 08 16:18:12 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 08 16:18:12 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 08 16:18:12 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 08 16:18:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 08 16:18:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 08 16:18:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 08 16:18:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 08 16:18:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 08 16:18:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 08 16:18:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 08 16:18:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 08 16:18:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 08 16:18:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 08 16:18:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 08 16:18:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 08 16:18:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 08 16:18:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 08 16:18:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 08 16:18:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 08 16:18:12 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2896, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 08 16:18:12 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 08 16:18:12 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 08 16:18:12 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2896 (ref=pe_calc-dc-1728375492-39013) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 08 16:18:12 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2896 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 08 16:18:12 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 08 16:18:12 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 08 16:19:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.030000
Oct 08 16:19:45 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 08 16:20:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.910000
Oct 08 16:20:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.310000
Oct 08 16:20:45 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 16:21:15 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 08 16:21:45 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 08 16:22:15 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was negligible)
Oct 08 16:22:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.680000
Oct 08 16:22:45 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 08 16:23:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.300000
Oct 08 16:23:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.530000
Oct 08 16:24:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.080000
Oct 08 16:24:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 12.990000
Oct 08 16:25:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.070000
Oct 08 16:25:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.500000
Oct 08 16:26:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.770000
Oct 08 16:26:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.220000
Oct 08 16:27:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.750000
Oct 08 16:27:15 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 16:27:45 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 08 16:28:45 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 08 16:30:15 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was negligible)
Oct 08 16:30:45 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 08 16:31:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.810000
Oct 08 16:31:15 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was negligible)
Oct 08 16:31:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.850000
Oct 08 16:31:45 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 08 16:32:15 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 08 16:32:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.580000
Oct 08 16:32:45 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 08 16:33:12 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 08 16:33:12 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 08 16:33:12 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 08 16:33:12 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 08 16:33:12 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 08 16:33:12 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 08 16:33:12 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 08 16:33:12 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 08 16:33:12 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 08 16:33:12 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 08 16:33:12 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 08 16:33:12 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 08 16:33:12 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 08 16:33:12 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 08 16:33:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 08 16:33:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 08 16:33:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 08 16:33:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 08 16:33:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 08 16:33:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 08 16:33:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 08 16:33:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 08 16:33:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 08 16:33:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 08 16:33:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 08 16:33:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 08 16:33:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 08 16:33:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 08 16:33:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 08 16:33:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 08 16:33:12 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2897, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 08 16:33:12 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 08 16:33:12 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 08 16:33:12 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2897 (ref=pe_calc-dc-1728376392-39029) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 08 16:33:12 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2897 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 08 16:33:12 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 08 16:33:12 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 08 16:33:15 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 08 16:33:45 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 08 16:34:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.490000
Oct 08 16:34:45 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was negligible)
Oct 08 16:35:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.560000
Oct 08 16:35:45 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 08 16:36:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.740000
Oct 08 16:36:15 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 08 16:36:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.680000
Oct 08 16:37:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.310000
Oct 08 16:37:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.590000
Oct 08 16:38:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.740000
Oct 08 16:38:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.320000
Oct 08 16:38:45 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 16:39:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.190000
Oct 08 16:39:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.590000
Oct 08 16:39:45 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 08 16:40:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.390000
Oct 08 16:40:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.910000
Oct 08 16:41:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.070000
Oct 08 16:41:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.090000
Oct 08 16:42:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.540000
Oct 08 16:42:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.560000
Oct 08 16:43:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.540000
Oct 08 16:43:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.220000
Oct 08 16:44:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.710000
Oct 08 16:44:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.510000
Oct 08 16:45:15 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 08 16:45:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.450000
Oct 08 16:45:45 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 08 16:46:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.130000
Oct 08 16:46:15 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 16:46:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.830000
Oct 08 16:46:45 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 08 16:47:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.560000
Oct 08 16:47:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.490000
Oct 08 16:48:12 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 08 16:48:12 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 08 16:48:12 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 08 16:48:12 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 08 16:48:12 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 08 16:48:12 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 08 16:48:12 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 08 16:48:12 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 08 16:48:12 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 08 16:48:12 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 08 16:48:12 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 08 16:48:12 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 08 16:48:12 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 08 16:48:12 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 08 16:48:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 08 16:48:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 08 16:48:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 08 16:48:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 08 16:48:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 08 16:48:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 08 16:48:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 08 16:48:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 08 16:48:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 08 16:48:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 08 16:48:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 08 16:48:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 08 16:48:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 08 16:48:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 08 16:48:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 08 16:48:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 08 16:48:12 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2898, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 08 16:48:12 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 08 16:48:12 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 08 16:48:12 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2898 (ref=pe_calc-dc-1728377292-39041) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 08 16:48:12 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2898 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 08 16:48:12 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 08 16:48:12 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 08 16:48:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.190000
Oct 08 16:48:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.040000
Oct 08 16:49:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.560000
Oct 08 16:49:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.590000
Oct 08 16:50:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.680000
Oct 08 16:50:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.170000
Oct 08 16:50:45 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 16:51:15 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 08 16:51:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.660000
Oct 08 16:51:45 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 08 16:52:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.720000
Oct 08 16:52:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.040000
Oct 08 16:53:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.810000
Oct 08 16:53:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 13.790000
Oct 08 16:54:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.600000
Oct 08 16:54:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.330000
Oct 08 16:55:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.940000
Oct 08 16:55:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.340000
Oct 08 16:56:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.160000
Oct 08 16:56:15 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 16:56:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.050000
Oct 08 16:57:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.120000
Oct 08 16:57:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.580000
Oct 08 16:57:45 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 08 16:58:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.300000
Oct 08 16:58:15 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 16:58:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.580000
Oct 08 16:58:45 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 08 16:59:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.220000
Oct 08 16:59:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.030000
Oct 08 16:59:45 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 17:00:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.180000
Oct 08 17:00:45 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 08 17:01:45 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 08 17:02:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.120000
Oct 08 17:02:15 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was negligible)
Oct 08 17:02:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.410000
Oct 08 17:03:12 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 08 17:03:12 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 08 17:03:12 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 08 17:03:12 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 08 17:03:12 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 08 17:03:12 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 08 17:03:12 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 08 17:03:12 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 08 17:03:12 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 08 17:03:12 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 08 17:03:12 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 08 17:03:12 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 08 17:03:12 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 08 17:03:12 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 08 17:03:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 08 17:03:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 08 17:03:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 08 17:03:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 08 17:03:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 08 17:03:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 08 17:03:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 08 17:03:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 08 17:03:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 08 17:03:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 08 17:03:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 08 17:03:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 08 17:03:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 08 17:03:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 08 17:03:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 08 17:03:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 08 17:03:12 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2899, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 08 17:03:12 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 08 17:03:12 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 08 17:03:12 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2899 (ref=pe_calc-dc-1728378192-39053) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 08 17:03:12 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2899 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 08 17:03:12 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 08 17:03:12 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 08 17:03:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.710000
Oct 08 17:03:15 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 17:03:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.540000
Oct 08 17:04:15 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 08 17:04:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.160000
Oct 08 17:04:45 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 08 17:05:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.320000
Oct 08 17:05:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.050000
Oct 08 17:05:45 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 08 17:06:15 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 08 17:07:15 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 08 17:07:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.570000
Oct 08 17:07:45 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was negligible)
Oct 08 17:08:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.090000
Oct 08 17:08:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.130000
Oct 08 17:08:45 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 17:09:15 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 08 17:09:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.360000
Oct 08 17:09:45 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 08 17:10:15 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 08 17:10:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.480000
Oct 08 17:10:45 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 08 17:11:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.200000
Oct 08 17:11:15 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 08 17:11:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.770000
Oct 08 17:12:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.720000
Oct 08 17:12:15 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 17:12:45 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 08 17:13:15 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 08 17:13:45 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was negligible)
Oct 08 17:14:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.600000
Oct 08 17:14:15 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 08 17:14:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.200000
Oct 08 17:14:45 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 17:15:15 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 08 17:16:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.680000
Oct 08 17:16:15 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 08 17:16:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.220000
Oct 08 17:17:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.560000
Oct 08 17:17:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.050000
Oct 08 17:18:12 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 08 17:18:12 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 08 17:18:12 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 08 17:18:12 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 08 17:18:12 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 08 17:18:12 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 08 17:18:12 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 08 17:18:12 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 08 17:18:12 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 08 17:18:12 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 08 17:18:12 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 08 17:18:12 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 08 17:18:12 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 08 17:18:12 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 08 17:18:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 08 17:18:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 08 17:18:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 08 17:18:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 08 17:18:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 08 17:18:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 08 17:18:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 08 17:18:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 08 17:18:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 08 17:18:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 08 17:18:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 08 17:18:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 08 17:18:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 08 17:18:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 08 17:18:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 08 17:18:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 08 17:18:12 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2900, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 08 17:18:12 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 08 17:18:12 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 08 17:18:12 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2900 (ref=pe_calc-dc-1728379092-39075) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 08 17:18:12 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2900 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 08 17:18:12 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 08 17:18:12 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 08 17:18:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.770000
Oct 08 17:18:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.720000
Oct 08 17:19:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.650000
Oct 08 17:19:15 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 17:19:45 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 08 17:20:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.560000
Oct 08 17:20:15 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 08 17:20:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.320000
Oct 08 17:20:45 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 08 17:21:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.770000
Oct 08 17:21:15 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 17:21:45 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 08 17:22:15 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 08 17:22:45 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was negligible)
Oct 08 17:23:45 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 08 17:24:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.450000
Oct 08 17:24:15 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was negligible)
Oct 08 17:24:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.290000
Oct 08 17:25:15 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 08 17:25:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.180000
Oct 08 17:25:45 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 08 17:26:15 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was medium)
Oct 08 17:26:45 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was negligible)
Oct 08 17:27:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.630000
Oct 08 17:27:15 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 08 17:27:45 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 08 17:28:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.060000
Oct 08 17:28:45 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 08 17:29:15 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was high)
Oct 08 17:29:45 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 08 17:30:45 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was negligible)
Oct 08 17:31:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.230000
Oct 08 17:31:15 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 08 17:31:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.030000
Oct 08 17:32:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.220000
Oct 08 17:32:45 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 08 17:33:12 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 08 17:33:12 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 08 17:33:12 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 08 17:33:12 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 08 17:33:12 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 08 17:33:12 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 08 17:33:12 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 08 17:33:12 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 08 17:33:12 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 08 17:33:12 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 08 17:33:12 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 08 17:33:12 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 08 17:33:12 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 08 17:33:12 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 08 17:33:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 08 17:33:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 08 17:33:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 08 17:33:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 08 17:33:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 08 17:33:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 08 17:33:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 08 17:33:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 08 17:33:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 08 17:33:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 08 17:33:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 08 17:33:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 08 17:33:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 08 17:33:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 08 17:33:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 08 17:33:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 08 17:33:12 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2901, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 08 17:33:12 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 08 17:33:12 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 08 17:33:12 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2901 (ref=pe_calc-dc-1728379992-39098) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 08 17:33:12 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2901 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 08 17:33:12 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 08 17:33:12 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 08 17:33:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.100000
Oct 08 17:33:15 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 08 17:33:45 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 08 17:34:15 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 08 17:36:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.420000
Oct 08 17:36:15 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was negligible)
Oct 08 17:36:45 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 08 17:37:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.320000
Oct 08 17:37:15 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 08 17:37:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.720000
Oct 08 17:37:45 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 08 17:38:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.170000
Oct 08 17:38:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.630000
Oct 08 17:39:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.890000
Oct 08 17:39:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.050000
Oct 08 17:39:45 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 17:40:15 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 08 17:40:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.230000
Oct 08 17:40:45 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was low)
Oct 08 17:41:15 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 08 17:42:15 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 08 17:42:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.600000
Oct 08 17:42:45 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was negligible)
Oct 08 17:43:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.260000
Oct 08 17:43:15 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 08 17:43:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.110000
Oct 08 17:44:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.530000
Oct 08 17:44:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 14.120000
Oct 08 17:45:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 13.760000
Oct 08 17:45:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.000000
Oct 08 17:46:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.790000
Oct 08 17:46:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.070000
Oct 08 17:46:45 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 17:47:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.160000
Oct 08 17:47:15 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 08 17:47:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.900000
Oct 08 17:48:12 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 08 17:48:12 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 08 17:48:12 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 08 17:48:12 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 08 17:48:12 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 08 17:48:12 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 08 17:48:12 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 08 17:48:12 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 08 17:48:12 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 08 17:48:12 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 08 17:48:12 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 08 17:48:12 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 08 17:48:12 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 08 17:48:12 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 08 17:48:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 08 17:48:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 08 17:48:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 08 17:48:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 08 17:48:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 08 17:48:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 08 17:48:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 08 17:48:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 08 17:48:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 08 17:48:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 08 17:48:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 08 17:48:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 08 17:48:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 08 17:48:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 08 17:48:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 08 17:48:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 08 17:48:12 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2902, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 08 17:48:12 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 08 17:48:12 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 08 17:48:12 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2902 (ref=pe_calc-dc-1728380892-39115) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 08 17:48:12 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2902 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 08 17:48:12 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 08 17:48:12 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 08 17:48:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.860000
Oct 08 17:48:15 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 17:48:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 13.760000
Oct 08 17:48:45 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 08 17:49:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 12.500000
Oct 08 17:49:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.500000
Oct 08 17:50:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.910000
Oct 08 17:50:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 14.210000
Oct 08 17:51:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 12.520000
Oct 08 17:51:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.020000
Oct 08 17:52:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.650000
Oct 08 17:52:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.950000
Oct 08 17:53:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.380000
Oct 08 17:53:15 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 17:53:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.100000
Oct 08 17:53:45 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 08 17:54:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.250000
Oct 08 17:54:15 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 17:54:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.260000
Oct 08 17:55:15 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: negligible load (was medium)
Oct 08 17:55:45 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: low load (was negligible)
Oct 08 17:56:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 7.070000
Oct 08 17:56:15 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was low)
Oct 08 17:56:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.630000
Oct 08 17:57:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.560000
Oct 08 17:57:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.820000
Oct 08 17:58:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.120000
Oct 08 17:58:15 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 17:58:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 6.320000
Oct 08 17:59:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.650000
Oct 08 17:59:15 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 08 17:59:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 16.540001
Oct 08 18:00:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 11.590000
Oct 08 18:00:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 16.040001
Oct 08 18:01:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.790000
Oct 08 18:01:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.610000
Oct 08 18:02:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.310000
Oct 08 18:02:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 10.350000
Oct 08 18:03:12 pplxnsms02 pacemaker-controld [2428] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 08 18:03:12 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 08 18:03:12 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 08 18:03:12 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 08 18:03:12 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 08 18:03:12 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 08 18:03:12 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 08 18:03:12 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 08 18:03:12 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is online
Oct 08 18:03:12 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 08 18:03:12 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 08 18:03:12 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 08 18:03:12 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 08 18:03:12 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 08 18:03:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 08 18:03:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 08 18:03:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 08 18:03:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 08 18:03:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 08 18:03:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 08 18:03:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 08 18:03:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 08 18:03:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 08 18:03:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 08 18:03:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 08 18:03:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 08 18:03:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 08 18:03:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 08 18:03:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 08 18:03:12 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms01)
Oct 08 18:03:12 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2903, saving inputs in /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 08 18:03:12 pplxnsms02 pacemaker-schedulerd[2427] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 08 18:03:12 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 08 18:03:12 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2903 (ref=pe_calc-dc-1728381792-39126) derived from /var/lib/pacemaker/pengine/pe-input-995.bz2
Oct 08 18:03:12 pplxnsms02 pacemaker-controld [2428] (pcmk__execute_graph) notice: Transition 2903 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-995.bz2): Complete
Oct 08 18:03:12 pplxnsms02 pacemaker-controld [2428] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 08 18:03:12 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 08 18:03:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 9.950000
Oct 08 18:03:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.060000
Oct 08 18:04:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) info: Moderate CPU load detected: 5.670000
Oct 08 18:04:15 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: medium load (was high)
Oct 08 18:04:45 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 8.560000
Oct 08 18:04:45 pplxnsms02 pacemaker-controld [2428] (throttle_send_command) info: New throttle mode: high load (was medium)
Oct 08 18:05:15 pplxnsms02 pacemaker-controld [2428] (throttle_check_thresholds) notice: High CPU load detected: 6.640000
Oct 08 18:05:25 pplxnsms02 pacemaker-based [2423] (cib_process_request) info: Forwarding cib_apply_diff operation for section 'all' to all (origin=local/cibadmin/2)
Oct 08 18:05:25 pplxnsms02 pacemaker-based [2423] (cib_perform_op) info: Diff: --- 0.523.12 2
Oct 08 18:05:25 pplxnsms02 pacemaker-based [2423] (cib_perform_op) info: Diff: +++ 0.524.0 cf1e1687f082b78e554b1aced4a83f81
Oct 08 18:05:25 pplxnsms02 pacemaker-based [2423] (cib_perform_op) info: + /cib: @epoch=524, @num_updates=0
Oct 08 18:05:25 pplxnsms02 pacemaker-based [2423] (cib_perform_op) info: ++ /cib/configuration/nodes/node[@id='1']/instance_attributes[@id='nodes-1']:
Oct 08 18:05:25 pplxnsms02 pacemaker-based [2423] (cib_process_request) info: Completed cib_apply_diff operation for section 'all': OK (rc=0, origin=pplxnsms02/cibadmin/2, version=0.524.0)
Oct 08 18:05:25 pplxnsms02 pacemaker-controld [2428] (abort_transition_graph) info: Transition 2903 aborted by nodes-1-standby doing create standby=on: Configuration change | cib=0.524.0 source=te_update_diff_v2:475 path=/cib/configuration/nodes/node[@id='1']/instance_attributes[@id='nodes-1'] complete=true
Oct 08 18:05:25 pplxnsms02 pacemaker-controld [2428] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_FSA_INTERNAL origin=abort_transition_graph
Oct 08 18:05:25 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 08 18:05:25 pplxnsms02 pacemaker-schedulerd[2427] (unpack_config) notice: On loss of quorum: Ignore
Oct 08 18:05:25 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 08 18:05:25 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms02 is online
Oct 08 18:05:25 pplxnsms02 pacemaker-schedulerd[2427] (unpack_transient_attributes) info: Node pplxnsms01 is in standby-mode
Oct 08 18:05:25 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 08 18:05:25 pplxnsms02 pacemaker-schedulerd[2427] (determine_online_status) info: Node pplxnsms01 is standby
Oct 08 18:05:25 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 08 18:05:25 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found nco_itnm active on pplxnsms02 at Sep 9 09:44:33 2024
Oct 08 18:05:25 pplxnsms02 pacemaker-schedulerd[2427] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Sep 8 13:59:46 2024
Oct 08 18:05:25 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 08 18:05:25 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 08 18:05:25 pplxnsms02 pacemaker-schedulerd[2427] (RecurringOp) info: Start recurring monitor (10s) for siem_vip on pplxnsms02
Oct 08 18:05:25 pplxnsms02 pacemaker-schedulerd[2427] (RecurringOp) info: Start recurring monitor (30s) for siem_lvm on pplxnsms02
Oct 08 18:05:25 pplxnsms02 pacemaker-schedulerd[2427] (RecurringOp) info: Start recurring monitor (20s) for siem_fs on pplxnsms02
Oct 08 18:05:25 pplxnsms02 pacemaker-schedulerd[2427] (RecurringOp) info: Start recurring monitor (10s) for siem_rsyslog on pplxnsms02
Oct 08 18:05:25 pplxnsms02 pacemaker-schedulerd[2427] (RecurringOp) info: Start recurring monitor (60s) for fence-sbd on pplxnsms02
Oct 08 18:05:25 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 08 18:05:25 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 08 18:05:25 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 08 18:05:25 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 08 18:05:25 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 08 18:05:25 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 08 18:05:25 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 08 18:05:25 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms02)
Oct 08 18:05:25 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms02)
Oct 08 18:05:25 pplxnsms02 pacemaker-schedulerd[2427] (log_list_item) notice: Actions: Move siem_vip ( pplxnsms01 -> pplxnsms02 )
Oct 08 18:05:25 pplxnsms02 pacemaker-schedulerd[2427] (log_list_item) notice: Actions: Move siem_lvm ( pplxnsms01 -> pplxnsms02 )
Oct 08 18:05:25 pplxnsms02 pacemaker-schedulerd[2427] (log_list_item) notice: Actions: Move siem_fs ( pplxnsms01 -> pplxnsms02 )
Oct 08 18:05:25 pplxnsms02 pacemaker-schedulerd[2427] (log_list_item) notice: Actions: Move siem_rsyslog ( pplxnsms01 -> pplxnsms02 )
Oct 08 18:05:25 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 08 18:05:25 pplxnsms02 pacemaker-schedulerd[2427] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 08 18:05:25 pplxnsms02 pacemaker-schedulerd[2427] (log_list_item) notice: Actions: Move fence-sbd ( pplxnsms01 -> pplxnsms02 )
Oct 08 18:05:25 pplxnsms02 pacemaker-schedulerd[2427] (pcmk__log_transition_summary) notice: Calculated transition 2904, saving inputs in /var/lib/pacemaker/pengine/pe-input-996.bz2
Oct 08 18:05:25 pplxnsms02 pacemaker-controld [2428] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 08 18:05:25 pplxnsms02 pacemaker-controld [2428] (do_te_invoke) info: Processing graph 2904 (ref=pe_calc-dc-1728381925-39129) derived from /var/lib/pacemaker/pengine/pe-input-996.bz2
Oct 08 18:05:25 pplxnsms02 pacemaker-controld [2428] (te_rsc_command) notice: Initiating stop operation siem_rsyslog_stop_0 on pplxnsms01 | action 46
Oct 08 18:05:25 pplxnsms02 pacemaker-based [2423] (cib_perform_op) info: Diff: --- 0.524.0 2
Oct 08 18:05:25 pplxnsms02 pacemaker-based [2423] (cib_perform_op) info: Diff: +++ 0.524.1 (null)
Oct 08 18:05:25 pplxnsms02 pacemaker-based [2423] (cib_perform_op) info: + /cib: @num_updates=1
Oct 08 18:05:25 pplxnsms02 pacemaker-based [2423] (cib_perform_op) info: + /cib/status/node_state[@id='1']/lrm[@id='1']/lrm_resources/lrm_resource[@id='siem_rsyslog']/lrm_rsc_op[@id='siem_rsyslog_last_0']: @operation_key=siem_rsyslog_stop_0, @operation=stop, @transition-key=46:2904:0:d323af85-43d0-451e-a989-278c4cd27db5, @transition-magic=-1:193;46:2904:0:d323af85-43d0-451e-a989-278c4cd27db5, @call-id=-1, @rc-code=193, @op-status=-1, @last-rc-change=1728381925, @exec-time=0
Oct 08 18:05:25 pplxnsms02 pacemaker-based [2423] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms01/crmd/121, version=0.524.1)
Oct 08 18:05:25 pplxnsms02 pacemaker-based [2423] (cib_file_backup) info: Archived previous version as /var/lib/pacemaker/cib/cib-36.raw
Oct 08 18:05:25 pplxnsms02 pacemaker-based [2423] (cib_file_write_with_digest) info: Wrote version 0.524.0 of the CIB to disk (digest: 82b0ab0306ca1144ac17ec1c0f075f22)
Oct 08 18:05:25 pplxnsms02 pacemaker-based [2423] (cib_file_write_with_digest) info: Reading cluster configuration file /var/lib/pacemaker/cib/cib.gMddxJ (digest: /var/lib/pacemaker/cib/cib.ARrvMt)
Oct 08 18:05:25 pplxnsms02 pacemaker-based [2423] (cib_perform_op) info: Diff: --- 0.524.1 2
Oct 08 18:05:25 pplxnsms02 pacemaker-based [2423] (cib_perform_op) info: Diff: +++ 0.524.2 (null)
Oct 08 18:05:25 pplxnsms02 pacemaker-based [2423] (cib_perform_op) info: + /cib: @num_updates=2
Oct 08 18:05:25 pplxnsms02 pacemaker-based [2423] (cib_perform_op) info: + /cib/status/node_state[@id='1']/lrm[@id='1']/lrm_resources/lrm_resource[@id='siem_rsyslog']/lrm_rsc_op[@id='siem_rsyslog_last_0']: @transition-magic=0:0;46:2904:0:d323af85-43d0-451e-a989-278c4cd27db5, @call-id=117, @rc-code=0, @op-status=0, @exec-time=533
Oct 08 18:05:25 pplxnsms02 pacemaker-based [2423] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms01/crmd/122, version=0.524.2)
Oct 08 18:05:25 pplxnsms02 pacemaker-controld [2428] (process_graph_event) info: Transition 2904 action 46 (siem_rsyslog_stop_0 on pplxnsms01) confirmed: ok | rc=0 call-id=117
Oct 08 18:05:25 pplxnsms02 pacemaker-controld [2428] (te_rsc_command) notice: Initiating stop operation siem_fs_stop_0 on pplxnsms01 | action 43
Oct 08 18:05:25 pplxnsms02 pacemaker-based [2423] (cib_perform_op) info: Diff: --- 0.524.2 2
Oct 08 18:05:25 pplxnsms02 pacemaker-based [2423] (cib_perform_op) info: Diff: +++ 0.524.3 (null)
Oct 08 18:05:25 pplxnsms02 pacemaker-based [2423] (cib_perform_op) info: + /cib: @num_updates=3
Oct 08 18:05:25 pplxnsms02 pacemaker-based [2423] (cib_perform_op) info: + /cib/status/node_state[@id='1']/lrm[@id='1']/lrm_resources/lrm_resource[@id='siem_fs']/lrm_rsc_op[@id='siem_fs_last_0']: @operation_key=siem_fs_stop_0, @operation=stop, @transition-key=43:2904:0:d323af85-43d0-451e-a989-278c4cd27db5, @transition-magic=-1:193;43:2904:0:d323af85-43d0-451e-a989-278c4cd27db5, @call-id=-1, @rc-code=193, @op-status=-1, @last-rc-change=1728381925, @exec-time=0
Oct 08 18:05:25 pplxnsms02 pacemaker-based [2423] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms01/crmd/123, version=0.524.3)
Oct 08 18:05:30 pplxnsms02 pacemaker-based [2423] (cib_process_ping) info: Reporting our current digest to pplxnsms02: fe8ff05c8c266668eb1f8cd14f28c5d0 for 0.524.3 (0x55cf947add90 0)
Oct 08 18:05:32 pplxnsms02 pacemaker-based [2423] (cib_perform_op) info: Diff: --- 0.524.3 2
Oct 08 18:05:32 pplxnsms02 pacemaker-based [2423] (cib_perform_op) info: Diff: +++ 0.524.4 (null)
Oct 08 18:05:32 pplxnsms02 pacemaker-based [2423] (cib_perform_op) info: + /cib: @num_updates=4
Oct 08 18:05:32 pplxnsms02 pacemaker-based [2423] (cib_perform_op) info: + /cib/status/node_state[@id='1']/lrm[@id='1']/lrm_resources/lrm_resource[@id='siem_fs']/lrm_rsc_op[@id='siem_fs_last_0']: @transition-magic=0:0;43:2904:0:d323af85-43d0-451e-a989-278c4cd27db5, @call-id=119, @rc-code=0, @op-status=0, @exec-time=7210
Oct 08 18:05:32 pplxnsms02 pacemaker-based [2423] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms01/crmd/124, version=0.524.4)
Oct 08 18:05:32 pplxnsms02 pacemaker-controld [2428] (process_graph_event) info: Transition 2904 action 43 (siem_fs_stop_0 on pplxnsms01) confirmed: ok | rc=0 call-id=119
Oct 08 18:05:32 pplxnsms02 pacemaker-controld [2428] (te_rsc_command) notice: Initiating stop operation siem_lvm_stop_0 on pplxnsms01 | action 40
Oct 08 18:05:32 pplxnsms02 pacemaker-based [2423] (cib_perform_op) info: Diff: --- 0.524.4 2
Oct 08 18:05:32 pplxnsms02 pacemaker-based [2423] (cib_perform_op) info: Diff: +++ 0.524.5 (null)
Oct 08 18:05:32 pplxnsms02 pacemaker-based [2423] (cib_perform_op) info: + /cib: @num_updates=5
Oct 08 18:05:32 pplxnsms02 pacemaker-based [2423] (cib_perform_op) info: + /cib/status/node_state[@id='1']/lrm[@id='1']/lrm_resources/lrm_resource[@id='siem_lvm']/lrm_rsc_op[@id='siem_lvm_last_0']: @operation_key=siem_lvm_stop_0, @operation=stop, @transition-key=40:2904:0:d323af85-43d0-451e-a989-278c4cd27db5, @transition-magic=-1:193;40:2904:0:d323af85-43d0-451e-a989-278c4cd27db5, @call-id=-1, @rc-code=193, @op-status=-1, @last-rc-change=1728381932, @exec-time=0
Oct 08 18:05:32 pplxnsms02 pacemaker-based [2423] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms01/crmd/125, version=0.524.5)
Oct 08 18:05:33 pplxnsms02 pacemaker-based [2423] (cib_perform_op) info: Diff: --- 0.524.5 2
Oct 08 18:05:33 pplxnsms02 pacemaker-based [2423] (cib_perform_op) info: Diff: +++ 0.524.6 (null)
Oct 08 18:05:33 pplxnsms02 pacemaker-based [2423] (cib_perform_op) info: + /cib: @num_updates=6
Oct 08 18:05:33 pplxnsms02 pacemaker-based [2423] (cib_perform_op) info: + /cib/status/node_state[@id='1']/lrm[@id='1']/lrm_resources/lrm_resource[@id='siem_lvm']/lrm_rsc_op[@id='siem_lvm_last_0']: @transition-magic=0:0;40:2904:0:d323af85-43d0-451e-a989-278c4cd27db5, @call-id=121, @rc-code=0, @op-status=0, @exec-time=431
Oct 08 18:05:33 pplxnsms02 pacemaker-based [2423] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms01/crmd/126, version=0.524.6)
Oct 08 18:05:33 pplxnsms02 pacemaker-controld [2428] (process_graph_event) info: Transition 2904 action 40 (siem_lvm_stop_0 on pplxnsms01) confirmed: ok | rc=0 call-id=121
Oct 08 18:05:33 pplxnsms02 pacemaker-controld [2428] (te_rsc_command) notice: Initiating stop operation siem_vip_stop_0 on pplxnsms01 | action 37
Oct 08 18:05:33 pplxnsms02 pacemaker-based [2423] (cib_perform_op) info: Diff: --- 0.524.6 2
Oct 08 18:05:33 pplxnsms02 pacemaker-based [2423] (cib_perform_op) info: Diff: +++ 0.524.7 (null)
Oct 08 18:05:33 pplxnsms02 pacemaker-based [2423] (cib_perform_op) info: + /cib: @num_updates=7
Oct 08 18:05:33 pplxnsms02 pacemaker-based [2423] (cib_perform_op) info: + /cib/status/node_state[@id='1']/lrm[@id='1']/lrm_resources/lrm_resource[@id='siem_vip']/lrm_rsc_op[@id='siem_vip_last_0']: @operation_key=siem_vip_stop_0, @operation=stop, @transition-key=37:2904:0:d323af85-43d0-451e-a989-278c4cd27db5, @transition-magic=-1:193;37:2904:0:d323af85-43d0-451e-a989-278c4cd27db5, @call-id=-1, @rc-code=193, @op-status=-1, @last-rc-change=1728381933, @exec-time=0
Oct 08 18:05:33 pplxnsms02 pacemaker-based [2423] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms01/crmd/127, version=0.524.7)
Oct 08 18:05:33 pplxnsms02 pacemaker-based [2423] (cib_perform_op) info: Diff: --- 0.524.7 2
Oct 08 18:05:33 pplxnsms02 pacemaker-based [2423] (cib_perform_op) info: Diff: +++ 0.524.8 (null)
Oct 08 18:05:33 pplxnsms02 pacemaker-based [2423] (cib_perform_op) info: + /cib: @num_updates=8
Oct 08 18:05:33 pplxnsms02 pacemaker-based [2423] (cib_perform_op) info: + /cib/status/node_state[@id='1']/lrm[@id='1']/lrm_resources/lrm_resource[@id='siem_vip']/lrm_rsc_op[@id='siem_vip_last_0']: @transition-magic=0:0;37:2904:0:d323af85-43d0-451e-a989-278c4cd27db5, @call-id=123, @rc-code=0, @op-status=0, @exec-time=215
Oct 08 18:05:33 pplxnsms02 pacemaker-based [2423] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms01/crmd/128, version=0.524.8)
Oct 08 18:05:33 pplxnsms02 pacemaker-controld [2428] (process_graph_event) info: Transition 2904 action 37 (siem_vip_stop_0 on pplxnsms01) confirmed: ok | rc=0 call-id=123
Oct 08 18:05:33 pplxnsms02 pacemaker-controld [2428] (te_rsc_command) notice: Initiating start operation siem_vip_start_0 locally on pplxnsms02 | action 38
Oct 08 18:05:33 pplxnsms02 pacemaker-controld [2428] (do_lrm_rsc_op) notice: Requesting local execution of start operation for siem_vip on pplxnsms02 | transition_key=38:2904:0:d323af85-43d0-451e-a989-278c4cd27db5 op_key=siem_vip_start_0
Oct 08 18:05:33 pplxnsms02 pacemaker-based [2423] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/3115)
Oct 08 18:05:33 pplxnsms02 pacemaker-execd [2425] (log_execute) info: executing - rsc:siem_vip action:start call_id:140
Oct 08 18:05:33 pplxnsms02 pacemaker-based [2423] (cib_perform_op) info: Diff: --- 0.524.8 2
Oct 08 18:05:33 pplxnsms02 pacemaker-based [2423] (cib_perform_op) info: Diff: +++ 0.524.9 (null)
Oct 08 18:05:33 pplxnsms02 pacemaker-based [2423] (cib_perform_op) info: + /cib: @num_updates=9
Oct 08 18:05:33 pplxnsms02 pacemaker-based [2423] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='siem_vip']/lrm_rsc_op[@id='siem_vip_last_0']: @operation_key=siem_vip_start_0, @operation=start, @transition-key=38:2904:0:d323af85-43d0-451e-a989-278c4cd27db5, @transition-magic=-1:193;38:2904:0:d323af85-43d0-451e-a989-278c4cd27db5, @call-id=-1, @rc-code=193, @op-status=-1, @last-rc-change=1728381933, @exec-time=0
Oct 08 18:05:33 pplxnsms02 pacemaker-based [2423] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/3115, version=0.524.9)
Oct 08 18:05:33 IPaddr2(siem_vip)[1810820]: INFO: Adding inet address 192.168.133.40/24 with broadcast address 192.168.133.255 to device ens224
Oct 08 18:05:33 IPaddr2(siem_vip)[1810820]: INFO: Bringing device ens224 up
Oct 08 18:05:33 IPaddr2(siem_vip)[1810820]: INFO: /usr/libexec/heartbeat/send_arp -i 200 -r 5 -p /run/resource-agents/send_arp-192.168.133.40 ens224 192.168.133.40 auto not_used not_used
Oct 08 18:05:33 pplxnsms02 pacemaker-execd [2425] (log_finished) info: siem_vip start (call 140, PID 1810820) exited with status 0 (execution time 106ms)
Oct 08 18:05:33 pplxnsms02 pacemaker-controld [2428] (wait_for_sync_result) info: IPaddr2_meta-data_0[1810892] exited with status 0
Oct 08 18:05:33 pplxnsms02 pacemaker-controld [2428] (log_executor_event) notice: Result of start operation for siem_vip on pplxnsms02: ok | CIB update 3116, graph action confirmed; call=140 key=siem_vip_start_0 rc=0
Oct 08 18:05:33 pplxnsms02 pacemaker-based [2423] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/3116)
Oct 08 18:05:33 pplxnsms02 pacemaker-based [2423] (cib_perform_op) info: Diff: --- 0.524.9 2
Oct 08 18:05:33 pplxnsms02 pacemaker-based [2423] (cib_perform_op) info: Diff: +++ 0.524.10 (null)
Oct 08 18:05:33 pplxnsms02 pacemaker-based [2423] (cib_perform_op) info: + /cib: @num_updates=10
Oct 08 18:05:33 pplxnsms02 pacemaker-based [2423] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='siem_vip']/lrm_rsc_op[@id='siem_vip_last_0']: @transition-magic=0:0;38:2904:0:d323af85-43d0-451e-a989-278c4cd27db5, @call-id=140, @rc-code=0, @op-status=0, @exec-time=106
Oct 08 18:05:33 pplxnsms02 pacemaker-based [2423] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/3116, version=0.524.10)
Oct 08 18:05:33 pplxnsms02 pacemaker-controld [2428] (process_graph_event) info: Transition 2904 action 38 (siem_vip_start_0 on pplxnsms02) confirmed: ok | rc=0 call-id=140
Oct 08 18:05:33 pplxnsms02 pacemaker-controld [2428] (te_rsc_command) notice: Initiating monitor operation siem_vip_monitor_10000 locally on pplxnsms02 | action 39
Oct 08 18:05:33 pplxnsms02 pacemaker-controld [2428] (do_lrm_rsc_op) notice: Requesting local execution of monitor operation for siem_vip on pplxnsms02 | transition_key=39:2904:0:d323af85-43d0-451e-a989-278c4cd27db5 op_key=siem_vip_monitor_10000
Oct 08 18:05:33 pplxnsms02 pacemaker-based [2423] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/3117)
Oct 08 18:05:33 pplxnsms02 pacemaker-based [2423] (cib_perform_op) info: Diff: --- 0.524.10 2
Oct 08 18:05:33 pplxnsms02 pacemaker-based [2423] (cib_perform_op) info: Diff: +++ 0.524.11 (null)
Oct 08 18:05:33 pplxnsms02 pacemaker-based [2423] (cib_perform_op) info: + /cib: @num_updates=11
Oct 08 18:05:33 pplxnsms02 pacemaker-based [2423] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='siem_vip']/lrm_rsc_op[@id='siem_vip_monitor_10000']: @transition-key=39:2904:0:d323af85-43d0-451e-a989-278c4cd27db5, @transition-magic=-1:193;39:2904:0:d323af85-43d0-451e-a989-278c4cd27db5, @call-id=-1, @rc-code=193, @op-status=-1, @last-rc-change=1728381933, @exec-time=0
Oct 08 18:05:33 pplxnsms02 pacemaker-based [2423] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/3117, version=0.524.11)
Oct 08 18:05:33 pplxnsms02 pacemaker-controld [2428] (log_executor_event) notice: Result of monitor operation for siem_vip on pplxnsms02: ok | CIB update 3118, graph action unconfirmed; call=141 key=siem_vip_monitor_10000 rc=0
Oct 08 18:05:33 pplxnsms02 pacemaker-based [2423] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/3118)
Oct 08 18:05:33 pplxnsms02 pacemaker-based [2423] (cib_perform_op) info: Diff: --- 0.524.11 2
Oct 08 18:05:33 pplxnsms02 pacemaker-based [2423] (cib_perform_op) info: Diff: +++ 0.524.12 (null)
Oct 08 18:05:33 pplxnsms02 pacemaker-based [2423] (cib_perform_op) info: + /cib: @num_updates=12
Oct 08 18:05:33 pplxnsms02 pacemaker-based [2423] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='siem_vip']/lrm_rsc_op[@id='siem_vip_monitor_10000']: @transition-magic=0:0;39:2904:0:d323af85-43d0-451e-a989-278c4cd27db5, @call-id=141, @rc-code=0, @op-status=0, @exec-time=46
Oct 08 18:05:33 pplxnsms02 pacemaker-based [2423] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/3118, version=0.524.12)
Oct 08 18:05:33 pplxnsms02 pacemaker-controld [2428] (process_graph_event) info: Transition 2904 action 39 (siem_vip_monitor_10000 on pplxnsms02) confirmed: ok | rc=0 call-id=141
Oct 08 18:05:33 pplxnsms02 pacemaker-controld [2428] (te_rsc_command) notice: Initiating start operation siem_lvm_start_0 locally on pplxnsms02 | action 41
Oct 08 18:05:33 pplxnsms02 pacemaker-controld [2428] (do_lrm_rsc_op) notice: Requesting local execution of start operation for siem_lvm on pplxnsms02 | transition_key=41:2904:0:d323af85-43d0-451e-a989-278c4cd27db5 op_key=siem_lvm_start_0
Oct 08 18:05:33 pplxnsms02 pacemaker-based [2423] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/3119)
Oct 08 18:05:33 pplxnsms02 pacemaker-based [2423] (cib_perform_op) info: Diff: --- 0.524.12 2
Oct 08 18:05:33 pplxnsms02 pacemaker-based [2423] (cib_perform_op) info: Diff: +++ 0.524.13 (null)
Oct 08 18:05:33 pplxnsms02 pacemaker-based [2423] (cib_perform_op) info: + /cib: @num_updates=13
Oct 08 18:05:33 pplxnsms02 pacemaker-based [2423] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='siem_lvm']/lrm_rsc_op[@id='siem_lvm_last_0']: @operation_key=siem_lvm_start_0, @operation=start, @transition-key=41:2904:0:d323af85-43d0-451e-a989-278c4cd27db5, @transition-magic=-1:193;41:2904:0:d323af85-43d0-451e-a989-278c4cd27db5, @call-id=-1, @rc-code=193, @op-status=-1, @last-rc-change=1728381933, @exec-time=0
Oct 08 18:05:33 pplxnsms02 pacemaker-execd [2425] (log_execute) info: executing - rsc:siem_lvm action:start call_id:142
Oct 08 18:05:33 pplxnsms02 pacemaker-based [2423] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/3119, version=0.524.13)
Oct 08 18:05:34 LVM-activate(siem_lvm)[1810942]: INFO: Activating vgslog
Oct 08 18:05:34 LVM-activate(siem_lvm)[1810942]: INFO: vgslog: activated successfully.
Oct 08 18:05:34 pplxnsms02 pacemaker-execd [2425] (log_op_output) info: siem_lvm_start_0[1810942] error output [ Cannot access VG vgslog with system ID pplxnsms01 with local system ID pplxnsms02. ]
Oct 08 18:05:34 pplxnsms02 pacemaker-execd [2425] (log_finished) info: siem_lvm start (call 142, PID 1810942) exited with status 0 (execution time 669ms)
Oct 08 18:05:34 pplxnsms02 pacemaker-controld [2428] (wait_for_sync_result) info: LVM-activate_meta-data_0[1811034] exited with status 0
Oct 08 18:05:34 pplxnsms02 pacemaker-controld [2428] (log_executor_event) notice: Result of start operation for siem_lvm on pplxnsms02: ok | CIB update 3120, graph action confirmed; call=142 key=siem_lvm_start_0 rc=0
Oct 08 18:05:34 pplxnsms02 pacemaker-based [2423] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/3120)
Oct 08 18:05:34 pplxnsms02 pacemaker-based [2423] (cib_perform_op) info: Diff: --- 0.524.13 2
Oct 08 18:05:34 pplxnsms02 pacemaker-based [2423] (cib_perform_op) info: Diff: +++ 0.524.14 (null)
Oct 08 18:05:34 pplxnsms02 pacemaker-based [2423] (cib_perform_op) info: + /cib: @num_updates=14
Oct 08 18:05:34 pplxnsms02 pacemaker-based [2423] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='siem_lvm']/lrm_rsc_op[@id='siem_lvm_last_0']: @transition-magic=0:0;41:2904:0:d323af85-43d0-451e-a989-278c4cd27db5, @call-id=142, @rc-code=0, @op-status=0, @exec-time=669
Oct 08 18:05:34 pplxnsms02 pacemaker-based [2423] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/3120, version=0.524.14)
Oct 08 18:05:34 pplxnsms02 pacemaker-controld [2428] (process_graph_event) info: Transition 2904 action 41 (siem_lvm_start_0 on pplxnsms02) confirmed: ok | rc=0 call-id=142
Oct 08 18:05:34 pplxnsms02 pacemaker-controld [2428] (te_rsc_command) notice: Initiating monitor operation siem_lvm_monitor_30000 locally on pplxnsms02 | action 42
Oct 08 18:05:34 pplxnsms02 pacemaker-controld [2428] (do_lrm_rsc_op) notice: Requesting local execution of monitor operation for siem_lvm on pplxnsms02 | transition_key=42:2904:0:d323af85-43d0-451e-a989-278c4cd27db5 op_key=siem_lvm_monitor_30000
Oct 08 18:05:34 pplxnsms02 pacemaker-based [2423] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/3121)
Oct 08 18:05:34 pplxnsms02 pacemaker-based [2423] (cib_perform_op) info: Diff: --- 0.524.14 2
Oct 08 18:05:34 pplxnsms02 pacemaker-based [2423] (cib_perform_op) info: Diff: +++ 0.524.15 (null)
Oct 08 18:05:34 pplxnsms02 pacemaker-based [2423] (cib_perform_op) info: + /cib: @num_updates=15
Oct 08 18:05:34 pplxnsms02 pacemaker-based [2423] (cib_perform_op) info: ++ /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='siem_lvm']:
Oct 08 20:02:32 pplxnsms02 pacemaker-based [2410] (cib_perform_op) info: ++
Oct 08 20:02:32 pplxnsms02 pacemaker-based [2410] (cib_perform_op) info: ++
Oct 08 20:02:32 pplxnsms02 pacemaker-based [2410] (cib_perform_op) info: ++
Oct 08 20:02:32 pplxnsms02 pacemaker-based [2410] (cib_perform_op) info: ++
Oct 08 20:02:32 pplxnsms02 pacemaker-based [2410] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/20, version=0.524.1)
Oct 08 20:02:32 pplxnsms02 pacemaker-controld [2415] (do_state_transition) info: State transition S_FINALIZE_JOIN -> S_POLICY_ENGINE | input=I_FINALIZED cause=C_FSA_INTERNAL origin=check_join_state
Oct 08 20:02:32 pplxnsms02 pacemaker-controld [2415] (create_node_state_update) info: Node update for pplxnsms01 cancelled: no state, not seen yet
Oct 08 20:02:32 pplxnsms02 pacemaker-controld [2415] (abort_transition_graph) info: Transition -1 aborted: Quorum lost | source=crm_update_quorum:435 complete=true
Oct 08 20:02:32 pplxnsms02 pacemaker-controld [2415] (abort_transition_graph) info: Transition -1 aborted: Peer Cancelled | source=do_te_invoke:129 complete=true
Oct 08 20:02:32 pplxnsms02 pacemaker-based [2410] (cib_process_request) info: Forwarding cib_modify operation for section nodes to all (origin=local/crmd/23)
Oct 08 20:02:32 pplxnsms02 pacemaker-based [2410] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/24)
Oct 08 20:02:32 pplxnsms02 pacemaker-based [2410] (cib_process_request) info: Forwarding cib_modify operation for section cib to all (origin=local/crmd/25)
Oct 08 20:02:32 pplxnsms02 pacemaker-based [2410] (cib_process_request) info: Completed cib_modify operation for section nodes: OK (rc=0, origin=pplxnsms02/crmd/23, version=0.524.1)
Oct 08 20:02:32 pplxnsms02 pacemaker-based [2410] (cib_perform_op) info: Diff: --- 0.524.1 2
Oct 08 20:02:32 pplxnsms02 pacemaker-based [2410] (cib_perform_op) info: Diff: +++ 0.524.2 (null)
Oct 08 20:02:32 pplxnsms02 pacemaker-based [2410] (cib_perform_op) info: + /cib: @num_updates=2
Oct 08 20:02:32 pplxnsms02 pacemaker-based [2410] (cib_perform_op) info: + /cib/status/node_state[@id='2']: @crm-debug-origin=do_state_transition, @join=member, @expected=member
Oct 08 20:02:32 pplxnsms02 pacemaker-based [2410] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/24, version=0.524.2)
Oct 08 20:02:32 pplxnsms02 pacemaker-based [2410] (cib_perform_op) info: Diff: --- 0.524.2 2
Oct 08 20:02:32 pplxnsms02 pacemaker-based [2410] (cib_perform_op) info: Diff: +++ 0.524.3 (null)
Oct 08 20:02:32 pplxnsms02 pacemaker-based [2410] (cib_perform_op) info: + /cib: @num_updates=3, @have-quorum=0, @dc-uuid=2
Oct 08 20:02:32 pplxnsms02 pacemaker-based [2410] (cib_process_request) info: Completed cib_modify operation for section cib: OK (rc=0, origin=pplxnsms02/crmd/25, version=0.524.3)
Oct 08 20:02:32 pplxnsms02 pacemaker-schedulerd[2414] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 08 20:02:32 pplxnsms02 pacemaker-schedulerd[2414] (unpack_config) notice: On loss of quorum: Ignore
Oct 08 20:02:32 pplxnsms02 pacemaker-schedulerd[2414] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 08 20:02:32 pplxnsms02 pacemaker-schedulerd[2414] (determine_online_status) info: Node pplxnsms02 is online
Oct 08 20:02:32 pplxnsms02 pacemaker-schedulerd[2414] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 08 20:02:32 pplxnsms02 pacemaker-schedulerd[2414] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 08 20:02:32 pplxnsms02 pacemaker-schedulerd[2414] (RecurringOp) info: Start recurring monitor (10s) for itm_vip on pplxnsms02
Oct 08 20:02:32 pplxnsms02 pacemaker-schedulerd[2414] (RecurringOp) info: Start recurring monitor (30s) for itm_lvm on pplxnsms02
Oct 08 20:02:32 pplxnsms02 pacemaker-schedulerd[2414] (RecurringOp) info: Start recurring monitor (20s) for itm_fs on pplxnsms02
Oct 08 20:02:32 pplxnsms02 pacemaker-schedulerd[2414] (RecurringOp) info: Start recurring monitor (20s) for itm_fs2 on pplxnsms02
Oct 08 20:02:32 pplxnsms02 pacemaker-schedulerd[2414] (RecurringOp) info: Start recurring monitor (20s) for itm_fs3 on pplxnsms02
Oct 08 20:02:32 pplxnsms02 pacemaker-schedulerd[2414] (RecurringOp) info: Start recurring monitor (20s) for nco_db2 on pplxnsms02
Oct 08 20:02:32 pplxnsms02 pacemaker-schedulerd[2414] (RecurringOp) info: Start recurring monitor (60s) for nco_omni on pplxnsms02
Oct 08 20:02:32 pplxnsms02 pacemaker-schedulerd[2414] (RecurringOp) info: Start recurring monitor (300s) for nco_itnm on pplxnsms02
Oct 08 20:02:32 pplxnsms02 pacemaker-schedulerd[2414] (RecurringOp) info: Start recurring monitor (10s) for nco_cognos on pplxnsms02
Oct 08 20:02:32 pplxnsms02 pacemaker-schedulerd[2414] (RecurringOp) info: Start recurring monitor (10s) for siem_vip on pplxnsms02
Oct 08 20:02:32 pplxnsms02 pacemaker-schedulerd[2414] (RecurringOp) info: Start recurring monitor (30s) for siem_lvm on pplxnsms02
Oct 08 20:02:32 pplxnsms02 pacemaker-schedulerd[2414] (RecurringOp) info: Start recurring monitor (20s) for siem_fs on pplxnsms02
Oct 08 20:02:32 pplxnsms02 pacemaker-schedulerd[2414] (RecurringOp) info: Start recurring monitor (10s) for siem_rsyslog on pplxnsms02
Oct 08 20:02:32 pplxnsms02 pacemaker-schedulerd[2414] (RecurringOp) info: Start recurring monitor (60s) for fence-sbd on pplxnsms02
Oct 08 20:02:32 pplxnsms02 pacemaker-schedulerd[2414] (stage6) warning: Scheduling Node pplxnsms01 for STONITH
Oct 08 20:02:32 pplxnsms02 pacemaker-schedulerd[2414] (log_list_item) notice: Actions: Fence (reboot) pplxnsms01 'node is unclean'
Oct 08 20:02:32 pplxnsms02 pacemaker-schedulerd[2414] (log_list_item) notice: Actions: Start itm_vip ( pplxnsms02 )
Oct 08 20:02:32 pplxnsms02 pacemaker-schedulerd[2414] (log_list_item) notice: Actions: Start itm_lvm ( pplxnsms02 )
Oct 08 20:02:32 pplxnsms02 pacemaker-schedulerd[2414] (log_list_item) notice: Actions: Start itm_fs ( pplxnsms02 )
Oct 08 20:02:32 pplxnsms02 pacemaker-schedulerd[2414] (log_list_item) notice: Actions: Start itm_fs2 ( pplxnsms02 )
Oct 08 20:02:32 pplxnsms02 pacemaker-schedulerd[2414] (log_list_item) notice: Actions: Start itm_fs3 ( pplxnsms02 )
Oct 08 20:02:32 pplxnsms02 pacemaker-schedulerd[2414] (log_list_item) notice: Actions: Start nco_db2 ( pplxnsms02 )
Oct 08 20:02:32 pplxnsms02 pacemaker-schedulerd[2414] (log_list_item) notice: Actions: Start nco_omni ( pplxnsms02 )
Oct 08 20:02:32 pplxnsms02 pacemaker-schedulerd[2414] (log_list_item) notice: Actions: Start nco_itnm ( pplxnsms02 )
Oct 08 20:02:32 pplxnsms02 pacemaker-schedulerd[2414] (log_list_item) notice: Actions: Start nco_cognos ( pplxnsms02 )
Oct 08 20:02:32 pplxnsms02 pacemaker-schedulerd[2414] (log_list_item) notice: Actions: Start siem_vip ( pplxnsms02 )
Oct 08 20:02:32 pplxnsms02 pacemaker-schedulerd[2414] (log_list_item) notice: Actions: Start siem_lvm ( pplxnsms02 )
Oct 08 20:02:32 pplxnsms02 pacemaker-schedulerd[2414] (log_list_item) notice: Actions: Start siem_fs ( pplxnsms02 )
Oct 08 20:02:32 pplxnsms02 pacemaker-schedulerd[2414] (log_list_item) notice: Actions: Start siem_rsyslog ( pplxnsms02 )
Oct 08 20:02:32 pplxnsms02 pacemaker-schedulerd[2414] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 08 20:02:32 pplxnsms02 pacemaker-schedulerd[2414] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 08 20:02:32 pplxnsms02 pacemaker-schedulerd[2414] (log_list_item) notice: Actions: Start fence-sbd ( pplxnsms02 )
Oct 08 20:02:32 pplxnsms02 pacemaker-based [2410] (cib_file_backup) info: Archived previous version as /var/lib/pacemaker/cib/cib-38.raw
Oct 08 20:02:32 pplxnsms02 pacemaker-based [2410] (cib_file_write_with_digest) info: Wrote version 0.524.0 of the CIB to disk (digest: 1e7b82b9341d4d6b5ae14a5b508c5b23)
Oct 08 20:02:32 pplxnsms02 pacemaker-based [2410] (cib_file_write_with_digest) info: Reading cluster configuration file /var/lib/pacemaker/cib/cib.mtIXNx (digest: /var/lib/pacemaker/cib/cib.cpyBA7)
Oct 08 20:02:32 pplxnsms02 pacemaker-schedulerd[2414] (pcmk__log_transition_summary) warning: Calculated transition 0 (with warnings), saving inputs in /var/lib/pacemaker/pengine/pe-warn-95.bz2
Oct 08 20:02:32 pplxnsms02 pacemaker-controld [2415] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 08 20:02:32 pplxnsms02 pacemaker-controld [2415] (do_te_invoke) info: Processing graph 0 (ref=pe_calc-dc-1728388952-8) derived from /var/lib/pacemaker/pengine/pe-warn-95.bz2
Oct 08 20:02:32 pplxnsms02 pacemaker-controld [2415] (te_rsc_command) notice: Initiating monitor operation itm_vip_monitor_0 locally on pplxnsms02 | action 1
Oct 08 20:02:32 pplxnsms02 pacemaker-execd [2412] (process_lrmd_get_rsc_info) info: Agent information for 'itm_vip' not in cache
Oct 08 20:02:32 pplxnsms02 pacemaker-execd [2412] (process_lrmd_rsc_register) info: Cached agent information for 'itm_vip'
Oct 08 20:02:32 pplxnsms02 pacemaker-controld [2415] (do_lrm_rsc_op) notice: Requesting local execution of probe operation for itm_vip on pplxnsms02 | transition_key=1:0:7:35e848dd-66c2-437f-a5f5-6690956e32c4 op_key=itm_vip_monitor_0
Oct 08 20:02:32 pplxnsms02 pacemaker-controld [2415] (wait_for_sync_result) info: IPaddr2_meta-data_0[3768] exited with status 0
Oct 08 20:02:32 pplxnsms02 pacemaker-based [2410] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/28)
Oct 08 20:02:32 pplxnsms02 pacemaker-controld [2415] (te_rsc_command) notice: Initiating monitor operation itm_lvm_monitor_0 locally on pplxnsms02 | action 2
Oct 08 20:02:32 pplxnsms02 pacemaker-execd [2412] (process_lrmd_get_rsc_info) info: Agent information for 'itm_lvm' not in cache
Oct 08 20:02:32 pplxnsms02 pacemaker-execd [2412] (process_lrmd_rsc_register) info: Cached agent information for 'itm_lvm'
Oct 08 20:02:32 pplxnsms02 pacemaker-controld [2415] (do_lrm_rsc_op) notice: Requesting local execution of probe operation for itm_lvm on pplxnsms02 | transition_key=2:0:7:35e848dd-66c2-437f-a5f5-6690956e32c4 op_key=itm_lvm_monitor_0
Oct 08 20:02:32 pplxnsms02 pacemaker-based [2410] (cib_perform_op) info: Diff: --- 0.524.3 2
Oct 08 20:02:32 pplxnsms02 pacemaker-based [2410] (cib_perform_op) info: Diff: +++ 0.524.4 (null)
Oct 08 20:02:32 pplxnsms02 pacemaker-based [2410] (cib_perform_op) info: + /cib: @num_updates=4
Oct 08 20:02:32 pplxnsms02 pacemaker-based [2410] (cib_perform_op) info: + /cib/status/node_state[@id='2']: @crm-debug-origin=do_update_resource
Oct 08 20:02:32 pplxnsms02 pacemaker-based [2410] (cib_perform_op) info: ++ /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources:
Oct 08 20:02:32 pplxnsms02 pacemaker-based [2410] (cib_perform_op) info: ++
Oct 08 20:02:32 pplxnsms02 pacemaker-based [2410] (cib_perform_op) info: ++
Oct 08 20:02:33 pplxnsms02 pacemaker-based [2410] (cib_perform_op) info: ++
Oct 08 20:02:33 pplxnsms02 pacemaker-based [2410] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/30, version=0.524.6)
Oct 08 20:02:33 pplxnsms02 pacemaker-execd [2412] (process_lrmd_get_rsc_info) info: Agent information for 'itm_fs2' not in cache
Oct 08 20:02:33 pplxnsms02 pacemaker-execd [2412] (process_lrmd_rsc_register) info: Cached agent information for 'itm_fs2'
Oct 08 20:02:33 pplxnsms02 pacemaker-controld [2415] (do_lrm_rsc_op) notice: Requesting local execution of probe operation for itm_fs2 on pplxnsms02 | transition_key=4:0:7:35e848dd-66c2-437f-a5f5-6690956e32c4 op_key=itm_fs2_monitor_0
Oct 08 20:02:33 pplxnsms02 pacemaker-based [2410] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/31)
Oct 08 20:02:33 pplxnsms02 pacemaker-controld [2415] (te_fence_node) notice: Requesting fencing (reboot) of node pplxnsms01 | action=53 timeout=60000
Oct 08 20:02:33 pplxnsms02 pacemaker-fenced [2411] (handle_request) notice: Client pacemaker-controld.2415 wants to fence (reboot) pplxnsms01 using any device
Oct 08 20:02:33 pplxnsms02 pacemaker-fenced [2411] (initiate_remote_stonith_op) notice: Requesting peer fencing (reboot) targeting pplxnsms01 | id=fdddb422 state=querying base_timeout=60
Oct 08 20:02:33 pplxnsms02 pacemaker-based [2410] (cib_perform_op) info: Diff: --- 0.524.6 2
Oct 08 20:02:33 pplxnsms02 pacemaker-based [2410] (cib_perform_op) info: Diff: +++ 0.524.7 (null)
Oct 08 20:02:33 pplxnsms02 pacemaker-based [2410] (cib_perform_op) info: + /cib: @num_updates=7
Oct 08 20:02:33 pplxnsms02 pacemaker-based [2410] (cib_perform_op) info: ++ /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources:
Oct 08 20:02:33 pplxnsms02 pacemaker-based [2410] (cib_perform_op) info: ++
Oct 08 20:02:33 pplxnsms02 pacemaker-based [2410] (cib_perform_op) info: ++
Oct 08 20:02:33 pplxnsms02 pacemaker-based [2410] (cib_perform_op) info: ++
Oct 08 20:02:33 pplxnsms02 pacemaker-based [2410] (cib_perform_op) info: ++
Oct 08 20:02:33 pplxnsms02 pacemaker-based [2410] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/38, version=0.524.14)
Oct 08 20:02:33 pplxnsms02 pacemaker-controld [2415] (process_graph_event) info: Transition 0 action 4 (itm_fs2_monitor_0 on pplxnsms02) confirmed: not running | rc=7 call-id=17
Oct 08 20:02:33 pplxnsms02 pacemaker-controld [2415] (log_executor_event) notice: Result of probe operation for itm_fs on pplxnsms02: not running | CIB update 39, graph action confirmed; call=13 key=itm_fs_monitor_0 rc=7
Oct 08 20:02:33 pplxnsms02 pacemaker-controld [2415] (te_rsc_command) notice: Initiating monitor operation nco_itnm_monitor_0 locally on pplxnsms02 | action 8
Oct 08 20:02:33 pplxnsms02 pacemaker-execd [2412] (process_lrmd_get_rsc_info) info: Agent information for 'nco_itnm' not in cache
Oct 08 20:02:33 pplxnsms02 pacemaker-based [2410] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/39)
Oct 08 20:02:33 pplxnsms02 pacemaker-based [2410] (cib_perform_op) info: Diff: --- 0.524.14 2
Oct 08 20:02:33 pplxnsms02 pacemaker-based [2410] (cib_perform_op) info: Diff: +++ 0.524.15 (null)
Oct 08 20:02:33 pplxnsms02 pacemaker-based [2410] (cib_perform_op) info: + /cib: @num_updates=15
Oct 08 20:02:33 pplxnsms02 pacemaker-based [2410] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='itm_fs']/lrm_rsc_op[@id='itm_fs_last_0']: @transition-magic=0:7;3:0:7:35e848dd-66c2-437f-a5f5-6690956e32c4, @call-id=13, @rc-code=7, @op-status=0, @last-rc-change=1728388953, @exec-time=243
Oct 08 20:02:33 pplxnsms02 pacemaker-execd [2412] (process_lrmd_rsc_register) info: Cached agent information for 'nco_itnm'
Oct 08 20:02:33 pplxnsms02 pacemaker-based [2410] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/39, version=0.524.15)
Oct 08 20:02:33 pplxnsms02 pacemaker-controld [2415] (do_lrm_rsc_op) notice: Requesting local execution of probe operation for nco_itnm on pplxnsms02 | transition_key=8:0:7:35e848dd-66c2-437f-a5f5-6690956e32c4 op_key=nco_itnm_monitor_0
Oct 08 20:02:33 omnibus(nco_omni)[4197]: ERROR: Cannot find the directory /san/tivoli/netcool!
Oct 08 20:02:33 pplxnsms02 pacemaker-controld [2415] (wait_for_sync_result) info: itnm_meta-data_0[4200] exited with status 0
Oct 08 20:02:33 pplxnsms02 pacemaker-based [2410] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/40)
Oct 08 20:02:33 pplxnsms02 pacemaker-controld [2415] (process_graph_event) info: Transition 0 action 3 (itm_fs_monitor_0 on pplxnsms02) confirmed: not running | rc=7 call-id=13
Oct 08 20:02:33 pplxnsms02 pacemaker-controld [2415] (te_rsc_command) notice: Initiating monitor operation nco_cognos_monitor_0 locally on pplxnsms02 | action 9
Oct 08 20:02:33 pplxnsms02 pacemaker-based [2410] (cib_perform_op) info: Diff: --- 0.524.15 2
Oct 08 20:02:33 pplxnsms02 pacemaker-based [2410] (cib_perform_op) info: Diff: +++ 0.524.16 (null)
Oct 08 20:02:33 pplxnsms02 pacemaker-based [2410] (cib_perform_op) info: + /cib: @num_updates=16
Oct 08 20:02:33 pplxnsms02 pacemaker-based [2410] (cib_perform_op) info: ++ /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources:
Oct 08 20:02:33 pplxnsms02 pacemaker-based [2410] (cib_perform_op) info: ++
Oct 08 20:02:33 pplxnsms02 pacemaker-based [2410] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/40, version=0.524.16)
Oct 08 20:02:33 pplxnsms02 pacemaker-execd [2412] (process_lrmd_get_rsc_info) info: Agent information for 'nco_cognos' not in cache
Oct 08 20:02:33 pplxnsms02 pacemaker-execd [2412] (process_lrmd_rsc_register) info: Cached agent information for 'nco_cognos'
Oct 08 20:02:33 pplxnsms02 pacemaker-controld [2415] (do_lrm_rsc_op) notice: Requesting local execution of probe operation for nco_cognos on pplxnsms02 | transition_key=9:0:7:35e848dd-66c2-437f-a5f5-6690956e32c4 op_key=nco_cognos_monitor_0
Oct 08 20:02:33 itnm(nco_itnm)[4210]: ERROR: Cannot find the directory /san/tivoli/netcool!
Oct 08 20:02:33 pplxnsms02 pacemaker-controld [2415] (wait_for_sync_result) info: Cognos_meta-data_0[4214] exited with status 0
Oct 08 20:02:33 pplxnsms02 pacemaker-controld [2415] (log_executor_event) notice: Result of probe operation for nco_omni on pplxnsms02: not running | CIB update 42, graph action confirmed; call=29 key=nco_omni_monitor_0 rc=7
Oct 08 20:02:33 pplxnsms02 pacemaker-based [2410] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/41)
Oct 08 20:02:33 pplxnsms02 pacemaker-based [2410] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/42)
Oct 08 20:02:33 pplxnsms02 pacemaker-based [2410] (cib_perform_op) info: Diff: --- 0.524.16 2
Oct 08 20:02:33 pplxnsms02 pacemaker-based [2410] (cib_perform_op) info: Diff: +++ 0.524.17 (null)
Oct 08 20:02:33 pplxnsms02 pacemaker-based [2410] (cib_perform_op) info: + /cib: @num_updates=17
Oct 08 20:02:33 pplxnsms02 pacemaker-based [2410] (cib_perform_op) info: ++ /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources:
Oct 08 20:02:33 pplxnsms02 pacemaker-based [2410] (cib_perform_op) info: ++
Oct 08 20:02:33 pplxnsms02 pacemaker-based [2410] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/41, version=0.524.17)
Oct 08 20:02:33 pplxnsms02 pacemaker-based [2410] (cib_perform_op) info: Diff: --- 0.524.17 2
Oct 08 20:02:33 pplxnsms02 pacemaker-based [2410] (cib_perform_op) info: Diff: +++ 0.524.18 (null)
Oct 08 20:02:33 pplxnsms02 pacemaker-based [2410] (cib_perform_op) info: + /cib: @num_updates=18
Oct 08 20:02:33 pplxnsms02 pacemaker-based [2410] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='nco_omni']/lrm_rsc_op[@id='nco_omni_last_0']: @transition-magic=0:7;7:0:7:35e848dd-66c2-437f-a5f5-6690956e32c4, @call-id=29, @rc-code=7, @op-status=0, @exec-time=76
Oct 08 20:02:33 pplxnsms02 pacemaker-based [2410] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/42, version=0.524.18)
Oct 08 20:02:33 pplxnsms02 pacemaker-controld [2415] (process_graph_event) info: Transition 0 action 7 (nco_omni_monitor_0 on pplxnsms02) confirmed: not running | rc=7 call-id=29
Oct 08 20:02:33 pplxnsms02 pacemaker-controld [2415] (te_rsc_command) notice: Initiating monitor operation siem_vip_monitor_0 locally on pplxnsms02 | action 10
Oct 08 20:02:33 pplxnsms02 pacemaker-execd [2412] (process_lrmd_get_rsc_info) info: Agent information for 'siem_vip' not in cache
Oct 08 20:02:33 pplxnsms02 pacemaker-execd [2412] (process_lrmd_rsc_register) info: Cached agent information for 'siem_vip'
Oct 08 20:02:33 pplxnsms02 pacemaker-controld [2415] (do_lrm_rsc_op) notice: Requesting local execution of probe operation for siem_vip on pplxnsms02 | transition_key=10:0:7:35e848dd-66c2-437f-a5f5-6690956e32c4 op_key=siem_vip_monitor_0
Oct 08 20:02:33 pplxnsms02 pacemaker-based [2410] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/43)
Oct 08 20:02:33 pplxnsms02 pacemaker-based [2410] (cib_perform_op) info: Diff: --- 0.524.18 2
Oct 08 20:02:33 pplxnsms02 pacemaker-based [2410] (cib_perform_op) info: Diff: +++ 0.524.19 (null)
Oct 08 20:02:33 pplxnsms02 pacemaker-based [2410] (cib_perform_op) info: + /cib: @num_updates=19
Oct 08 20:02:33 pplxnsms02 pacemaker-based [2410] (cib_perform_op) info: ++ /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources:
Oct 08 20:02:33 pplxnsms02 pacemaker-based [2410] (cib_perform_op) info: ++
Oct 08 20:02:33 pplxnsms02 pacemaker-based [2410] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/43, version=0.524.19)
Oct 08 20:02:33 Cognos(nco_cognos)[4224]: ERROR: Cannot find the directory /san/tivoli/IBM/WebSphere!
Oct 08 20:02:33 pplxnsms02 pacemaker-controld [2415] (log_executor_event) notice: Result of probe operation for nco_itnm on pplxnsms02: not running | CIB update 44, graph action confirmed; call=33 key=nco_itnm_monitor_0 rc=7
Oct 08 20:02:33 pplxnsms02 pacemaker-based [2410] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/44)
Oct 08 20:02:33 pplxnsms02 pacemaker-based [2410] (cib_perform_op) info: Diff: --- 0.524.19 2
Oct 08 20:02:33 pplxnsms02 pacemaker-based [2410] (cib_perform_op) info: Diff: +++ 0.524.20 (null)
Oct 08 20:02:33 pplxnsms02 pacemaker-based [2410] (cib_perform_op) info: + /cib: @num_updates=20
Oct 08 20:02:33 pplxnsms02 pacemaker-based [2410] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='nco_itnm']/lrm_rsc_op[@id='nco_itnm_last_0']: @transition-magic=0:7;8:0:7:35e848dd-66c2-437f-a5f5-6690956e32c4, @call-id=33, @rc-code=7, @op-status=0, @exec-time=87
Oct 08 20:02:33 pplxnsms02 pacemaker-based [2410] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/44, version=0.524.20)
Oct 08 20:02:33 pplxnsms02 pacemaker-controld [2415] (process_graph_event) info: Transition 0 action 8 (nco_itnm_monitor_0 on pplxnsms02) confirmed: not running | rc=7 call-id=33
Oct 08 20:02:33 pplxnsms02 pacemaker-controld [2415] (te_rsc_command) notice: Initiating monitor operation siem_lvm_monitor_0 locally on pplxnsms02 | action 11
Oct 08 20:02:33 pplxnsms02 pacemaker-execd [2412] (process_lrmd_get_rsc_info) info: Agent information for 'siem_lvm' not in cache
Oct 08 20:02:33 pplxnsms02 pacemaker-execd [2412] (process_lrmd_rsc_register) info: Cached agent information for 'siem_lvm'
Oct 08 20:02:33 pplxnsms02 pacemaker-controld [2415] (do_lrm_rsc_op) notice: Requesting local execution of probe operation for siem_lvm on pplxnsms02 | transition_key=11:0:7:35e848dd-66c2-437f-a5f5-6690956e32c4 op_key=siem_lvm_monitor_0
Oct 08 20:02:33 pplxnsms02 pacemaker-based [2410] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/45)
Oct 08 20:02:33 pplxnsms02 pacemaker-based [2410] (cib_perform_op) info: Diff: --- 0.524.20 2
Oct 08 20:02:33 pplxnsms02 pacemaker-based [2410] (cib_perform_op) info: Diff: +++ 0.524.21 (null)
Oct 08 20:02:33 pplxnsms02 pacemaker-based [2410] (cib_perform_op) info: + /cib: @num_updates=21
Oct 08 20:02:33 pplxnsms02 pacemaker-based [2410] (cib_perform_op) info: ++ /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources:
Oct 08 20:02:33 pplxnsms02 pacemaker-based [2410] (cib_perform_op) info: ++
Oct 08 20:02:33 pplxnsms02 pacemaker-based [2410] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/45, version=0.524.21)
Oct 08 20:02:33 pplxnsms02 pacemaker-controld [2415] (log_executor_event) notice: Result of probe operation for siem_lvm on pplxnsms02: not running | CIB update 46, graph action confirmed; call=45 key=siem_lvm_monitor_0 rc=7
Oct 08 20:02:33 pplxnsms02 pacemaker-based [2410] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/46)
Oct 08 20:02:33 pplxnsms02 pacemaker-based [2410] (cib_perform_op) info: Diff: --- 0.524.21 2
Oct 08 20:02:33 pplxnsms02 pacemaker-based [2410] (cib_perform_op) info: Diff: +++ 0.524.22 (null)
Oct 08 20:02:33 pplxnsms02 pacemaker-based [2410] (cib_perform_op) info: + /cib: @num_updates=22
Oct 08 20:02:33 pplxnsms02 pacemaker-based [2410] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='siem_lvm']/lrm_rsc_op[@id='siem_lvm_last_0']: @transition-magic=0:7;11:0:7:35e848dd-66c2-437f-a5f5-6690956e32c4, @call-id=45, @rc-code=7, @op-status=0, @exec-time=40
Oct 08 20:02:33 pplxnsms02 pacemaker-based [2410] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/46, version=0.524.22)
Oct 08 20:02:33 pplxnsms02 pacemaker-controld [2415] (process_graph_event) info: Transition 0 action 11 (siem_lvm_monitor_0 on pplxnsms02) confirmed: not running | rc=7 call-id=45
Oct 08 20:02:33 pplxnsms02 pacemaker-controld [2415] (te_rsc_command) notice: Initiating monitor operation siem_fs_monitor_0 locally on pplxnsms02 | action 12
Oct 08 20:02:33 pplxnsms02 pacemaker-execd [2412] (process_lrmd_get_rsc_info) info: Agent information for 'siem_fs' not in cache
Oct 08 20:02:33 pplxnsms02 pacemaker-execd [2412] (process_lrmd_rsc_register) info: Cached agent information for 'siem_fs'
Oct 08 20:02:33 pplxnsms02 pacemaker-controld [2415] (do_lrm_rsc_op) notice: Requesting local execution of probe operation for siem_fs on pplxnsms02 | transition_key=12:0:7:35e848dd-66c2-437f-a5f5-6690956e32c4 op_key=siem_fs_monitor_0
Oct 08 20:02:33 pplxnsms02 pacemaker-based [2410] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/47)
Oct 08 20:02:33 pplxnsms02 pacemaker-based [2410] (cib_perform_op) info: Diff: --- 0.524.22 2
Oct 08 20:02:33 pplxnsms02 pacemaker-based [2410] (cib_perform_op) info: Diff: +++ 0.524.23 (null)
Oct 08 20:02:33 pplxnsms02 pacemaker-based [2410] (cib_perform_op) info: + /cib: @num_updates=23
Oct 08 20:02:33 pplxnsms02 pacemaker-based [2410] (cib_perform_op) info: ++ /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources:
Oct 08 20:02:33 pplxnsms02 pacemaker-based [2410] (cib_perform_op) info: ++
Oct 08 20:02:33 pplxnsms02 pacemaker-based [2410] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/47, version=0.524.23)
Oct 08 20:02:33 pplxnsms02 pacemaker-controld [2415] (log_executor_event) notice: Result of probe operation for nco_cognos on pplxnsms02: not running | CIB update 48, graph action confirmed; call=37 key=nco_cognos_monitor_0 rc=7
Oct 08 20:02:33 pplxnsms02 pacemaker-based [2410] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/48)
Oct 08 20:02:33 pplxnsms02 pacemaker-based [2410] (cib_perform_op) info: Diff: --- 0.524.23 2
Oct 08 20:02:33 pplxnsms02 pacemaker-based [2410] (cib_perform_op) info: Diff: +++ 0.524.24 (null)
Oct 08 20:02:33 pplxnsms02 pacemaker-based [2410] (cib_perform_op) info: + /cib: @num_updates=24
Oct 08 20:02:33 pplxnsms02 pacemaker-based [2410] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='nco_cognos']/lrm_rsc_op[@id='nco_cognos_last_0']: @transition-magic=0:7;9:0:7:35e848dd-66c2-437f-a5f5-6690956e32c4, @call-id=37, @rc-code=7, @op-status=0, @exec-time=98
Oct 08 20:02:33 pplxnsms02 pacemaker-based [2410] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/48, version=0.524.24)
Oct 08 20:02:33 pplxnsms02 pacemaker-controld [2415] (process_graph_event) info: Transition 0 action 9 (nco_cognos_monitor_0 on pplxnsms02) confirmed: not running | rc=7 call-id=37
Oct 08 20:02:33 pplxnsms02 pacemaker-controld [2415] (te_rsc_command) notice: Initiating monitor operation siem_rsyslog_monitor_0 locally on pplxnsms02 | action 13
Oct 08 20:02:33 pplxnsms02 pacemaker-execd [2412] (process_lrmd_get_rsc_info) info: Agent information for 'siem_rsyslog' not in cache
Oct 08 20:02:33 pplxnsms02 pacemaker-execd [2412] (process_lrmd_rsc_register) info: Cached agent information for 'siem_rsyslog'
Oct 08 20:02:33 pplxnsms02 pacemaker-controld [2415] (do_lrm_rsc_op) notice: Requesting local execution of probe operation for siem_rsyslog on pplxnsms02 | transition_key=13:0:7:35e848dd-66c2-437f-a5f5-6690956e32c4 op_key=siem_rsyslog_monitor_0
Oct 08 20:02:52 pplxnsms02 pacemakerd [2196] (crm_log_init) info: Changed active directory to /var/lib/pacemaker/cores
Oct 08 20:02:52 pplxnsms02 pacemakerd [2196] (ipc_post_disconnect) info: Disconnected from launcher IPC API
Oct 08 20:02:52 pplxnsms02 pacemakerd [2196] (get_cluster_type) info: Detected an active 'corosync' cluster
Oct 08 20:02:52 pplxnsms02 pacemakerd [2196] (mcp_read_config) info: Reading configuration for corosync stack
Oct 08 20:02:52 pplxnsms02 pacemakerd [2196] (main) notice: Starting Pacemaker 2.1.2-4.el8 | build=ada5c3b36e2 features:agent-manpages cibsecrets compat-2.0 corosync-ge-2 default-concurrent-fencing default-sbd-sync generated-manpages monotonic nagios ncurses remote systemd
Oct 08 20:02:52 pplxnsms02 pacemakerd [2196] (remove_core_file_limit) info: Maximum core file size is 18446744073709551615 bytes
Oct 08 20:02:52 pplxnsms02 pacemakerd [2196] (qb_ipcs_us_publish) info: server name: pacemakerd
Oct 08 20:02:52 pplxnsms02 pacemakerd [2196] (pcmk__ipc_is_authentic_process_active) info: Could not connect to cib_ro IPC: Connection refused
Oct 08 20:02:52 pplxnsms02 pacemakerd [2196] (pcmk__ipc_is_authentic_process_active) info: Could not connect to stonith-ng IPC: Connection refused
Oct 08 20:02:52 pplxnsms02 pacemakerd [2196] (pcmk__ipc_is_authentic_process_active) info: Could not connect to lrmd IPC: Connection refused
Oct 08 20:02:52 pplxnsms02 pacemakerd [2196] (pcmk__ipc_is_authentic_process_active) info: Could not connect to attrd IPC: Connection refused
Oct 08 20:02:52 pplxnsms02 pacemakerd [2196] (pcmk__ipc_is_authentic_process_active) info: Could not connect to pengine IPC: Connection refused
Oct 08 20:02:52 pplxnsms02 pacemakerd [2196] (pcmk__ipc_is_authentic_process_active) info: Could not connect to crmd IPC: Connection refused
Oct 08 20:02:52 pplxnsms02 pacemakerd [2196] (main) notice: Waiting for startup-trigger from SBD.
Oct 08 20:02:52 pplxnsms02 pacemakerd [2196] (main) notice: Pacemaker daemon successfully started and accepting connections
Oct 08 20:02:53 pplxnsms02 pacemakerd [2196] (pcmk_handle_ping_request) notice: Received startup-trigger from SBD.
Oct 08 20:02:53 pplxnsms02 pacemakerd [2196] (start_child) info: Using uid=189 and group=189 for process pacemaker-based
Oct 08 20:02:53 pplxnsms02 pacemakerd [2196] (start_child) info: Forked child 2388 for process pacemaker-based
Oct 08 20:02:53 pplxnsms02 pacemakerd [2196] (start_child) info: Forked child 2389 for process pacemaker-fenced
Oct 08 20:02:53 pplxnsms02 pacemakerd [2196] (start_child) info: Forked child 2390 for process pacemaker-execd
Oct 08 20:02:53 pplxnsms02 pacemakerd [2196] (start_child) info: Using uid=189 and group=189 for process pacemaker-attrd
Oct 08 20:02:53 pplxnsms02 pacemakerd [2196] (start_child) info: Forked child 2392 for process pacemaker-attrd
Oct 08 20:02:53 pplxnsms02 pacemakerd [2196] (start_child) info: Using uid=189 and group=189 for process pacemaker-schedulerd
Oct 08 20:02:53 pplxnsms02 pacemakerd [2196] (start_child) info: Forked child 2393 for process pacemaker-schedulerd
Oct 08 20:02:53 pplxnsms02 pacemakerd [2196] (start_child) info: Using uid=189 and group=189 for process pacemaker-controld
Oct 08 20:02:53 pplxnsms02 pacemakerd [2196] (start_child) info: Forked child 2394 for process pacemaker-controld
Oct 08 20:02:53 pplxnsms02 pacemaker-based [2388] (crm_log_init) info: Changed active directory to /var/lib/pacemaker/cores
Oct 08 20:02:53 pplxnsms02 pacemaker-based [2388] (main) notice: Starting Pacemaker CIB manager
Oct 08 20:02:53 pplxnsms02 pacemaker-based [2388] (get_cluster_type) info: Verifying cluster type: 'corosync'
Oct 08 20:02:53 pplxnsms02 pacemaker-based [2388] (get_cluster_type) info: Assuming an active 'corosync' cluster
Oct 08 20:02:53 pplxnsms02 pacemaker-fenced [2389] (crm_log_init) info: Changed active directory to /var/lib/pacemaker/cores
Oct 08 20:02:53 pplxnsms02 pacemaker-fenced [2389] (main) notice: Starting Pacemaker fencer
Oct 08 20:02:53 pplxnsms02 pacemaker-fenced [2389] (get_cluster_type) info: Verifying cluster type: 'corosync'
Oct 08 20:02:53 pplxnsms02 pacemaker-fenced [2389] (get_cluster_type) info: Assuming an active 'corosync' cluster
Oct 08 20:02:53 pplxnsms02 pacemaker-fenced [2389] (crm_cluster_connect) notice: Connecting to corosync cluster infrastructure
Oct 08 20:02:53 pplxnsms02 pacemaker-schedulerd[2393] (crm_log_init) info: Changed active directory to /var/lib/pacemaker/cores
Oct 08 20:02:53 pplxnsms02 pacemaker-schedulerd[2393] (main) notice: Starting Pacemaker scheduler
Oct 08 20:02:53 pplxnsms02 pacemaker-schedulerd[2393] (qb_ipcs_us_publish) info: server name: pengine
Oct 08 20:02:53 pplxnsms02 pacemaker-schedulerd[2393] (main) notice: Pacemaker scheduler successfully started and accepting connections
Oct 08 20:02:53 pplxnsms02 pacemaker-fenced [2389] (crm_get_peer) info: Created entry f6169684-b326-4bba-b2f0-04c50139bcc3/0x55d7e506a970 for node pplxnsms02/2 (1 total)
Oct 08 20:02:53 pplxnsms02 pacemaker-fenced [2389] (crm_get_peer) info: Node 2 is now known as pplxnsms02
Oct 08 20:02:53 pplxnsms02 pacemaker-fenced [2389] (crm_get_peer) info: Node 2 has uuid 2
Oct 08 20:02:53 pplxnsms02 pacemaker-fenced [2389] (crm_update_peer_proc) info: cluster_connect_cpg: Node pplxnsms02[2] - corosync-cpg is now online
Oct 08 20:02:53 pplxnsms02 pacemaker-fenced [2389] (update_peer_state_iter) notice: Node pplxnsms02 state is now member | nodeid=2 previous=unknown source=crm_update_peer_proc
Oct 08 20:02:53 pplxnsms02 pacemaker-fenced [2389] (pcmk__corosync_connect) info: Connection to corosync established
Oct 08 20:02:53 pplxnsms02 pacemaker-based [2388] (retrieveCib) info: Reading cluster configuration file /var/lib/pacemaker/cib/cib.xml (digest: /var/lib/pacemaker/cib/cib.xml.sig)
Oct 08 20:02:53 pplxnsms02 pacemaker-fenced [2389] (cib_native_signon_raw) info: Could not connect to CIB manager for stonithd
Oct 08 20:02:53 pplxnsms02 pacemaker-fenced [2389] (cib_native_signon_raw) info: Connection to CIB manager for stonithd failed: Transport endpoint is not connected
Oct 08 20:02:53 pplxnsms02 pacemaker-execd [2390] (crm_log_init) info: Changed active directory to /var/lib/pacemaker/cores
Oct 08 20:02:53 pplxnsms02 pacemaker-execd [2390] (main) notice: Starting Pacemaker local executor
Oct 08 20:02:53 pplxnsms02 pacemaker-execd [2390] (qb_ipcs_us_publish) info: server name: lrmd
Oct 08 20:02:53 pplxnsms02 pacemaker-execd [2390] (main) notice: Pacemaker local executor successfully started and accepting connections
Oct 08 20:02:53 pplxnsms02 pacemaker-execd [2390] (main) notice: OCF resource agent search path is /usr/lib/ocf/resource.d
Oct 08 20:02:53 pplxnsms02 pacemaker-attrd [2392] (crm_log_init) info: Changed active directory to /var/lib/pacemaker/cores
Oct 08 20:02:53 pplxnsms02 pacemaker-attrd [2392] (main) notice: Starting Pacemaker node attribute manager
Oct 08 20:02:53 pplxnsms02 pacemaker-attrd [2392] (cib_native_signon_raw) info: Could not connect to CIB manager for attrd
Oct 08 20:02:53 pplxnsms02 pacemaker-attrd [2392] (cib_native_signon_raw) info: Connection to CIB manager for attrd failed: Transport endpoint is not connected
Oct 08 20:02:53 pplxnsms02 pacemaker-controld [2394] (crm_log_init) info: Changed active directory to /var/lib/pacemaker/cores
Oct 08 20:02:53 pplxnsms02 pacemaker-controld [2394] (main) notice: Starting Pacemaker controller
Oct 08 20:02:53 pplxnsms02 pacemaker-controld [2394] (do_log) info: Input I_STARTUP received in state S_STARTING from crmd_init
Oct 08 20:02:53 pplxnsms02 pacemaker-controld [2394] (cib_native_signon_raw) info: Could not connect to CIB manager for crmd
Oct 08 20:02:53 pplxnsms02 pacemaker-controld [2394] (cib_native_signon_raw) info: Connection to CIB manager for crmd failed: Transport endpoint is not connected
Oct 08 20:02:53 pplxnsms02 pacemaker-based [2388] (crm_cluster_connect) notice: Connecting to corosync cluster infrastructure
Oct 08 20:02:53 pplxnsms02 pacemaker-based [2388] (crm_get_peer) info: Created entry e9c5ba47-0bf9-4964-9c6e-bbd9815be788/0x559ac6825d60 for node pplxnsms02/2 (1 total)
Oct 08 20:02:53 pplxnsms02 pacemaker-based [2388] (crm_get_peer) info: Node 2 is now known as pplxnsms02
Oct 08 20:02:53 pplxnsms02 pacemaker-based [2388] (crm_get_peer) info: Node 2 has uuid 2
Oct 08 20:02:53 pplxnsms02 pacemaker-based [2388] (crm_update_peer_proc) info: cluster_connect_cpg: Node pplxnsms02[2] - corosync-cpg is now online
Oct 08 20:02:53 pplxnsms02 pacemaker-based [2388] (update_peer_state_iter) notice: Node pplxnsms02 state is now member | nodeid=2 previous=unknown source=crm_update_peer_proc
Oct 08 20:02:53 pplxnsms02 pacemaker-based [2388] (pcmk__corosync_connect) info: Connection to corosync established
Oct 08 20:02:53 pplxnsms02 pacemaker-based [2388] (qb_ipcs_us_publish) info: server name: cib_ro
Oct 08 20:02:53 pplxnsms02 pacemaker-based [2388] (qb_ipcs_us_publish) info: server name: cib_rw
Oct 08 20:02:53 pplxnsms02 pacemaker-based [2388] (qb_ipcs_us_publish) info: server name: cib_shm
Oct 08 20:02:53 pplxnsms02 pacemaker-based [2388] (main) notice: Pacemaker CIB manager successfully started and accepting connections
Oct 08 20:02:53 pplxnsms02 pacemaker-based [2388] (pcmk_cpg_membership) info: Group cib event 0: node 2 pid 2388 joined via cpg_join
Oct 08 20:02:53 pplxnsms02 pacemaker-based [2388] (pcmk_cpg_membership) info: Group cib event 0: pplxnsms02 (node 2 pid 2388) is member
Oct 08 20:02:53 pplxnsms02 pacemaker-based [2388] (cib_file_backup) info: Archived previous version as /var/lib/pacemaker/cib/cib-39.raw
Oct 08 20:02:53 pplxnsms02 pacemaker-based [2388] (cib_file_write_with_digest) info: Wrote version 0.524.0 of the CIB to disk (digest: 15d4fda4c9a4a8aec876f87c5ea7f745)
Oct 08 20:02:53 pplxnsms02 pacemaker-based [2388] (cib_file_write_with_digest) info: Reading cluster configuration file /var/lib/pacemaker/cib/cib.YtYKij (digest: /var/lib/pacemaker/cib/cib.5uiZcA)
Oct 08 20:02:54 pplxnsms02 pacemaker-controld [2394] (cib_native_signon_raw) info: Successfully connected to CIB manager for crmd
Oct 08 20:02:54 pplxnsms02 pacemaker-attrd [2392] (cib_native_signon_raw) info: Successfully connected to CIB manager for attrd
Oct 08 20:02:54 pplxnsms02 pacemaker-fenced [2389] (cib_native_signon_raw) info: Successfully connected to CIB manager for stonithd
Oct 08 20:02:54 pplxnsms02 pacemaker-controld [2394] (get_cluster_type) info: Verifying cluster type: 'corosync'
Oct 08 20:02:54 pplxnsms02 pacemaker-controld [2394] (get_cluster_type) info: Assuming an active 'corosync' cluster
Oct 08 20:02:54 pplxnsms02 pacemaker-controld [2394] (crm_cluster_connect) notice: Connecting to corosync cluster infrastructure
Oct 08 20:02:54 pplxnsms02 pacemaker-attrd [2392] (main) info: CIB connection active
Oct 08 20:02:54 pplxnsms02 pacemaker-attrd [2392] (get_cluster_type) info: Verifying cluster type: 'corosync'
Oct 08 20:02:54 pplxnsms02 pacemaker-attrd [2392] (get_cluster_type) info: Assuming an active 'corosync' cluster
Oct 08 20:02:54 pplxnsms02 pacemaker-attrd [2392] (crm_cluster_connect) notice: Connecting to corosync cluster infrastructure
Oct 08 20:02:54 pplxnsms02 pacemaker-fenced [2389] (setup_cib) info: Watching for fencing topology changes
Oct 08 20:02:54 pplxnsms02 pacemaker-fenced [2389] (qb_ipcs_us_publish) info: server name: stonith-ng
Oct 08 20:02:54 pplxnsms02 pacemaker-fenced [2389] (main) notice: Pacemaker fencer successfully started and accepting connections
Oct 08 20:02:54 pplxnsms02 pacemaker-fenced [2389] (pcmk_cpg_membership) info: Group stonith-ng event 0: node 2 pid 2389 joined via cpg_join
Oct 08 20:02:54 pplxnsms02 pacemaker-fenced [2389] (pcmk_cpg_membership) info: Group stonith-ng event 0: pplxnsms02 (node 2 pid 2389) is member
Oct 08 20:02:54 pplxnsms02 pacemaker-fenced [2389] (init_cib_cache_cb) info: Updating device list from CIB
Oct 08 20:02:54 pplxnsms02 pacemaker-fenced [2389] (cib_devices_update) info: Updating devices to version 0.524.0
Oct 08 20:02:54 pplxnsms02 pacemaker-fenced [2389] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 08 20:02:54 pplxnsms02 pacemaker-fenced [2389] (unpack_config) notice: On loss of quorum: Ignore
Oct 08 20:02:54 pplxnsms02 pacemaker-attrd [2392] (crm_get_peer) info: Created entry a4f4d801-5eb8-4845-9076-10e91dec93ac/0x56134e2f7bd0 for node pplxnsms02/2 (1 total)
Oct 08 20:02:54 pplxnsms02 pacemaker-attrd [2392] (crm_get_peer) info: Node 2 is now known as pplxnsms02
Oct 08 20:02:54 pplxnsms02 pacemaker-controld [2394] (crm_get_peer) info: Created entry c2175201-f5d5-42e0-b6f6-4a99506c5680/0x565393b470b0 for node pplxnsms02/2 (1 total)
Oct 08 20:02:54 pplxnsms02 pacemaker-controld [2394] (crm_get_peer) info: Node 2 is now known as pplxnsms02
Oct 08 20:02:54 pplxnsms02 pacemaker-controld [2394] (peer_update_callback) info: Cluster node pplxnsms02 is now in unknown state
Oct 08 20:02:54 pplxnsms02 pacemaker-attrd [2392] (crm_get_peer) info: Node 2 has uuid 2
Oct 08 20:02:54 pplxnsms02 pacemaker-attrd [2392] (crm_update_peer_proc) info: cluster_connect_cpg: Node pplxnsms02[2] - corosync-cpg is now online
Oct 08 20:02:54 pplxnsms02 pacemaker-attrd [2392] (update_peer_state_iter) notice: Node pplxnsms02 state is now member | nodeid=2 previous=unknown source=crm_update_peer_proc
Oct 08 20:02:54 pplxnsms02 pacemaker-attrd [2392] (pcmk__corosync_connect) info: Connection to corosync established
Oct 08 20:02:54 pplxnsms02 pacemaker-controld [2394] (crm_get_peer) info: Node 2 has uuid 2
Oct 08 20:02:54 pplxnsms02 pacemaker-controld [2394] (crm_update_peer_proc) info: cluster_connect_cpg: Node pplxnsms02[2] - corosync-cpg is now online
Oct 08 20:02:54 pplxnsms02 pacemaker-attrd [2392] (main) info: Cluster connection active
Oct 08 20:02:54 pplxnsms02 pacemaker-attrd [2392] (attrd_erase_attrs) info: Clearing transient attributes from CIB | xpath=//node_state[@uname='pplxnsms02']/transient_attributes
Oct 08 20:02:54 pplxnsms02 pacemaker-controld [2394] (peer_update_callback) info: Node pplxnsms02 is now a peer | DC= old=0x0000000 new=0x4000000
Oct 08 20:02:54 pplxnsms02 pacemaker-controld [2394] (te_trigger_stonith_history_sync) info: Fence history will be synchronized cluster-wide within 5 seconds
Oct 08 20:02:54 pplxnsms02 pacemaker-controld [2394] (pcmk__corosync_connect) info: Connection to corosync established
Oct 08 20:02:54 pplxnsms02 pacemaker-based [2388] (cib_process_request) info: Forwarding cib_delete operation for section //node_state[@uname='pplxnsms02']/transient_attributes to all (origin=local/attrd/2)
Oct 08 20:02:54 pplxnsms02 pacemaker-attrd [2392] (qb_ipcs_us_publish) info: server name: attrd
Oct 08 20:02:54 pplxnsms02 pacemaker-attrd [2392] (main) notice: Pacemaker node attribute manager successfully started and accepting connections
Oct 08 20:02:54 pplxnsms02 pacemaker-controld [2394] (pcmk__corosync_quorum_connect) warning: No quorum
Oct 08 20:02:54 pplxnsms02 pacemaker-attrd [2392] (pcmk_cpg_membership) info: Group attrd event 0: node 2 pid 2392 joined via cpg_join
Oct 08 20:02:54 pplxnsms02 pacemaker-attrd [2392] (pcmk_cpg_membership) info: Group attrd event 0: pplxnsms02 (node 2 pid 2392) is member
Oct 08 20:02:54 pplxnsms02 pacemaker-attrd [2392] (attrd_peer_update) notice: Setting #attrd-protocol[pplxnsms02]: (unset) -> 3 | from pplxnsms02
Oct 08 20:02:54 pplxnsms02 pacemaker-attrd [2392] (attrd_start_election_if_needed) info: Starting an election to determine the writer
Oct 08 20:02:54 pplxnsms02 pacemaker-controld [2394] (crm_get_peer) info: Created entry 955bbef8-416c-43e7-91b1-9233cfd3845e/0x565393b4a7e0 for node pplxnsms01/1 (2 total)
Oct 08 20:02:54 pplxnsms02 pacemaker-controld [2394] (crm_get_peer) info: Node 1 is now known as pplxnsms01
Oct 08 20:02:54 pplxnsms02 pacemaker-controld [2394] (peer_update_callback) info: Cluster node pplxnsms01 is now in unknown state
Oct 08 20:02:54 pplxnsms02 pacemaker-controld [2394] (crm_get_peer) info: Node 1 has uuid 1
Oct 08 20:02:54 pplxnsms02 pacemaker-attrd [2392] (election_check) info: election-attrd won by local node
Oct 08 20:02:54 pplxnsms02 pacemaker-attrd [2392] (attrd_declare_winner) notice: Recorded local node as attribute writer (was unset)
Oct 08 20:02:54 pplxnsms02 pacemaker-attrd [2392] (write_attribute) info: Processed 1 private change for #attrd-protocol, id=n/a, set=n/a
Oct 08 20:02:54 pplxnsms02 pacemaker-controld [2394] (do_ha_control) info: Connected to the cluster
Oct 08 20:02:54 pplxnsms02 pacemaker-controld [2394] (lrmd_ipc_connect) info: Connecting to executor
Oct 08 20:02:54 pplxnsms02 pacemaker-controld [2394] (try_local_executor_connect) info: Connection to the local executor established
Oct 08 20:02:54 pplxnsms02 pacemaker-controld [2394] (do_started) info: Delaying start, no membership data (0000000000100000)
Oct 08 20:02:54 pplxnsms02 pacemaker-controld [2394] (do_started) info: Delaying start, no membership data (0000000000100000)
Oct 08 20:02:54 pplxnsms02 pacemaker-controld [2394] (quorum_notification_cb) info: Quorum still lost | membership=1320 members=1
Oct 08 20:02:54 pplxnsms02 pacemaker-controld [2394] (update_peer_state_iter) notice: Node pplxnsms02 state is now member | nodeid=2 previous=unknown source=quorum_notification_cb
Oct 08 20:02:54 pplxnsms02 pacemaker-controld [2394] (peer_update_callback) info: Cluster node pplxnsms02 is now member (was in unknown state)
Oct 08 20:02:54 pplxnsms02 pacemaker-controld [2394] (pcmk__reap_unseen_nodes) info: State of node pplxnsms01[1] is still unknown
Oct 08 20:02:54 pplxnsms02 pacemaker-controld [2394] (do_started) info: Delaying start, Config not read (0000000000000040)
Oct 08 20:02:54 pplxnsms02 pacemaker-controld [2394] (pcmk_cpg_membership) info: Group crmd event 0: node 2 pid 2394 joined via cpg_join
Oct 08 20:02:54 pplxnsms02 pacemaker-controld [2394] (pcmk_cpg_membership) info: Group crmd event 0: pplxnsms02 (node 2 pid 2394) is member
Oct 08 20:02:54 pplxnsms02 pacemaker-controld [2394] (do_started) info: Delaying start, Config not read (0000000000000040)
Oct 08 20:02:54 pplxnsms02 pacemaker-controld [2394] (do_started) info: Delaying start, Config not read (0000000000000040)
Oct 08 20:02:54 pplxnsms02 pacemaker-based [2388] (cib_process_request) info: Completed cib_delete operation for section //node_state[@uname='pplxnsms02']/transient_attributes: OK (rc=0, origin=pplxnsms02/attrd/2, version=0.524.0)
Oct 08 20:02:54 pplxnsms02 pacemaker-based [2388] (cib_process_request) info: Forwarding cib_modify operation for section nodes to all (origin=local/crmd/4)
Oct 08 20:02:54 pplxnsms02 pacemaker-controld [2394] (qb_ipcs_us_publish) info: server name: crmd
Oct 08 20:02:54 pplxnsms02 pacemaker-controld [2394] (do_started) notice: Pacemaker controller successfully started and accepting connections
Oct 08 20:02:54 pplxnsms02 pacemaker-controld [2394] (do_log) info: Input I_PENDING received in state S_STARTING from do_started
Oct 08 20:02:54 pplxnsms02 pacemaker-controld [2394] (do_state_transition) notice: State transition S_STARTING -> S_PENDING | input=I_PENDING cause=C_FSA_INTERNAL origin=do_started
Oct 08 20:02:54 pplxnsms02 pacemaker-based [2388] (cib_process_request) info: Completed cib_modify operation for section nodes: OK (rc=0, origin=pplxnsms02/crmd/4, version=0.524.0)
Oct 08 20:02:54 pplxnsms02 pacemaker-fenced [2389] (wait_for_sync_result) info: fence_sbd_metadata_1[2485] exited with status 0
Oct 08 20:02:54 pplxnsms02 pacemaker-fenced [2389] (stonith_device_register) notice: Added 'fence-sbd' to device list (1 active device)
Oct 08 20:02:55 pplxnsms02 pacemaker-controld [2394] (te_trigger_stonith_history_sync) info: Fence history will be synchronized cluster-wide within 30 seconds
Oct 08 20:02:55 pplxnsms02 pacemaker-controld [2394] (te_connect_stonith) notice: Fencer successfully connected
Oct 08 20:03:15 pplxnsms02 pacemaker-controld [2394] (crm_timer_popped) info: Election Trigger just popped | input=I_DC_TIMEOUT time=20000ms
Oct 08 20:03:15 pplxnsms02 pacemaker-controld [2394] (do_log) warning: Input I_DC_TIMEOUT received in state S_PENDING from crm_timer_popped
Oct 08 20:03:15 pplxnsms02 pacemaker-controld [2394] (do_state_transition) info: State transition S_PENDING -> S_ELECTION | input=I_DC_TIMEOUT cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 08 20:03:15 pplxnsms02 pacemaker-controld [2394] (election_check) info: election-DC won by local node
Oct 08 20:03:15 pplxnsms02 pacemaker-controld [2394] (do_log) info: Input I_ELECTION_DC received in state S_ELECTION from election_win_cb
Oct 08 20:03:15 pplxnsms02 pacemaker-controld [2394] (do_state_transition) notice: State transition S_ELECTION -> S_INTEGRATION | input=I_ELECTION_DC cause=C_FSA_INTERNAL origin=election_win_cb
Oct 08 20:03:15 pplxnsms02 pacemaker-controld [2394] (do_te_control) info: Registering TE UUID: 1d0c450c-ecfb-4a6e-aef1-ba7a7da138ea
Oct 08 20:03:15 pplxnsms02 pacemaker-controld [2394] (pcmk__pid_active) info: Could not read from /proc/1719/exe: Permission denied | errno=13
Oct 08 20:03:15 pplxnsms02 pacemaker-controld [2394] (do_dc_takeover) info: Taking over DC status for this partition
Oct 08 20:03:15 pplxnsms02 pacemaker-based [2388] (cib_process_readwrite) info: We are now in R/W mode
Oct 08 20:03:15 pplxnsms02 pacemaker-based [2388] (cib_process_request) info: Completed cib_master operation for section 'all': OK (rc=0, origin=local/crmd/7, version=0.524.0)
Oct 08 20:03:15 pplxnsms02 pacemaker-based [2388] (cib_process_request) info: Forwarding cib_modify operation for section cib to all (origin=local/crmd/8)
Oct 08 20:03:15 pplxnsms02 pacemaker-based [2388] (cib_process_request) info: Completed cib_modify operation for section cib: OK (rc=0, origin=pplxnsms02/crmd/8, version=0.524.0)
Oct 08 20:03:15 pplxnsms02 pacemaker-based [2388] (cib_process_request) info: Forwarding cib_modify operation for section crm_config to all (origin=local/crmd/10)
Oct 08 20:03:15 pplxnsms02 pacemaker-based [2388] (cib_process_request) info: Completed cib_modify operation for section crm_config: OK (rc=0, origin=pplxnsms02/crmd/10, version=0.524.0)
Oct 08 20:03:15 pplxnsms02 pacemaker-based [2388] (cib_process_request) info: Forwarding cib_modify operation for section crm_config to all (origin=local/crmd/12)
Oct 08 20:03:15 pplxnsms02 pacemaker-controld [2394] (join_make_offer) info: Making join-1 offers based on membership event 1320
Oct 08 20:03:15 pplxnsms02 pacemaker-controld [2394] (join_make_offer) info: Sending join-1 offer to pplxnsms02
Oct 08 20:03:15 pplxnsms02 pacemaker-controld [2394] (join_make_offer) info: Not making join-1 offer to inactive node pplxnsms01
Oct 08 20:03:15 pplxnsms02 pacemaker-controld [2394] (do_dc_join_offer_all) info: Waiting on join-1 requests from 1 outstanding node
Oct 08 20:03:15 pplxnsms02 pacemaker-controld [2394] (update_dc) info: Set DC to pplxnsms02 (3.13.0)
Oct 08 20:03:15 pplxnsms02 pacemaker-controld [2394] (pcmk__update_peer_expected) info: update_dc: Node pplxnsms02[2] - expected state is now member (was (null))
Oct 08 20:03:15 pplxnsms02 pacemaker-based [2388] (cib_process_request) info: Completed cib_modify operation for section crm_config: OK (rc=0, origin=pplxnsms02/crmd/12, version=0.524.0)
Oct 08 20:03:15 pplxnsms02 pacemaker-based [2388] (cib_process_request) info: Forwarding cib_modify operation for section crm_config to all (origin=local/crmd/14)
Oct 08 20:03:15 pplxnsms02 pacemaker-controld [2394] (stonith__watchdog_fencing_enabled_for_node_api) notice: Cluster does not have watchdog fencing device
Oct 08 20:03:15 pplxnsms02 pacemaker-controld [2394] (do_state_transition) info: State transition S_INTEGRATION -> S_FINALIZE_JOIN | input=I_INTEGRATED cause=C_FSA_INTERNAL origin=check_join_state
Oct 08 20:03:15 pplxnsms02 pacemaker-based [2388] (cib_process_request) info: Completed cib_modify operation for section crm_config: OK (rc=0, origin=pplxnsms02/crmd/14, version=0.524.0)
Oct 08 20:03:15 pplxnsms02 pacemaker-controld [2394] (controld_delete_node_state) info: Deleting resource history for node pplxnsms02 (via CIB call 19) | xpath=//node_state[@uname='pplxnsms02']/lrm
Oct 08 20:03:15 pplxnsms02 pacemaker-based [2388] (cib_process_replace) info: Digest matched on replace from pplxnsms02: 3ee2a3044e50b4f9747d375984348bab
Oct 08 20:03:15 pplxnsms02 pacemaker-based [2388] (cib_process_replace) info: Replaced 0.524.0 with 0.524.0 from pplxnsms02
Oct 08 20:03:15 pplxnsms02 pacemaker-based [2388] (cib_process_request) info: Completed cib_replace operation for section 'all': OK (rc=0, origin=pplxnsms02/crmd/17, version=0.524.0)
Oct 08 20:03:15 pplxnsms02 pacemaker-based [2388] (cib_process_request) info: Forwarding cib_modify operation for section nodes to all (origin=local/crmd/18)
Oct 08 20:03:15 pplxnsms02 pacemaker-based [2388] (cib_process_request) info: Forwarding cib_delete operation for section //node_state[@uname='pplxnsms02']/lrm to all (origin=local/crmd/19)
Oct 08 20:03:15 pplxnsms02 pacemaker-based [2388] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/20)
Oct 08 20:03:15 pplxnsms02 pacemaker-based [2388] (cib_process_request) info: Completed cib_modify operation for section nodes: OK (rc=0, origin=pplxnsms02/crmd/18, version=0.524.0)
Oct 08 20:03:15 pplxnsms02 pacemaker-based [2388] (cib_process_request) info: Completed cib_delete operation for section //node_state[@uname='pplxnsms02']/lrm: OK (rc=0, origin=pplxnsms02/crmd/19, version=0.524.0)
Oct 08 20:03:15 pplxnsms02 pacemaker-based [2388] (cib_perform_op) info: Diff: --- 0.524.0 2
Oct 08 20:03:15 pplxnsms02 pacemaker-based [2388] (cib_perform_op) info: Diff: +++ 0.524.1 (null)
Oct 08 20:03:15 pplxnsms02 pacemaker-based [2388] (cib_perform_op) info: + /cib: @num_updates=1
Oct 08 20:03:15 pplxnsms02 pacemaker-based [2388] (cib_perform_op) info: ++ /cib/status:
Oct 08 20:03:15 pplxnsms02 pacemaker-based [2388] (cib_perform_op) info: ++
Oct 08 20:03:15 pplxnsms02 pacemaker-based [2388] (cib_perform_op) info: ++
Oct 08 20:03:15 pplxnsms02 pacemaker-based [2388] (cib_perform_op) info: ++
Oct 08 20:03:15 pplxnsms02 pacemaker-based [2388] (cib_perform_op) info: ++
Oct 08 20:03:15 pplxnsms02 pacemaker-based [2388] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/20, version=0.524.1)
Oct 08 20:03:15 pplxnsms02 pacemaker-controld [2394] (do_state_transition) info: State transition S_FINALIZE_JOIN -> S_POLICY_ENGINE | input=I_FINALIZED cause=C_FSA_INTERNAL origin=check_join_state
Oct 08 20:03:15 pplxnsms02 pacemaker-controld [2394] (create_node_state_update) info: Node update for pplxnsms01 cancelled: no state, not seen yet
Oct 08 20:03:15 pplxnsms02 pacemaker-controld [2394] (abort_transition_graph) info: Transition -1 aborted: Quorum lost | source=crm_update_quorum:435 complete=true
Oct 08 20:03:15 pplxnsms02 pacemaker-controld [2394] (abort_transition_graph) info: Transition -1 aborted: Peer Cancelled | source=do_te_invoke:129 complete=true
Oct 08 20:03:15 pplxnsms02 pacemaker-based [2388] (cib_process_request) info: Forwarding cib_modify operation for section nodes to all (origin=local/crmd/23)
Oct 08 20:03:15 pplxnsms02 pacemaker-based [2388] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/24)
Oct 08 20:03:15 pplxnsms02 pacemaker-based [2388] (cib_process_request) info: Forwarding cib_modify operation for section cib to all (origin=local/crmd/25)
Oct 08 20:03:15 pplxnsms02 pacemaker-based [2388] (cib_process_request) info: Completed cib_modify operation for section nodes: OK (rc=0, origin=pplxnsms02/crmd/23, version=0.524.1)
Oct 08 20:03:15 pplxnsms02 pacemaker-based [2388] (cib_perform_op) info: Diff: --- 0.524.1 2
Oct 08 20:03:15 pplxnsms02 pacemaker-based [2388] (cib_perform_op) info: Diff: +++ 0.524.2 (null)
Oct 08 20:03:15 pplxnsms02 pacemaker-based [2388] (cib_perform_op) info: + /cib: @num_updates=2
Oct 08 20:03:15 pplxnsms02 pacemaker-based [2388] (cib_perform_op) info: + /cib/status/node_state[@id='2']: @crm-debug-origin=do_state_transition, @join=member, @expected=member
Oct 08 20:03:15 pplxnsms02 pacemaker-based [2388] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/24, version=0.524.2)
Oct 08 20:03:15 pplxnsms02 pacemaker-based [2388] (cib_perform_op) info: Diff: --- 0.524.2 2
Oct 08 20:03:15 pplxnsms02 pacemaker-based [2388] (cib_perform_op) info: Diff: +++ 0.524.3 (null)
Oct 08 20:03:15 pplxnsms02 pacemaker-based [2388] (cib_perform_op) info: + /cib: @num_updates=3, @have-quorum=0, @dc-uuid=2
Oct 08 20:03:15 pplxnsms02 pacemaker-based [2388] (cib_process_request) info: Completed cib_modify operation for section cib: OK (rc=0, origin=pplxnsms02/crmd/25, version=0.524.3)
Oct 08 20:03:15 pplxnsms02 pacemaker-schedulerd[2393] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 08 20:03:15 pplxnsms02 pacemaker-schedulerd[2393] (unpack_config) notice: On loss of quorum: Ignore
Oct 08 20:03:15 pplxnsms02 pacemaker-schedulerd[2393] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 08 20:03:15 pplxnsms02 pacemaker-schedulerd[2393] (determine_online_status) info: Node pplxnsms02 is online
Oct 08 20:03:15 pplxnsms02 pacemaker-schedulerd[2393] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 08 20:03:15 pplxnsms02 pacemaker-schedulerd[2393] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 08 20:03:15 pplxnsms02 pacemaker-schedulerd[2393] (RecurringOp) info: Start recurring monitor (10s) for itm_vip on pplxnsms02
Oct 08 20:03:15 pplxnsms02 pacemaker-schedulerd[2393] (RecurringOp) info: Start recurring monitor (30s) for itm_lvm on pplxnsms02
Oct 08 20:03:15 pplxnsms02 pacemaker-schedulerd[2393] (RecurringOp) info: Start recurring monitor (20s) for itm_fs on pplxnsms02
Oct 08 20:03:15 pplxnsms02 pacemaker-schedulerd[2393] (RecurringOp) info: Start recurring monitor (20s) for itm_fs2 on pplxnsms02
Oct 08 20:03:15 pplxnsms02 pacemaker-schedulerd[2393] (RecurringOp) info: Start recurring monitor (20s) for itm_fs3 on pplxnsms02
Oct 08 20:03:15 pplxnsms02 pacemaker-schedulerd[2393] (RecurringOp) info: Start recurring monitor (20s) for nco_db2 on pplxnsms02
Oct 08 20:03:15 pplxnsms02 pacemaker-schedulerd[2393] (RecurringOp) info: Start recurring monitor (60s) for nco_omni on pplxnsms02
Oct 08 20:03:15 pplxnsms02 pacemaker-schedulerd[2393] (RecurringOp) info: Start recurring monitor (300s) for nco_itnm on pplxnsms02
Oct 08 20:03:15 pplxnsms02 pacemaker-schedulerd[2393] (RecurringOp) info: Start recurring monitor (10s) for nco_cognos on pplxnsms02
Oct 08 20:03:15 pplxnsms02 pacemaker-schedulerd[2393] (RecurringOp) info: Start recurring monitor (10s) for siem_vip on pplxnsms02
Oct 08 20:03:15 pplxnsms02 pacemaker-schedulerd[2393] (RecurringOp) info: Start recurring monitor (30s) for siem_lvm on pplxnsms02
Oct 08 20:03:15 pplxnsms02 pacemaker-schedulerd[2393] (RecurringOp) info: Start recurring monitor (20s) for siem_fs on pplxnsms02
Oct 08 20:03:15 pplxnsms02 pacemaker-schedulerd[2393] (RecurringOp) info: Start recurring monitor (10s) for siem_rsyslog on pplxnsms02
Oct 08 20:03:15 pplxnsms02 pacemaker-schedulerd[2393] (RecurringOp) info: Start recurring monitor (60s) for fence-sbd on pplxnsms02
Oct 08 20:03:15 pplxnsms02 pacemaker-schedulerd[2393] (stage6) warning: Scheduling Node pplxnsms01 for STONITH
Oct 08 20:03:15 pplxnsms02 pacemaker-schedulerd[2393] (log_list_item) notice: Actions: Fence (reboot) pplxnsms01 'node is unclean'
Oct 08 20:03:15 pplxnsms02 pacemaker-schedulerd[2393] (log_list_item) notice: Actions: Start itm_vip ( pplxnsms02 )
Oct 08 20:03:15 pplxnsms02 pacemaker-schedulerd[2393] (log_list_item) notice: Actions: Start itm_lvm ( pplxnsms02 )
Oct 08 20:03:15 pplxnsms02 pacemaker-schedulerd[2393] (log_list_item) notice: Actions: Start itm_fs ( pplxnsms02 )
Oct 08 20:03:15 pplxnsms02 pacemaker-schedulerd[2393] (log_list_item) notice: Actions: Start itm_fs2 ( pplxnsms02 )
Oct 08 20:03:15 pplxnsms02 pacemaker-schedulerd[2393] (log_list_item) notice: Actions: Start itm_fs3 ( pplxnsms02 )
Oct 08 20:03:15 pplxnsms02 pacemaker-schedulerd[2393] (log_list_item) notice: Actions: Start nco_db2 ( pplxnsms02 )
Oct 08 20:03:15 pplxnsms02 pacemaker-schedulerd[2393] (log_list_item) notice: Actions: Start nco_omni ( pplxnsms02 )
Oct 08 20:03:15 pplxnsms02 pacemaker-schedulerd[2393] (log_list_item) notice: Actions: Start nco_itnm ( pplxnsms02 )
Oct 08 20:03:15 pplxnsms02 pacemaker-schedulerd[2393] (log_list_item) notice: Actions: Start nco_cognos ( pplxnsms02 )
Oct 08 20:03:15 pplxnsms02 pacemaker-schedulerd[2393] (log_list_item) notice: Actions: Start siem_vip ( pplxnsms02 )
Oct 08 20:03:15 pplxnsms02 pacemaker-schedulerd[2393] (log_list_item) notice: Actions: Start siem_lvm ( pplxnsms02 )
Oct 08 20:03:15 pplxnsms02 pacemaker-schedulerd[2393] (log_list_item) notice: Actions: Start siem_fs ( pplxnsms02 )
Oct 08 20:03:15 pplxnsms02 pacemaker-schedulerd[2393] (log_list_item) notice: Actions: Start siem_rsyslog ( pplxnsms02 )
Oct 08 20:03:15 pplxnsms02 pacemaker-schedulerd[2393] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 08 20:03:15 pplxnsms02 pacemaker-schedulerd[2393] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 08 20:03:15 pplxnsms02 pacemaker-schedulerd[2393] (log_list_item) notice: Actions: Start fence-sbd ( pplxnsms02 )
Oct 08 20:03:15 pplxnsms02 pacemaker-based [2388] (cib_file_backup) info: Archived previous version as /var/lib/pacemaker/cib/cib-40.raw
Oct 08 20:03:15 pplxnsms02 pacemaker-based [2388] (cib_file_write_with_digest) info: Wrote version 0.524.0 of the CIB to disk (digest: a70d6d7a65c6e5cdd9957a3f9ee9c127)
Oct 08 20:03:15 pplxnsms02 pacemaker-based [2388] (cib_file_write_with_digest) info: Reading cluster configuration file /var/lib/pacemaker/cib/cib.ggS4ZK (digest: /var/lib/pacemaker/cib/cib.BPWobR)
Oct 08 20:03:15 pplxnsms02 pacemaker-schedulerd[2393] (pcmk__log_transition_summary) warning: Calculated transition 0 (with warnings), saving inputs in /var/lib/pacemaker/pengine/pe-warn-96.bz2
Oct 08 20:03:15 pplxnsms02 pacemaker-controld [2394] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 08 20:03:15 pplxnsms02 pacemaker-controld [2394] (do_te_invoke) info: Processing graph 0 (ref=pe_calc-dc-1728388995-8) derived from /var/lib/pacemaker/pengine/pe-warn-96.bz2
Oct 08 20:03:15 pplxnsms02 pacemaker-controld [2394] (te_rsc_command) notice: Initiating monitor operation itm_vip_monitor_0 locally on pplxnsms02 | action 1
Oct 08 20:03:15 pplxnsms02 pacemaker-execd [2390] (process_lrmd_get_rsc_info) info: Agent information for 'itm_vip' not in cache
Oct 08 20:03:15 pplxnsms02 pacemaker-execd [2390] (process_lrmd_rsc_register) info: Cached agent information for 'itm_vip'
Oct 08 20:03:15 pplxnsms02 pacemaker-controld [2394] (do_lrm_rsc_op) notice: Requesting local execution of probe operation for itm_vip on pplxnsms02 | transition_key=1:0:7:1d0c450c-ecfb-4a6e-aef1-ba7a7da138ea op_key=itm_vip_monitor_0
Oct 08 20:03:15 pplxnsms02 pacemaker-controld [2394] (wait_for_sync_result) info: IPaddr2_meta-data_0[3847] exited with status 0
Oct 08 20:03:15 pplxnsms02 pacemaker-based [2388] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/28)
Oct 08 20:03:15 pplxnsms02 pacemaker-controld [2394] (te_rsc_command) notice: Initiating monitor operation itm_lvm_monitor_0 locally on pplxnsms02 | action 2
Oct 08 20:03:15 pplxnsms02 pacemaker-execd [2390] (process_lrmd_get_rsc_info) info: Agent information for 'itm_lvm' not in cache
Oct 08 20:03:15 pplxnsms02 pacemaker-execd [2390] (process_lrmd_rsc_register) info: Cached agent information for 'itm_lvm'
Oct 08 20:03:15 pplxnsms02 pacemaker-based [2388] (cib_perform_op) info: Diff: --- 0.524.3 2
Oct 08 20:03:15 pplxnsms02 pacemaker-based [2388] (cib_perform_op) info: Diff: +++ 0.524.4 (null)
Oct 08 20:03:15 pplxnsms02 pacemaker-based [2388] (cib_perform_op) info: + /cib: @num_updates=4
Oct 08 20:03:15 pplxnsms02 pacemaker-based [2388] (cib_perform_op) info: + /cib/status/node_state[@id='2']: @crm-debug-origin=do_update_resource
Oct 08 20:03:15 pplxnsms02 pacemaker-controld [2394] (do_lrm_rsc_op) notice: Requesting local execution of probe operation for itm_lvm on pplxnsms02 | transition_key=2:0:7:1d0c450c-ecfb-4a6e-aef1-ba7a7da138ea op_key=itm_lvm_monitor_0
Oct 08 20:03:15 pplxnsms02 pacemaker-based [2388] (cib_perform_op) info: ++ /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources:
Oct 08 20:03:15 pplxnsms02 pacemaker-based [2388] (cib_perform_op) info: ++
Oct 08 20:03:15 pplxnsms02 pacemaker-based [2388] (cib_perform_op) info: ++
Oct 08 20:03:16 pplxnsms02 pacemaker-based [2388] (cib_perform_op) info: ++
Oct 08 20:03:16 pplxnsms02 pacemaker-controld [2394] (te_rsc_command) notice: Initiating monitor operation itm_fs2_monitor_0 locally on pplxnsms02 | action 4
Oct 08 20:03:16 pplxnsms02 pacemaker-execd [2390] (process_lrmd_get_rsc_info) info: Agent information for 'itm_fs2' not in cache
Oct 08 20:03:16 pplxnsms02 pacemaker-execd [2390] (process_lrmd_rsc_register) info: Cached agent information for 'itm_fs2'
Oct 08 20:03:16 pplxnsms02 pacemaker-controld [2394] (do_lrm_rsc_op) notice: Requesting local execution of probe operation for itm_fs2 on pplxnsms02 | transition_key=4:0:7:1d0c450c-ecfb-4a6e-aef1-ba7a7da138ea op_key=itm_fs2_monitor_0
Oct 08 20:03:16 pplxnsms02 pacemaker-based [2388] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/30, version=0.524.6)
Oct 08 20:03:16 pplxnsms02 pacemaker-based [2388] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/31)
Oct 08 20:03:16 pplxnsms02 pacemaker-based [2388] (cib_perform_op) info: Diff: --- 0.524.6 2
Oct 08 20:03:16 pplxnsms02 pacemaker-based [2388] (cib_perform_op) info: Diff: +++ 0.524.7 (null)
Oct 08 20:03:16 pplxnsms02 pacemaker-based [2388] (cib_perform_op) info: + /cib: @num_updates=7
Oct 08 20:03:16 pplxnsms02 pacemaker-based [2388] (cib_perform_op) info: ++ /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources:
Oct 08 20:03:16 pplxnsms02 pacemaker-based [2388] (cib_perform_op) info: ++
Oct 08 20:03:16 pplxnsms02 pacemaker-based [2388] (cib_perform_op) info: ++
Oct 08 20:03:16 pplxnsms02 pacemaker-based [2388] (cib_perform_op) info: ++
Oct 08 20:03:16 pplxnsms02 pacemaker-based [2388] (cib_perform_op) info: ++
Oct 08 20:03:16 pplxnsms02 pacemaker-based [2388] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/37, version=0.524.13)
Oct 08 20:03:16 pplxnsms02 pacemaker-controld [2394] (log_executor_event) notice: Result of probe operation for itm_fs on pplxnsms02: not running | CIB update 38, graph action confirmed; call=13 key=itm_fs_monitor_0 rc=7
Oct 08 20:03:16 pplxnsms02 pacemaker-based [2388] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/38)
Oct 08 20:03:16 pplxnsms02 pacemaker-based [2388] (cib_perform_op) info: Diff: --- 0.524.13 2
Oct 08 20:03:16 pplxnsms02 pacemaker-based [2388] (cib_perform_op) info: Diff: +++ 0.524.14 (null)
Oct 08 20:03:16 pplxnsms02 pacemaker-based [2388] (cib_perform_op) info: + /cib: @num_updates=14
Oct 08 20:03:16 pplxnsms02 pacemaker-based [2388] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='itm_fs']/lrm_rsc_op[@id='itm_fs_last_0']: @transition-magic=0:7;3:0:7:1d0c450c-ecfb-4a6e-aef1-ba7a7da138ea, @call-id=13, @rc-code=7, @op-status=0, @last-rc-change=1728388996, @exec-time=460
Oct 08 20:03:16 pplxnsms02 pacemaker-based [2388] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/38, version=0.524.14)
Oct 08 20:03:16 pplxnsms02 pacemaker-controld [2394] (process_graph_event) info: Transition 0 action 3 (itm_fs_monitor_0 on pplxnsms02) confirmed: not running | rc=7 call-id=13
Oct 08 20:03:16 pplxnsms02 pacemaker-controld [2394] (te_rsc_command) notice: Initiating monitor operation nco_itnm_monitor_0 locally on pplxnsms02 | action 8
Oct 08 20:03:16 pplxnsms02 pacemaker-execd [2390] (process_lrmd_get_rsc_info) info: Agent information for 'nco_itnm' not in cache
Oct 08 20:03:16 pplxnsms02 pacemaker-execd [2390] (process_lrmd_rsc_register) info: Cached agent information for 'nco_itnm'
Oct 08 20:03:16 pplxnsms02 pacemaker-controld [2394] (do_lrm_rsc_op) notice: Requesting local execution of probe operation for nco_itnm on pplxnsms02 | transition_key=8:0:7:1d0c450c-ecfb-4a6e-aef1-ba7a7da138ea op_key=nco_itnm_monitor_0
Oct 08 20:03:16 pplxnsms02 pacemaker-controld [2394] (wait_for_sync_result) info: itnm_meta-data_0[4271] exited with status 0
Oct 08 20:03:16 pplxnsms02 pacemaker-based [2388] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/39)
Oct 08 20:03:16 pplxnsms02 pacemaker-based [2388] (cib_perform_op) info: Diff: --- 0.524.14 2
Oct 08 20:03:16 pplxnsms02 pacemaker-based [2388] (cib_perform_op) info: Diff: +++ 0.524.15 (null)
Oct 08 20:03:16 pplxnsms02 pacemaker-based [2388] (cib_perform_op) info: + /cib: @num_updates=15
Oct 08 20:03:16 pplxnsms02 pacemaker-based [2388] (cib_perform_op) info: ++ /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources:
Oct 08 20:03:16 pplxnsms02 pacemaker-based [2388] (cib_perform_op) info: ++
Oct 08 20:03:16 pplxnsms02 pacemaker-based [2388] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/39, version=0.524.15)
Oct 08 20:03:16 omnibus(nco_omni)[4263]: ERROR: Cannot find the directory /san/tivoli/netcool!
Oct 08 20:03:16 itnm(nco_itnm)[4293]: ERROR: Cannot find the directory /san/tivoli/netcool!
Oct 08 20:03:16 pplxnsms02 pacemaker-controld [2394] (log_executor_event) notice: Result of probe operation for nco_omni on pplxnsms02: not running | CIB update 40, graph action confirmed; call=29 key=nco_omni_monitor_0 rc=7
Oct 08 20:03:16 pplxnsms02 pacemaker-based [2388] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/40)
Oct 08 20:03:16 pplxnsms02 pacemaker-based [2388] (cib_perform_op) info: Diff: --- 0.524.15 2
Oct 08 20:03:16 pplxnsms02 pacemaker-based [2388] (cib_perform_op) info: Diff: +++ 0.524.16 (null)
Oct 08 20:03:16 pplxnsms02 pacemaker-based [2388] (cib_perform_op) info: + /cib: @num_updates=16
Oct 08 20:03:16 pplxnsms02 pacemaker-based [2388] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='nco_omni']/lrm_rsc_op[@id='nco_omni_last_0']: @transition-magic=0:7;7:0:7:1d0c450c-ecfb-4a6e-aef1-ba7a7da138ea, @call-id=29, @rc-code=7, @op-status=0, @exec-time=170
Oct 08 20:03:16 pplxnsms02 pacemaker-controld [2394] (process_graph_event) info: Transition 0 action 7 (nco_omni_monitor_0 on pplxnsms02) confirmed: not running | rc=7 call-id=29
Oct 08 20:03:16 pplxnsms02 pacemaker-controld [2394] (te_rsc_command) notice: Initiating monitor operation nco_cognos_monitor_0 locally on pplxnsms02 | action 9
Oct 08 20:03:16 pplxnsms02 pacemaker-execd [2390] (process_lrmd_get_rsc_info) info: Agent information for 'nco_cognos' not in cache
Oct 08 20:03:16 pplxnsms02 pacemaker-execd [2390] (process_lrmd_rsc_register) info: Cached agent information for 'nco_cognos'
Oct 08 20:03:16 pplxnsms02 pacemaker-controld [2394] (do_lrm_rsc_op) notice: Requesting local execution of probe operation for nco_cognos on pplxnsms02 | transition_key=9:0:7:1d0c450c-ecfb-4a6e-aef1-ba7a7da138ea op_key=nco_cognos_monitor_0
Oct 08 20:03:16 pplxnsms02 pacemaker-based [2388] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/40, version=0.524.16)
Oct 08 20:03:16 pplxnsms02 pacemaker-controld [2394] (wait_for_sync_result) info: Cognos_meta-data_0[4327] exited with status 0
Oct 08 20:03:16 pplxnsms02 pacemaker-controld [2394] (log_executor_event) notice: Result of probe operation for nco_itnm on pplxnsms02: not running | CIB update 42, graph action confirmed; call=33 key=nco_itnm_monitor_0 rc=7
Oct 08 20:03:16 pplxnsms02 pacemaker-controld [2394] (log_executor_event) notice: Result of probe operation for itm_fs2 on pplxnsms02: not running | CIB update 43, graph action confirmed; call=17 key=itm_fs2_monitor_0 rc=7
Oct 08 20:03:16 pplxnsms02 pacemaker-based [2388] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/41)
Oct 08 20:03:16 pplxnsms02 pacemaker-based [2388] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/42)
Oct 08 20:03:16 pplxnsms02 pacemaker-based [2388] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/43)
Oct 08 20:03:16 pplxnsms02 pacemaker-based [2388] (cib_perform_op) info: Diff: --- 0.524.16 2
Oct 08 20:03:16 pplxnsms02 pacemaker-based [2388] (cib_perform_op) info: Diff: +++ 0.524.17 (null)
Oct 08 20:03:16 pplxnsms02 pacemaker-based [2388] (cib_perform_op) info: + /cib: @num_updates=17
Oct 08 20:03:16 pplxnsms02 pacemaker-based [2388] (cib_perform_op) info: ++ /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources:
Oct 08 20:03:16 pplxnsms02 pacemaker-based [2388] (cib_perform_op) info: ++
Oct 08 20:03:16 pplxnsms02 pacemaker-based [2388] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/41, version=0.524.17)
Oct 08 20:03:16 pplxnsms02 pacemaker-based [2388] (cib_perform_op) info: Diff: --- 0.524.17 2
Oct 08 20:03:16 pplxnsms02 pacemaker-based [2388] (cib_perform_op) info: Diff: +++ 0.524.18 (null)
Oct 08 20:03:16 pplxnsms02 pacemaker-based [2388] (cib_perform_op) info: + /cib: @num_updates=18
Oct 08 20:03:16 pplxnsms02 pacemaker-based [2388] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='nco_itnm']/lrm_rsc_op[@id='nco_itnm_last_0']: @transition-magic=0:7;8:0:7:1d0c450c-ecfb-4a6e-aef1-ba7a7da138ea, @call-id=33, @rc-code=7, @op-status=0, @exec-time=74
Oct 08 20:03:16 pplxnsms02 pacemaker-based [2388] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/42, version=0.524.18)
Oct 08 20:03:16 pplxnsms02 pacemaker-based [2388] (cib_perform_op) info: Diff: --- 0.524.18 2
Oct 08 20:03:16 pplxnsms02 pacemaker-based [2388] (cib_perform_op) info: Diff: +++ 0.524.19 (null)
Oct 08 20:03:16 pplxnsms02 pacemaker-based [2388] (cib_perform_op) info: + /cib: @num_updates=19
Oct 08 20:03:16 pplxnsms02 pacemaker-based [2388] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='itm_fs2']/lrm_rsc_op[@id='itm_fs2_last_0']: @transition-magic=0:7;4:0:7:1d0c450c-ecfb-4a6e-aef1-ba7a7da138ea, @call-id=17, @rc-code=7, @op-status=0, @exec-time=625
Oct 08 20:03:16 pplxnsms02 pacemaker-based [2388] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/43, version=0.524.19)
Oct 08 20:03:16 pplxnsms02 pacemaker-controld [2394] (process_graph_event) info: Transition 0 action 8 (nco_itnm_monitor_0 on pplxnsms02) confirmed: not running | rc=7 call-id=33
Oct 08 20:03:16 pplxnsms02 pacemaker-controld [2394] (process_graph_event) info: Transition 0 action 4 (itm_fs2_monitor_0 on pplxnsms02) confirmed: not running | rc=7 call-id=17
Oct 08 20:03:16 pplxnsms02 pacemaker-controld [2394] (te_rsc_command) notice: Initiating monitor operation siem_vip_monitor_0 locally on pplxnsms02 | action 10
Oct 08 20:03:16 pplxnsms02 pacemaker-execd [2390] (process_lrmd_get_rsc_info) info: Agent information for 'siem_vip' not in cache
Oct 08 20:03:16 pplxnsms02 pacemaker-execd [2390] (process_lrmd_rsc_register) info: Cached agent information for 'siem_vip'
Oct 08 20:03:16 pplxnsms02 pacemaker-controld [2394] (do_lrm_rsc_op) notice: Requesting local execution of probe operation for siem_vip on pplxnsms02 | transition_key=10:0:7:1d0c450c-ecfb-4a6e-aef1-ba7a7da138ea op_key=siem_vip_monitor_0
Oct 08 20:03:16 pplxnsms02 pacemaker-controld [2394] (te_rsc_command) notice: Initiating monitor operation siem_lvm_monitor_0 locally on pplxnsms02 | action 11
Oct 08 20:03:16 pplxnsms02 pacemaker-execd [2390] (process_lrmd_get_rsc_info) info: Agent information for 'siem_lvm' not in cache
Oct 08 20:03:16 pplxnsms02 pacemaker-execd [2390] (process_lrmd_rsc_register) info: Cached agent information for 'siem_lvm'
Oct 08 20:03:16 pplxnsms02 pacemaker-controld [2394] (do_lrm_rsc_op) notice: Requesting local execution of probe operation for siem_lvm on pplxnsms02 | transition_key=11:0:7:1d0c450c-ecfb-4a6e-aef1-ba7a7da138ea op_key=siem_lvm_monitor_0
Oct 08 20:03:16 pplxnsms02 pacemaker-based [2388] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/44)
Oct 08 20:03:16 pplxnsms02 pacemaker-based [2388] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/45)
Oct 08 20:03:16 pplxnsms02 pacemaker-based [2388] (cib_perform_op) info: Diff: --- 0.524.19 2
Oct 08 20:03:16 pplxnsms02 pacemaker-based [2388] (cib_perform_op) info: Diff: +++ 0.524.20 (null)
Oct 08 20:03:16 pplxnsms02 pacemaker-based [2388] (cib_perform_op) info: + /cib: @num_updates=20
Oct 08 20:03:16 pplxnsms02 pacemaker-based [2388] (cib_perform_op) info: ++ /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources:
Oct 08 20:03:16 pplxnsms02 pacemaker-based [2388] (cib_perform_op) info: ++
Oct 08 20:03:16 pplxnsms02 pacemaker-based [2388] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/44, version=0.524.20)
Oct 08 20:03:16 pplxnsms02 pacemaker-based [2388] (cib_perform_op) info: Diff: --- 0.524.20 2
Oct 08 20:03:16 pplxnsms02 pacemaker-based [2388] (cib_perform_op) info: Diff: +++ 0.524.21 (null)
Oct 08 20:03:16 pplxnsms02 pacemaker-based [2388] (cib_perform_op) info: + /cib: @num_updates=21
Oct 08 20:03:16 pplxnsms02 pacemaker-based [2388] (cib_perform_op) info: ++ /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources:
Oct 08 20:03:16 pplxnsms02 pacemaker-based [2388] (cib_perform_op) info: ++
Oct 08 20:03:16 pplxnsms02 pacemaker-based [2388] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/45, version=0.524.21)
Oct 08 20:03:16 Cognos(nco_cognos)[4347]: ERROR: Cannot find the directory /san/tivoli/IBM/WebSphere!
Oct 08 20:03:16 pplxnsms02 pacemaker-controld [2394] (log_executor_event) notice: Result of probe operation for siem_lvm on pplxnsms02: not running | CIB update 46, graph action confirmed; call=45 key=siem_lvm_monitor_0 rc=7
Oct 08 20:03:16 pplxnsms02 pacemaker-based [2388] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/46)
Oct 08 20:03:16 pplxnsms02 pacemaker-based [2388] (cib_perform_op) info: Diff: --- 0.524.21 2
Oct 08 20:03:16 pplxnsms02 pacemaker-based [2388] (cib_perform_op) info: Diff: +++ 0.524.22 (null)
Oct 08 20:03:16 pplxnsms02 pacemaker-based [2388] (cib_perform_op) info: + /cib: @num_updates=22
Oct 08 20:03:16 pplxnsms02 pacemaker-based [2388] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='siem_lvm']/lrm_rsc_op[@id='siem_lvm_last_0']: @transition-magic=0:7;11:0:7:1d0c450c-ecfb-4a6e-aef1-ba7a7da138ea, @call-id=45, @rc-code=7, @op-status=0, @exec-time=53
Oct 08 20:03:16 pplxnsms02 pacemaker-based [2388] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/46, version=0.524.22)
Oct 08 20:03:16 pplxnsms02 pacemaker-controld [2394] (process_graph_event) info: Transition 0 action 11 (siem_lvm_monitor_0 on pplxnsms02) confirmed: not running | rc=7 call-id=45
Oct 08 20:03:16 pplxnsms02 pacemaker-controld [2394] (te_rsc_command) notice: Initiating monitor operation siem_fs_monitor_0 locally on pplxnsms02 | action 12
Oct 08 20:03:16 pplxnsms02 pacemaker-execd [2390] (process_lrmd_get_rsc_info) info: Agent information for 'siem_fs' not in cache
Oct 08 20:03:16 pplxnsms02 pacemaker-execd [2390] (process_lrmd_rsc_register) info: Cached agent information for 'siem_fs'
Oct 08 20:03:16 pplxnsms02 pacemaker-controld [2394] (do_lrm_rsc_op) notice: Requesting local execution of probe operation for siem_fs on pplxnsms02 | transition_key=12:0:7:1d0c450c-ecfb-4a6e-aef1-ba7a7da138ea op_key=siem_fs_monitor_0
Oct 08 20:03:16 pplxnsms02 pacemaker-based [2388] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/47)
Oct 08 20:03:16 pplxnsms02 pacemaker-based [2388] (cib_perform_op) info: Diff: --- 0.524.22 2
Oct 08 20:03:16 pplxnsms02 pacemaker-based [2388] (cib_perform_op) info: Diff: +++ 0.524.23 (null)
Oct 08 20:03:16 pplxnsms02 pacemaker-based [2388] (cib_perform_op) info: + /cib: @num_updates=23
Oct 08 20:03:16 pplxnsms02 pacemaker-based [2388] (cib_perform_op) info: ++ /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources:
Oct 08 20:03:16 pplxnsms02 pacemaker-based [2388] (cib_perform_op) info: ++
Oct 08 20:03:16 pplxnsms02 pacemaker-based [2388] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/47, version=0.524.23)
Oct 08 20:03:16 pplxnsms02 pacemaker-fenced [2389] (dynamic_list_search_cb) info: Refreshing target list for fence-sbd
Oct 08 20:03:16 pplxnsms02 pacemaker-fenced [2389] (process_remote_stonith_query) info: Query result 1 of 1 from pplxnsms02 for pplxnsms01/reboot (1 device) 46983bba-9371-4f30-ad0f-509b129c2ba0
Oct 08 20:03:16 pplxnsms02 pacemaker-fenced [2389] (process_remote_stonith_query) info: All query replies have arrived, continuing (1 expected/1 received)
Oct 08 20:03:16 pplxnsms02 pacemaker-fenced [2389] (request_peer_fencing) info: Total timeout set to 60 for peer's fencing targeting pplxnsms01 for pacemaker-controld.2394|id=46983bba
Oct 08 20:03:16 pplxnsms02 pacemaker-fenced [2389] (request_peer_fencing) notice: Requesting that pplxnsms02 perform 'reboot' action targeting pplxnsms01 | for client pacemaker-controld.2394 (72s, 0s)
Oct 08 20:03:16 pplxnsms02 pacemaker-fenced [2389] (can_fence_host_with_device) notice: fence-sbd is eligible to fence (reboot) pplxnsms01: dynamic-list
Oct 08 20:03:16 pplxnsms02 pacemaker-fenced [2389] (stonith_fence_get_devices_cb) info: Found 1 matching device for target 'pplxnsms01'
Oct 08 20:03:16 pplxnsms02 pacemaker-controld [2394] (log_executor_event) notice: Result of probe operation for nco_cognos on pplxnsms02: not running | CIB update 48, graph action confirmed; call=37 key=nco_cognos_monitor_0 rc=7
Oct 08 20:03:16 pplxnsms02 pacemaker-based [2388] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/48)
Oct 08 20:03:16 pplxnsms02 pacemaker-based [2388] (cib_perform_op) info: Diff: --- 0.524.23 2
Oct 08 20:03:16 pplxnsms02 pacemaker-based [2388] (cib_perform_op) info: Diff: +++ 0.524.24 (null)
Oct 08 20:03:16 pplxnsms02 pacemaker-based [2388] (cib_perform_op) info: + /cib: @num_updates=24
Oct 08 20:03:16 pplxnsms02 pacemaker-based [2388] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='nco_cognos']/lrm_rsc_op[@id='nco_cognos_last_0']: @transition-magic=0:7;9:0:7:1d0c450c-ecfb-4a6e-aef1-ba7a7da138ea, @call-id=37, @rc-code=7, @op-status=0, @exec-time=98
Oct 08 20:03:16 pplxnsms02 pacemaker-based [2388] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/48, version=0.524.24)
Oct 08 20:03:16 pplxnsms02 pacemaker-controld [2394] (process_graph_event) info: Transition 0 action 9 (nco_cognos_monitor_0 on pplxnsms02) confirmed: not running | rc=7 call-id=37
Oct 08 20:03:16 pplxnsms02 pacemaker-controld [2394] (te_rsc_command) notice: Initiating monitor operation siem_rsyslog_monitor_0 locally on pplxnsms02 | action 13
Oct 08 20:03:16 pplxnsms02 pacemaker-execd [2390] (process_lrmd_get_rsc_info) info: Agent information for 'siem_rsyslog' not in cache
Oct 08 20:03:16 pplxnsms02 pacemaker-execd [2390] (process_lrmd_rsc_register) info: Cached agent information for 'siem_rsyslog'
Oct 08 20:03:16 pplxnsms02 pacemaker-controld [2394] (do_lrm_rsc_op) notice: Requesting local execution of probe operation for siem_rsyslog on pplxnsms02 | transition_key=13:0:7:1d0c450c-ecfb-4a6e-aef1-ba7a7da138ea op_key=siem_rsyslog_monitor_0
Oct 08 20:03:16 pplxnsms02 pacemaker-controld [2394] (wait_for_sync_result) info: siemsyslog_meta-data_0[4415] exited with status 0
Oct 08 20:03:16 pplxnsms02 pacemaker-based [2388] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/49)
Oct 08 20:03:16 pplxnsms02 pacemaker-based [2388] (cib_perform_op) info: Diff: --- 0.524.24 2
Oct 08 20:03:16 pplxnsms02 pacemaker-based [2388] (cib_perform_op) info: Diff: +++ 0.524.25 (null)
Oct 08 20:03:16 pplxnsms02 pacemaker-based [2388] (cib_perform_op) info: + /cib: @num_updates=25
Oct 08 20:03:16 pplxnsms02 pacemaker-based [2388] (cib_perform_op) info: ++ /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources:
Oct 08 20:03:16 pplxnsms02 pacemaker-based [2388] (cib_perform_op) info: ++
Oct 08 20:03:16 pplxnsms02 pacemaker-based [2388] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/49, version=0.524.25)
Oct 08 20:03:16 pplxnsms02 pacemaker-execd [2390] (log_op_output) info: siem_rsyslog_monitor_0[4444] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 3062 1 0 20:03 ? 00:00:00 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:03:16 pplxnsms02 pacemaker-controld [2394] (log_executor_event) notice: Result of probe operation for siem_rsyslog on pplxnsms02: not running | CIB update 50, graph action confirmed; call=53 key=siem_rsyslog_monitor_0 rc=7
Oct 08 20:03:16 pplxnsms02 pacemaker-controld [2394] (log_executor_event) notice: siem_rsyslog_monitor_0@pplxnsms02 output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 3062 1 0 20:03 ? 00:00:00 /usr/sbin/rsyslogd -n: integer expression expected\n ]
Oct 08 20:03:16 pplxnsms02 pacemaker-based [2388] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/50)
Oct 08 20:03:16 pplxnsms02 pacemaker-based [2388] (cib_perform_op) info: Diff: --- 0.524.25 2
Oct 08 20:03:16 pplxnsms02 pacemaker-based [2388] (cib_perform_op) info: Diff: +++ 0.524.26 (null)
Oct 08 20:03:16 pplxnsms02 pacemaker-based [2388] (cib_perform_op) info: + /cib: @num_updates=26
Oct 08 20:03:16 pplxnsms02 pacemaker-based [2388] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='siem_rsyslog']/lrm_rsc_op[@id='siem_rsyslog_last_0']: @transition-magic=0:7;13:0:7:1d0c450c-ecfb-4a6e-aef1-ba7a7da138ea, @call-id=53, @rc-code=7, @op-status=0, @exec-time=89
Oct 08 20:03:16 pplxnsms02 pacemaker-based [2388] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/50, version=0.524.26)
Oct 08 20:03:16 pplxnsms02 pacemaker-controld [2394] (process_graph_event) info: Transition 0 action 13 (siem_rsyslog_monitor_0 on pplxnsms02) confirmed: not running | rc=7 call-id=53
Oct 08 20:03:16 pplxnsms02 pacemaker-controld [2394] (te_rsc_command) notice: Initiating monitor operation web_mariadb_monitor_0 locally on pplxnsms02 | action 14
Oct 08 20:03:16 pplxnsms02 pacemaker-execd [2390] (process_lrmd_get_rsc_info) info: Agent information for 'web_mariadb' not in cache
Oct 08 20:03:16 pplxnsms02 pacemaker-execd [2390] (process_lrmd_rsc_register) info: Cached agent information for 'web_mariadb'
Oct 08 20:03:16 pplxnsms02 pacemaker-controld [2394] (do_lrm_rsc_op) notice: Requesting local execution of probe operation for web_mariadb on pplxnsms02 | transition_key=14:0:7:1d0c450c-ecfb-4a6e-aef1-ba7a7da138ea op_key=web_mariadb_monitor_0
Oct 08 20:03:16 Filesystem(siem_fs)[4388]: WARNING: Couldn't find device [/dev/vgslog/lv_log01]. Expected /dev/??? to exist
Oct 08 20:03:17 pplxnsms02 pacemaker-controld [2394] (wait_for_sync_result) info: mysql_meta-data_0[4545] exited with status 0
Oct 08 20:03:17 pplxnsms02 pacemaker-based [2388] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/51)
Oct 08 20:03:17 pplxnsms02 pacemaker-based [2388] (cib_perform_op) info: Diff: --- 0.524.26 2
Oct 08 20:03:17 pplxnsms02 pacemaker-based [2388] (cib_perform_op) info: Diff: +++ 0.524.27 (null)
Oct 08 20:03:17 pplxnsms02 pacemaker-based [2388] (cib_perform_op) info: + /cib: @num_updates=27
Oct 08 20:03:17 pplxnsms02 pacemaker-based [2388] (cib_perform_op) info: ++ /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources:
Oct 08 20:03:17 pplxnsms02 pacemaker-based [2388] (cib_perform_op) info: ++
Oct 08 20:03:17 pplxnsms02 pacemaker-based [2388] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/51, version=0.524.27)
Oct 08 20:03:17 pplxnsms02 pacemaker-controld [2394] (log_executor_event) notice: Result of probe operation for siem_vip on pplxnsms02: not running | CIB update 52, graph action confirmed; call=41 key=siem_vip_monitor_0 rc=7
Oct 08 20:03:17 pplxnsms02 pacemaker-controld [2394] (log_executor_event) notice: Result of probe operation for siem_fs on pplxnsms02: not running | CIB update 53, graph action confirmed; call=49 key=siem_fs_monitor_0 rc=7
Oct 08 20:03:17 pplxnsms02 pacemaker-based [2388] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/52)
Oct 08 20:03:17 pplxnsms02 pacemaker-based [2388] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/53)
Oct 08 20:03:17 pplxnsms02 pacemaker-based [2388] (cib_perform_op) info: Diff: --- 0.524.27 2
Oct 08 20:03:17 pplxnsms02 pacemaker-based [2388] (cib_perform_op) info: Diff: +++ 0.524.28 (null)
Oct 08 20:03:17 pplxnsms02 pacemaker-based [2388] (cib_perform_op) info: + /cib: @num_updates=28
Oct 08 20:03:17 pplxnsms02 pacemaker-based [2388] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='siem_vip']/lrm_rsc_op[@id='siem_vip_last_0']: @transition-magic=0:7;10:0:7:1d0c450c-ecfb-4a6e-aef1-ba7a7da138ea, @call-id=41, @rc-code=7, @op-status=0, @exec-time=232
Oct 08 20:03:17 pplxnsms02 pacemaker-controld [2394] (process_graph_event) info: Transition 0 action 10 (siem_vip_monitor_0 on pplxnsms02) confirmed: not running | rc=7 call-id=41
Oct 08 20:03:17 pplxnsms02 pacemaker-controld [2394] (te_rsc_command) notice: Initiating monitor operation web_matomo_monitor_0 locally on pplxnsms02 | action 15
Oct 08 20:03:17 pplxnsms02 pacemaker-based [2388] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/52, version=0.524.28)
Oct 08 20:03:17 pplxnsms02 pacemaker-execd [2390] (process_lrmd_get_rsc_info) info: Agent information for 'web_matomo' not in cache
Oct 08 20:03:17 pplxnsms02 pacemaker-based [2388] (cib_perform_op) info: Diff: --- 0.524.28 2
Oct 08 20:03:17 pplxnsms02 pacemaker-based [2388] (cib_perform_op) info: Diff: +++ 0.524.29 (null)
Oct 08 20:03:17 pplxnsms02 pacemaker-based [2388] (cib_perform_op) info: + /cib: @num_updates=29
Oct 08 20:03:17 pplxnsms02 pacemaker-based [2388] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='siem_fs']/lrm_rsc_op[@id='siem_fs_last_0']: @transition-magic=0:7;12:0:7:1d0c450c-ecfb-4a6e-aef1-ba7a7da138ea, @call-id=49, @rc-code=7, @op-status=0, @exec-time=320
Oct 08 20:03:17 pplxnsms02 pacemaker-execd [2390] (process_lrmd_rsc_register) info: Cached agent information for 'web_matomo'
Oct 08 20:03:17 pplxnsms02 pacemaker-based [2388] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/53, version=0.524.29)
Oct 08 20:03:17 pplxnsms02 pacemaker-controld [2394] (do_lrm_rsc_op) notice: Requesting local execution of probe operation for web_matomo on pplxnsms02 | transition_key=15:0:7:1d0c450c-ecfb-4a6e-aef1-ba7a7da138ea op_key=web_matomo_monitor_0
Oct 08 20:03:17 pplxnsms02 pacemaker-controld [2394] (wait_for_sync_result) info: apache_meta-data_0[4701] exited with status 0
Oct 08 20:03:17 pplxnsms02 pacemaker-based [2388] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/54)
Oct 08 20:03:17 pplxnsms02 pacemaker-based [2388] (cib_perform_op) info: Diff: --- 0.524.29 2
Oct 08 20:03:17 pplxnsms02 pacemaker-based [2388] (cib_perform_op) info: Diff: +++ 0.524.30 (null)
Oct 08 20:03:17 pplxnsms02 pacemaker-based [2388] (cib_perform_op) info: + /cib: @num_updates=30
Oct 08 20:03:17 pplxnsms02 pacemaker-based [2388] (cib_perform_op) info: ++ /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources:
Oct 08 20:03:17 pplxnsms02 pacemaker-based [2388] (cib_perform_op) info: ++
Oct 08 20:03:17 pplxnsms02 pacemaker-based [2388] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/54, version=0.524.30)
Oct 08 20:03:17 pplxnsms02 pacemaker-controld [2394] (process_graph_event) info: Transition 0 action 12 (siem_fs_monitor_0 on pplxnsms02) confirmed: not running | rc=7 call-id=49
Oct 08 20:03:17 pplxnsms02 pacemaker-controld [2394] (te_rsc_command) notice: Initiating monitor operation fence-sbd_monitor_0 locally on pplxnsms02 | action 16
Oct 08 20:03:17 pplxnsms02 pacemaker-execd [2390] (process_lrmd_get_rsc_info) info: Agent information for 'fence-sbd' not in cache
Oct 08 20:03:17 pplxnsms02 pacemaker-execd [2390] (process_lrmd_rsc_register) info: Cached agent information for 'fence-sbd'
Oct 08 20:03:17 pplxnsms02 pacemaker-controld [2394] (do_lrm_rsc_op) notice: Requesting local execution of probe operation for fence-sbd on pplxnsms02 | transition_key=16:0:7:1d0c450c-ecfb-4a6e-aef1-ba7a7da138ea op_key=fence-sbd_monitor_0
Oct 08 20:03:17 pplxnsms02 pacemaker-controld [2394] (wait_for_sync_result) info: fence_sbd_metadata_1[4778] exited with status 0
Oct 08 20:03:17 pplxnsms02 pacemaker-based [2388] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/55)
Oct 08 20:03:17 pplxnsms02 pacemaker-based [2388] (cib_perform_op) info: Diff: --- 0.524.30 2
Oct 08 20:03:17 pplxnsms02 pacemaker-based [2388] (cib_perform_op) info: Diff: +++ 0.524.31 (null)
Oct 08 20:03:17 pplxnsms02 pacemaker-based [2388] (cib_perform_op) info: + /cib: @num_updates=31
Oct 08 20:03:17 pplxnsms02 pacemaker-based [2388] (cib_perform_op) info: ++ /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources:
Oct 08 20:03:17 pplxnsms02 pacemaker-based [2388] (cib_perform_op) info: ++
Oct 08 20:03:17 pplxnsms02 pacemaker-based [2388] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/55, version=0.524.31)
Oct 08 20:03:17 mysql(web_mariadb)[4694]: ERROR: Datadir /siemlog/mysql doesn't exist
Oct 08 20:03:17 pplxnsms02 pacemaker-controld [2394] (log_executor_event) notice: Result of probe operation for fence-sbd on pplxnsms02: not running | CIB update 56, graph action confirmed; call=65 key=fence-sbd_monitor_0 rc=7
Oct 08 20:03:17 pplxnsms02 pacemaker-based [2388] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/56)
Oct 08 20:03:17 pplxnsms02 pacemaker-based [2388] (cib_perform_op) info: Diff: --- 0.524.31 2
Oct 08 20:03:17 pplxnsms02 pacemaker-based [2388] (cib_perform_op) info: Diff: +++ 0.524.32 (null)
Oct 08 20:03:17 pplxnsms02 pacemaker-based [2388] (cib_perform_op) info: + /cib: @num_updates=32
Oct 08 20:03:17 pplxnsms02 pacemaker-based [2388] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='fence-sbd']/lrm_rsc_op[@id='fence-sbd_last_0']: @transition-magic=0:7;16:0:7:1d0c450c-ecfb-4a6e-aef1-ba7a7da138ea, @call-id=65, @rc-code=7, @op-status=0, @exec-time=13
Oct 08 20:03:17 pplxnsms02 pacemaker-based [2388] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/56, version=0.524.32)
Oct 08 20:03:17 pplxnsms02 pacemaker-controld [2394] (process_graph_event) info: Transition 0 action 16 (fence-sbd_monitor_0 on pplxnsms02) confirmed: not running | rc=7 call-id=65
Oct 08 20:03:17 mysql(web_mariadb)[4694]: INFO: MySQL is not running
Oct 08 20:03:17 apache(web_matomo)[4769]: INFO: apache not running
Oct 08 20:03:17 pplxnsms02 pacemaker-execd [2390] (log_op_output) info: web_mariadb_monitor_0[4694] error output [ ocf-exit-reason:Datadir /siemlog/mysql doesn't exist ]
Oct 08 20:03:17 pplxnsms02 pacemaker-controld [2394] (log_executor_event) notice: Result of probe operation for web_mariadb on pplxnsms02: not running (Datadir /siemlog/mysql doesn't exist) | CIB update 57, graph action confirmed; call=57 key=web_mariadb_monitor_0 rc=7
Oct 08 20:03:17 pplxnsms02 pacemaker-controld [2394] (log_executor_event) notice: web_mariadb_monitor_0@pplxnsms02 output [ ocf-exit-reason:Datadir /siemlog/mysql doesn't exist\n ]
Oct 08 20:03:17 pplxnsms02 pacemaker-based [2388] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/57)
Oct 08 20:03:17 pplxnsms02 pacemaker-controld [2394] (log_executor_event) notice: Result of probe operation for web_matomo on pplxnsms02: not running | CIB update 58, graph action confirmed; call=61 key=web_matomo_monitor_0 rc=7
Oct 08 20:03:17 pplxnsms02 pacemaker-based [2388] (cib_perform_op) info: Diff: --- 0.524.32 2
Oct 08 20:03:17 pplxnsms02 pacemaker-based [2388] (cib_perform_op) info: Diff: +++ 0.524.33 (null)
Oct 08 20:03:17 pplxnsms02 pacemaker-based [2388] (cib_perform_op) info: + /cib: @num_updates=33
Oct 08 20:03:17 pplxnsms02 pacemaker-based [2388] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='web_mariadb']/lrm_rsc_op[@id='web_mariadb_last_0']: @transition-magic=0:7;14:0:7:1d0c450c-ecfb-4a6e-aef1-ba7a7da138ea, @call-id=57, @rc-code=7, @op-status=0, @last-rc-change=1728388997, @exec-time=239
Oct 08 20:03:17 pplxnsms02 pacemaker-based [2388] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/57, version=0.524.33)
Oct 08 20:03:17 pplxnsms02 pacemaker-based [2388] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/58)
Oct 08 20:03:17 pplxnsms02 pacemaker-based [2388] (cib_perform_op) info: Diff: --- 0.524.33 2
Oct 08 20:03:17 pplxnsms02 pacemaker-based [2388] (cib_perform_op) info: Diff: +++ 0.524.34 (null)
Oct 08 20:03:17 pplxnsms02 pacemaker-based [2388] (cib_perform_op) info: + /cib: @num_updates=34
Oct 08 20:03:17 pplxnsms02 pacemaker-based [2388] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='web_matomo']/lrm_rsc_op[@id='web_matomo_last_0']: @transition-magic=0:7;15:0:7:1d0c450c-ecfb-4a6e-aef1-ba7a7da138ea, @call-id=61, @rc-code=7, @op-status=0, @exec-time=153
Oct 08 20:03:17 pplxnsms02 pacemaker-based [2388] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/58, version=0.524.34)
Oct 08 20:03:17 pplxnsms02 pacemaker-controld [2394] (process_graph_event) info: Transition 0 action 14 (web_mariadb_monitor_0 on pplxnsms02) confirmed: not running | rc=7 call-id=57
Oct 08 20:03:17 pplxnsms02 pacemaker-controld [2394] (process_graph_event) info: Transition 0 action 15 (web_matomo_monitor_0 on pplxnsms02) confirmed: not running | rc=7 call-id=61
Oct 08 20:03:19 pplxnsms02 pacemaker-controld [2394] (log_executor_event) notice: Result of probe operation for nco_db2 on pplxnsms02: not running | CIB update 59, graph action confirmed; call=25 key=nco_db2_monitor_0 rc=7
Oct 08 20:03:19 pplxnsms02 pacemaker-based [2388] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/59)
Oct 08 20:03:19 pplxnsms02 pacemaker-based [2388] (cib_perform_op) info: Diff: --- 0.524.34 2
Oct 08 20:03:19 pplxnsms02 pacemaker-based [2388] (cib_perform_op) info: Diff: +++ 0.524.35 (null)
Oct 08 20:03:19 pplxnsms02 pacemaker-based [2388] (cib_perform_op) info: + /cib: @num_updates=35
Oct 08 20:03:19 pplxnsms02 pacemaker-based [2388] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='nco_db2']/lrm_rsc_op[@id='nco_db2_last_0']: @transition-magic=0:7;6:0:7:1d0c450c-ecfb-4a6e-aef1-ba7a7da138ea, @call-id=25, @rc-code=7, @op-status=0, @exec-time=3388
Oct 08 20:03:19 pplxnsms02 pacemaker-controld [2394] (process_graph_event) info: Transition 0 action 6 (nco_db2_monitor_0 on pplxnsms02) confirmed: not running | rc=7 call-id=25
Oct 08 20:03:19 pplxnsms02 pacemaker-based [2388] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/59, version=0.524.35)
Oct 08 20:03:24 pplxnsms02 pacemaker-based [2388] (cib_process_ping) info: Reporting our current digest to pplxnsms02: 63b9a3f240d3f1721ab99f0a3c3cb694 for 0.524.35 (0x559ac6814db0 0)
Oct 08 20:03:24 pplxnsms02 pacemaker-controld [2394] (pcmk__procfs_pid_of) info: Found pacemaker-based active as process 2388
Oct 08 20:03:24 pplxnsms02 pacemaker-controld [2394] (throttle_send_command) info: New throttle mode: low load (was undetermined)
Oct 08 20:03:37 pplxnsms02 pacemaker-fenced [2389] (log_async_result) notice: Operation 'reboot' [4403] targeting pplxnsms01 using fence-sbd returned 0 | call 4 from pacemaker-controld.2394
Oct 08 20:03:37 pplxnsms02 pacemaker-fenced [2389] (finalize_op) notice: Operation 'reboot' targeting pplxnsms01 by pplxnsms02 for pacemaker-controld.2394@pplxnsms02: OK (complete) | id=46983bba
Oct 08 20:03:37 pplxnsms02 pacemaker-controld [2394] (tengine_stonith_callback) notice: Fence operation 4 for pplxnsms01 passed
Oct 08 20:03:37 pplxnsms02 pacemaker-controld [2394] (update_peer_state_iter) notice: Node pplxnsms01 state is now lost | nodeid=1 previous=unknown source=crmd_peer_down
Oct 08 20:03:37 pplxnsms02 pacemaker-controld [2394] (peer_update_callback) info: Cluster node pplxnsms01 is now lost (was in unknown state)
Oct 08 20:03:37 pplxnsms02 pacemaker-controld [2394] (crm_update_peer_proc) info: crmd_peer_down: Node pplxnsms01[1] - all processes are now offline
Oct 08 20:03:37 pplxnsms02 pacemaker-controld [2394] (peer_update_callback) info: Node pplxnsms01 is no longer a peer | DC=true old=0x0000000 new=0x0000001
Oct 08 20:03:37 pplxnsms02 pacemaker-controld [2394] (pcmk__update_peer_expected) info: crmd_peer_down: Node pplxnsms01[1] - expected state is now down (was (null))
Oct 08 20:03:37 pplxnsms02 pacemaker-controld [2394] (controld_delete_node_state) info: Deleting all state for node pplxnsms01 (via CIB call 62) | xpath=//node_state[@uname='pplxnsms01']/*
Oct 08 20:03:37 pplxnsms02 pacemaker-based [2388] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/60)
Oct 08 20:03:37 pplxnsms02 pacemaker-based [2388] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/61)
Oct 08 20:03:37 pplxnsms02 pacemaker-controld [2394] (handle_fence_notification) notice: Peer pplxnsms01 was terminated (reboot) by pplxnsms02 on behalf of pacemaker-controld.2394@pplxnsms02: OK | event=46983bba-9371-4f30-ad0f-509b129c2ba0
Oct 08 20:03:37 pplxnsms02 pacemaker-based [2388] (cib_process_request) info: Forwarding cib_delete operation for section //node_state[@uname='pplxnsms01']/* to all (origin=local/crmd/62)
Oct 08 20:03:37 pplxnsms02 pacemaker-controld [2394] (controld_delete_node_state) info: Deleting all state for node pplxnsms01 (via CIB call 64) | xpath=//node_state[@uname='pplxnsms01']/*
Oct 08 20:03:37 pplxnsms02 pacemaker-based [2388] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/63)
Oct 08 20:03:37 pplxnsms02 pacemaker-based [2388] (cib_process_request) info: Forwarding cib_delete operation for section //node_state[@uname='pplxnsms01']/* to all (origin=local/crmd/64)
Oct 08 20:03:37 pplxnsms02 pacemaker-controld [2394] (te_rsc_command) notice: Initiating start operation itm_vip_start_0 locally on pplxnsms02 | action 17
Oct 08 20:03:37 pplxnsms02 pacemaker-controld [2394] (do_lrm_rsc_op) notice: Requesting local execution of start operation for itm_vip on pplxnsms02 | transition_key=17:0:0:1d0c450c-ecfb-4a6e-aef1-ba7a7da138ea op_key=itm_vip_start_0
Oct 08 20:03:37 pplxnsms02 pacemaker-based [2388] (cib_perform_op) info: Diff: --- 0.524.35 2
Oct 08 20:03:37 pplxnsms02 pacemaker-based [2388] (cib_perform_op) info: Diff: +++ 0.524.36 (null)
Oct 08 20:03:37 pplxnsms02 pacemaker-based [2388] (cib_perform_op) info: + /cib: @num_updates=36
Oct 08 20:03:37 pplxnsms02 pacemaker-based [2388] (cib_perform_op) info: ++ /cib/status:
Oct 08 20:03:37 pplxnsms02 pacemaker-execd [2390] (log_execute) info: executing - rsc:itm_vip action:start call_id:66
Oct 08 20:03:37 pplxnsms02 pacemaker-controld [2394] (te_rsc_command) notice: Initiating start operation siem_vip_start_0 locally on pplxnsms02 | action 39
Oct 08 20:03:37 pplxnsms02 pacemaker-controld [2394] (do_lrm_rsc_op) notice: Requesting local execution of start operation for siem_vip on pplxnsms02 | transition_key=39:0:0:1d0c450c-ecfb-4a6e-aef1-ba7a7da138ea op_key=siem_vip_start_0
Oct 08 20:03:37 pplxnsms02 pacemaker-execd [2390] (log_execute) info: executing - rsc:siem_vip action:start call_id:67
Oct 08 20:03:37 pplxnsms02 pacemaker-controld [2394] (te_rsc_command) notice: Initiating start operation fence-sbd_start_0 locally on pplxnsms02 | action 51
Oct 08 20:03:37 pplxnsms02 pacemaker-controld [2394] (do_lrm_rsc_op) notice: Requesting local execution of start operation for fence-sbd on pplxnsms02 | transition_key=51:0:0:1d0c450c-ecfb-4a6e-aef1-ba7a7da138ea op_key=fence-sbd_start_0
Oct 08 20:03:37 pplxnsms02 pacemaker-execd [2390] (log_execute) info: executing - rsc:fence-sbd action:start call_id:68
Oct 08 20:03:37 pplxnsms02 pacemaker-based [2388] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/60, version=0.524.36)
Oct 08 20:03:37 pplxnsms02 pacemaker-based [2388] (cib_perform_op) info: Diff: --- 0.524.36 2
Oct 08 20:03:37 pplxnsms02 pacemaker-based [2388] (cib_perform_op) info: Diff: +++ 0.524.37 (null)
Oct 08 20:03:37 pplxnsms02 pacemaker-based [2388] (cib_perform_op) info: + /cib: @num_updates=37
Oct 08 20:03:37 pplxnsms02 pacemaker-based [2388] (cib_perform_op) info: + /cib/status/node_state[@id='1']: @crm-debug-origin=send_stonith_update, @in_ccm=false, @join=down, @expected=down
Oct 08 20:03:37 pplxnsms02 pacemaker-based [2388] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/61, version=0.524.37)
Oct 08 20:03:37 pplxnsms02 pacemaker-controld [2394] (cib_fencing_updated) info: Fencing update 61 for pplxnsms01: complete
Oct 08 20:03:37 pplxnsms02 pacemaker-based [2388] (cib_process_request) info: Completed cib_delete operation for section //node_state[@uname='pplxnsms01']/*: OK (rc=0, origin=pplxnsms02/crmd/62, version=0.524.37)
Oct 08 20:03:37 pplxnsms02 pacemaker-based [2388] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/63, version=0.524.37)
Oct 08 20:03:37 pplxnsms02 pacemaker-based [2388] (cib_process_request) info: Completed cib_delete operation for section //node_state[@uname='pplxnsms01']/*: OK (rc=0, origin=pplxnsms02/crmd/64, version=0.524.37)
Oct 08 20:03:37 pplxnsms02 pacemaker-based [2388] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/65)
Oct 08 20:03:37 pplxnsms02 pacemaker-based [2388] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/66)
Oct 08 20:03:37 pplxnsms02 pacemaker-based [2388] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/67)
Oct 08 20:03:37 pplxnsms02 pacemaker-controld [2394] (cib_fencing_updated) info: Fencing update 63 for pplxnsms01: complete
Oct 08 20:03:37 pplxnsms02 pacemaker-based [2388] (cib_perform_op) info: Diff: --- 0.524.37 2
Oct 08 20:03:37 pplxnsms02 pacemaker-based [2388] (cib_perform_op) info: Diff: +++ 0.524.38 (null)
Oct 08 20:03:37 pplxnsms02 pacemaker-based [2388] (cib_perform_op) info: + /cib: @num_updates=38
Oct 08 20:03:37 pplxnsms02 pacemaker-based [2388] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='itm_vip']/lrm_rsc_op[@id='itm_vip_last_0']: @operation_key=itm_vip_start_0, @operation=start, @transition-key=17:0:0:1d0c450c-ecfb-4a6e-aef1-ba7a7da138ea, @transition-magic=-1:193;17:0:0:1d0c450c-ecfb-4a6e-aef1-ba7a7da138ea, @call-id=-1, @rc-code=193, @op-status=-1, @last-rc-change=1728389017, @exec-time=0
Oct 08 20:03:37 pplxnsms02 pacemaker-based [2388] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/65, version=0.524.38)
Oct 08 20:03:37 pplxnsms02 pacemaker-based [2388] (cib_perform_op) info: Diff: --- 0.524.38 2
Oct 08 20:03:37 pplxnsms02 pacemaker-based [2388] (cib_perform_op) info: Diff: +++ 0.524.39 (null)
Oct 08 20:03:37 pplxnsms02 pacemaker-based [2388] (cib_perform_op) info: + /cib: @num_updates=39
Oct 08 20:03:37 pplxnsms02 pacemaker-based [2388] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='siem_vip']/lrm_rsc_op[@id='siem_vip_last_0']: @operation_key=siem_vip_start_0, @operation=start, @transition-key=39:0:0:1d0c450c-ecfb-4a6e-aef1-ba7a7da138ea, @transition-magic=-1:193;39:0:0:1d0c450c-ecfb-4a6e-aef1-ba7a7da138ea, @call-id=-1, @rc-code=193, @op-status=-1, @last-rc-change=1728389017, @exec-time=0
Oct 08 20:03:37 pplxnsms02 pacemaker-based [2388] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/66, version=0.524.39)
Oct 08 20:03:37 pplxnsms02 pacemaker-based [2388] (cib_perform_op) info: Diff: --- 0.524.39 2
Oct 08 20:03:37 pplxnsms02 pacemaker-based [2388] (cib_perform_op) info: Diff: +++ 0.524.40 (null)
Oct 08 20:03:37 pplxnsms02 pacemaker-based [2388] (cib_perform_op) info: + /cib: @num_updates=40
Oct 08 20:03:37 pplxnsms02 pacemaker-based [2388] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='fence-sbd']/lrm_rsc_op[@id='fence-sbd_last_0']: @operation_key=fence-sbd_start_0, @operation=start, @transition-key=51:0:0:1d0c450c-ecfb-4a6e-aef1-ba7a7da138ea, @transition-magic=-1:193;51:0:0:1d0c450c-ecfb-4a6e-aef1-ba7a7da138ea, @call-id=-1, @rc-code=193, @op-status=-1, @last-rc-change=1728389017, @exec-time=0
Oct 08 20:03:37 pplxnsms02 pacemaker-based [2388] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/67, version=0.524.40)
Oct 08 20:03:37 IPaddr2(itm_vip)[6421]: INFO: Adding inet address 192.168.133.136/24 with broadcast address 192.168.133.255 to device ens224
Oct 08 20:03:37 IPaddr2(siem_vip)[6422]: INFO: Adding inet address 192.168.133.40/24 with broadcast address 192.168.133.255 to device ens224
Oct 08 20:03:37 IPaddr2(itm_vip)[6421]: INFO: Bringing device ens224 up
Oct 08 20:03:37 IPaddr2(siem_vip)[6422]: INFO: Bringing device ens224 up
Oct 08 20:03:37 IPaddr2(itm_vip)[6421]: INFO: /usr/libexec/heartbeat/send_arp -i 200 -r 5 -p /run/resource-agents/send_arp-192.168.133.136 ens224 192.168.133.136 auto not_used not_used
Oct 08 20:03:37 pplxnsms02 pacemaker-execd [2390] (log_finished) info: itm_vip start (call 66, PID 6421) exited with status 0 (execution time 148ms)
Oct 08 20:03:37 pplxnsms02 pacemaker-controld [2394] (wait_for_sync_result) info: IPaddr2_meta-data_0[6576] exited with status 0
Oct 08 20:03:37 pplxnsms02 pacemaker-controld [2394] (log_executor_event) notice: Result of start operation for itm_vip on pplxnsms02: ok | CIB update 68, graph action confirmed; call=66 key=itm_vip_start_0 rc=0
Oct 08 20:03:37 pplxnsms02 pacemaker-based [2388] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/68)
Oct 08 20:03:37 pplxnsms02 pacemaker-based [2388] (cib_perform_op) info: Diff: --- 0.524.40 2
Oct 08 20:03:37 pplxnsms02 pacemaker-based [2388] (cib_perform_op) info: Diff: +++ 0.524.41 (null)
Oct 08 20:03:37 pplxnsms02 pacemaker-based [2388] (cib_perform_op) info: + /cib: @num_updates=41
Oct 08 20:03:37 pplxnsms02 pacemaker-based [2388] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='itm_vip']/lrm_rsc_op[@id='itm_vip_last_0']: @transition-magic=0:0;17:0:0:1d0c450c-ecfb-4a6e-aef1-ba7a7da138ea, @call-id=66, @rc-code=0, @op-status=0, @exec-time=148
Oct 08 20:03:37 pplxnsms02 pacemaker-controld [2394] (process_graph_event) info: Transition 0 action 17 (itm_vip_start_0 on pplxnsms02) confirmed: ok | rc=0 call-id=66
Oct 08 20:03:37 pplxnsms02 pacemaker-controld [2394] (te_rsc_command) notice: Initiating monitor operation itm_vip_monitor_10000 locally on pplxnsms02 | action 18
Oct 08 20:03:37 pplxnsms02 pacemaker-controld [2394] (do_lrm_rsc_op) notice: Requesting local execution of monitor operation for itm_vip on pplxnsms02 | transition_key=18:0:0:1d0c450c-ecfb-4a6e-aef1-ba7a7da138ea op_key=itm_vip_monitor_10000
Oct 08 20:03:37 pplxnsms02 pacemaker-based [2388] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/68, version=0.524.41)
Oct 08 20:03:37 pplxnsms02 pacemaker-based [2388] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/69)
Oct 08 20:03:37 pplxnsms02 pacemaker-based [2388] (cib_perform_op) info: Diff: --- 0.524.41 2
Oct 08 20:03:37 pplxnsms02 pacemaker-based [2388] (cib_perform_op) info: Diff: +++ 0.524.42 (null)
Oct 08 20:03:37 pplxnsms02 pacemaker-based [2388] (cib_perform_op) info: + /cib: @num_updates=42
Oct 08 20:03:37 pplxnsms02 pacemaker-based [2388] (cib_perform_op) info: ++ /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='itm_vip']: 3 | from pplxnsms02
Oct 08 20:04:20 pplxnsms02 pacemaker-attrd [2419] (attrd_start_election_if_needed) info: Starting an election to determine the writer
Oct 08 20:04:20 pplxnsms02 pacemaker-based [2416] (cib_process_request) info: Completed cib_delete operation for section //node_state[@uname='pplxnsms02']/transient_attributes: OK (rc=0, origin=pplxnsms02/attrd/2, version=0.524.0)
Oct 08 20:04:20 pplxnsms02 pacemaker-attrd [2419] (election_check) info: election-attrd won by local node
Oct 08 20:04:20 pplxnsms02 pacemaker-attrd [2419] (attrd_declare_winner) notice: Recorded local node as attribute writer (was unset)
Oct 08 20:04:20 pplxnsms02 pacemaker-attrd [2419] (write_attribute) info: Processed 1 private change for #attrd-protocol, id=n/a, set=n/a
Oct 08 20:04:20 pplxnsms02 pacemaker-controld [2422] (cib_native_signon_raw) info: Successfully connected to CIB manager for crmd
Oct 08 20:04:20 pplxnsms02 pacemaker-controld [2422] (get_cluster_type) info: Verifying cluster type: 'corosync'
Oct 08 20:04:20 pplxnsms02 pacemaker-controld [2422] (get_cluster_type) info: Assuming an active 'corosync' cluster
Oct 08 20:04:20 pplxnsms02 pacemaker-controld [2422] (crm_cluster_connect) notice: Connecting to corosync cluster infrastructure
Oct 08 20:04:20 pplxnsms02 pacemaker-controld [2422] (crm_get_peer) info: Created entry ae945e74-4194-49bf-a56a-bb10dd38974c/0x5609c78860b0 for node pplxnsms02/2 (1 total)
Oct 08 20:04:20 pplxnsms02 pacemaker-controld [2422] (crm_get_peer) info: Node 2 is now known as pplxnsms02
Oct 08 20:04:20 pplxnsms02 pacemaker-controld [2422] (peer_update_callback) info: Cluster node pplxnsms02 is now in unknown state
Oct 08 20:04:20 pplxnsms02 pacemaker-fenced [2417] (cib_native_signon_raw) info: Successfully connected to CIB manager for stonithd
Oct 08 20:04:20 pplxnsms02 pacemaker-controld [2422] (crm_get_peer) info: Node 2 has uuid 2
Oct 08 20:04:20 pplxnsms02 pacemaker-controld [2422] (crm_update_peer_proc) info: cluster_connect_cpg: Node pplxnsms02[2] - corosync-cpg is now online
Oct 08 20:04:20 pplxnsms02 pacemaker-fenced [2417] (setup_cib) info: Watching for fencing topology changes
Oct 08 20:04:20 pplxnsms02 pacemaker-fenced [2417] (qb_ipcs_us_publish) info: server name: stonith-ng
Oct 08 20:04:20 pplxnsms02 pacemaker-fenced [2417] (main) notice: Pacemaker fencer successfully started and accepting connections
Oct 08 20:04:20 pplxnsms02 pacemaker-fenced [2417] (pcmk_cpg_membership) info: Group stonith-ng event 0: node 2 pid 2417 joined via cpg_join
Oct 08 20:04:20 pplxnsms02 pacemaker-fenced [2417] (pcmk_cpg_membership) info: Group stonith-ng event 0: pplxnsms02 (node 2 pid 2417) is member
Oct 08 20:04:20 pplxnsms02 pacemaker-controld [2422] (peer_update_callback) info: Node pplxnsms02 is now a peer | DC= old=0x0000000 new=0x4000000
Oct 08 20:04:20 pplxnsms02 pacemaker-controld [2422] (te_trigger_stonith_history_sync) info: Fence history will be synchronized cluster-wide within 5 seconds
Oct 08 20:04:20 pplxnsms02 pacemaker-controld [2422] (pcmk__corosync_connect) info: Connection to corosync established
Oct 08 20:04:20 pplxnsms02 pacemaker-fenced [2417] (init_cib_cache_cb) info: Updating device list from CIB
Oct 08 20:04:20 pplxnsms02 pacemaker-fenced [2417] (cib_devices_update) info: Updating devices to version 0.524.0
Oct 08 20:04:20 pplxnsms02 pacemaker-fenced [2417] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 08 20:04:20 pplxnsms02 pacemaker-controld [2422] (pcmk__corosync_quorum_connect) warning: No quorum
Oct 08 20:04:20 pplxnsms02 pacemaker-fenced [2417] (unpack_config) notice: On loss of quorum: Ignore
Oct 08 20:04:20 pplxnsms02 pacemaker-controld [2422] (crm_get_peer) info: Created entry 0c49c9fa-d059-489f-90ae-1a5164d49cec/0x5609c78897e0 for node pplxnsms01/1 (2 total)
Oct 08 20:04:20 pplxnsms02 pacemaker-controld [2422] (crm_get_peer) info: Node 1 is now known as pplxnsms01
Oct 08 20:04:20 pplxnsms02 pacemaker-controld [2422] (peer_update_callback) info: Cluster node pplxnsms01 is now in unknown state
Oct 08 20:04:20 pplxnsms02 pacemaker-controld [2422] (crm_get_peer) info: Node 1 has uuid 1
Oct 08 20:04:20 pplxnsms02 pacemaker-controld [2422] (do_ha_control) info: Connected to the cluster
Oct 08 20:04:20 pplxnsms02 pacemaker-controld [2422] (lrmd_ipc_connect) info: Connecting to executor
Oct 08 20:04:20 pplxnsms02 pacemaker-based [2416] (cib_process_request) info: Forwarding cib_modify operation for section nodes to all (origin=local/crmd/4)
Oct 08 20:04:20 pplxnsms02 pacemaker-based [2416] (cib_process_request) info: Completed cib_modify operation for section nodes: OK (rc=0, origin=pplxnsms02/crmd/4, version=0.524.0)
Oct 08 20:04:20 pplxnsms02 pacemaker-controld [2422] (try_local_executor_connect) info: Connection to the local executor established
Oct 08 20:04:20 pplxnsms02 pacemaker-controld [2422] (do_started) info: Delaying start, no membership data (0000000000100000)
Oct 08 20:04:20 pplxnsms02 pacemaker-controld [2422] (do_started) info: Delaying start, no membership data (0000000000100000)
Oct 08 20:04:20 pplxnsms02 pacemaker-controld [2422] (quorum_notification_cb) info: Quorum still lost | membership=1325 members=1
Oct 08 20:04:20 pplxnsms02 pacemaker-controld [2422] (update_peer_state_iter) notice: Node pplxnsms02 state is now member | nodeid=2 previous=unknown source=quorum_notification_cb
Oct 08 20:04:20 pplxnsms02 pacemaker-controld [2422] (peer_update_callback) info: Cluster node pplxnsms02 is now member (was in unknown state)
Oct 08 20:04:20 pplxnsms02 pacemaker-controld [2422] (pcmk__reap_unseen_nodes) info: State of node pplxnsms01[1] is still unknown
Oct 08 20:04:20 pplxnsms02 pacemaker-controld [2422] (do_started) info: Delaying start, Config not read (0000000000000040)
Oct 08 20:04:20 pplxnsms02 pacemaker-controld [2422] (pcmk_cpg_membership) info: Group crmd event 0: node 2 pid 2422 joined via cpg_join
Oct 08 20:04:20 pplxnsms02 pacemaker-controld [2422] (pcmk_cpg_membership) info: Group crmd event 0: pplxnsms02 (node 2 pid 2422) is member
Oct 08 20:04:20 pplxnsms02 pacemaker-controld [2422] (do_started) info: Delaying start, Config not read (0000000000000040)
Oct 08 20:04:20 pplxnsms02 pacemaker-controld [2422] (qb_ipcs_us_publish) info: server name: crmd
Oct 08 20:04:20 pplxnsms02 pacemaker-controld [2422] (do_started) notice: Pacemaker controller successfully started and accepting connections
Oct 08 20:04:20 pplxnsms02 pacemaker-controld [2422] (do_log) info: Input I_PENDING received in state S_STARTING from do_started
Oct 08 20:04:20 pplxnsms02 pacemaker-controld [2422] (do_state_transition) notice: State transition S_STARTING -> S_PENDING | input=I_PENDING cause=C_FSA_INTERNAL origin=do_started
Oct 08 20:04:20 pplxnsms02 pacemaker-fenced [2417] (wait_for_sync_result) info: fence_sbd_metadata_1[2497] exited with status 0
Oct 08 20:04:20 pplxnsms02 pacemaker-fenced [2417] (stonith_device_register) notice: Added 'fence-sbd' to device list (1 active device)
Oct 08 20:04:21 pplxnsms02 pacemaker-controld [2422] (te_trigger_stonith_history_sync) info: Fence history will be synchronized cluster-wide within 30 seconds
Oct 08 20:04:21 pplxnsms02 pacemaker-controld [2422] (te_connect_stonith) notice: Fencer successfully connected
Oct 08 20:04:41 pplxnsms02 pacemaker-controld [2422] (crm_timer_popped) info: Election Trigger just popped | input=I_DC_TIMEOUT time=20000ms
Oct 08 20:04:41 pplxnsms02 pacemaker-controld [2422] (do_log) warning: Input I_DC_TIMEOUT received in state S_PENDING from crm_timer_popped
Oct 08 20:04:41 pplxnsms02 pacemaker-controld [2422] (do_state_transition) info: State transition S_PENDING -> S_ELECTION | input=I_DC_TIMEOUT cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 08 20:04:41 pplxnsms02 pacemaker-controld [2422] (election_check) info: election-DC won by local node
Oct 08 20:04:41 pplxnsms02 pacemaker-controld [2422] (do_log) info: Input I_ELECTION_DC received in state S_ELECTION from election_win_cb
Oct 08 20:04:41 pplxnsms02 pacemaker-controld [2422] (do_state_transition) notice: State transition S_ELECTION -> S_INTEGRATION | input=I_ELECTION_DC cause=C_FSA_INTERNAL origin=election_win_cb
Oct 08 20:04:41 pplxnsms02 pacemaker-controld [2422] (do_te_control) info: Registering TE UUID: 4a6bffb4-939f-43ba-ae14-590611334275
Oct 08 20:04:41 pplxnsms02 pacemaker-controld [2422] (pcmk__pid_active) info: Could not read from /proc/1657/exe: Permission denied | errno=13
Oct 08 20:04:41 pplxnsms02 pacemaker-controld [2422] (do_dc_takeover) info: Taking over DC status for this partition
Oct 08 20:04:41 pplxnsms02 pacemaker-based [2416] (cib_process_readwrite) info: We are now in R/W mode
Oct 08 20:04:41 pplxnsms02 pacemaker-based [2416] (cib_process_request) info: Completed cib_master operation for section 'all': OK (rc=0, origin=local/crmd/7, version=0.524.0)
Oct 08 20:04:41 pplxnsms02 pacemaker-based [2416] (cib_process_request) info: Forwarding cib_modify operation for section cib to all (origin=local/crmd/8)
Oct 08 20:04:41 pplxnsms02 pacemaker-based [2416] (cib_process_request) info: Completed cib_modify operation for section cib: OK (rc=0, origin=pplxnsms02/crmd/8, version=0.524.0)
Oct 08 20:04:41 pplxnsms02 pacemaker-based [2416] (cib_process_request) info: Forwarding cib_modify operation for section crm_config to all (origin=local/crmd/10)
Oct 08 20:04:41 pplxnsms02 pacemaker-based [2416] (cib_process_request) info: Completed cib_modify operation for section crm_config: OK (rc=0, origin=pplxnsms02/crmd/10, version=0.524.0)
Oct 08 20:04:41 pplxnsms02 pacemaker-based [2416] (cib_process_request) info: Forwarding cib_modify operation for section crm_config to all (origin=local/crmd/12)
Oct 08 20:04:41 pplxnsms02 pacemaker-based [2416] (cib_process_request) info: Completed cib_modify operation for section crm_config: OK (rc=0, origin=pplxnsms02/crmd/12, version=0.524.0)
Oct 08 20:04:41 pplxnsms02 pacemaker-controld [2422] (join_make_offer) info: Not making join-1 offer to inactive node pplxnsms01
Oct 08 20:04:41 pplxnsms02 pacemaker-controld [2422] (join_make_offer) info: Making join-1 offers based on membership event 1325
Oct 08 20:04:41 pplxnsms02 pacemaker-controld [2422] (join_make_offer) info: Sending join-1 offer to pplxnsms02
Oct 08 20:04:41 pplxnsms02 pacemaker-controld [2422] (do_dc_join_offer_all) info: Waiting on join-1 requests from 1 outstanding node
Oct 08 20:04:41 pplxnsms02 pacemaker-controld [2422] (update_dc) info: Set DC to pplxnsms02 (3.13.0)
Oct 08 20:04:41 pplxnsms02 pacemaker-controld [2422] (pcmk__update_peer_expected) info: update_dc: Node pplxnsms02[2] - expected state is now member (was (null))
Oct 08 20:04:41 pplxnsms02 pacemaker-based [2416] (cib_process_request) info: Forwarding cib_modify operation for section crm_config to all (origin=local/crmd/14)
Oct 08 20:04:41 pplxnsms02 pacemaker-based [2416] (cib_process_request) info: Completed cib_modify operation for section crm_config: OK (rc=0, origin=pplxnsms02/crmd/14, version=0.524.0)
Oct 08 20:04:41 pplxnsms02 pacemaker-controld [2422] (stonith__watchdog_fencing_enabled_for_node_api) notice: Cluster does not have watchdog fencing device
Oct 08 20:04:41 pplxnsms02 pacemaker-controld [2422] (do_state_transition) info: State transition S_INTEGRATION -> S_FINALIZE_JOIN | input=I_INTEGRATED cause=C_FSA_INTERNAL origin=check_join_state
Oct 08 20:04:41 pplxnsms02 pacemaker-based [2416] (cib_process_replace) info: Digest matched on replace from pplxnsms02: 3ee2a3044e50b4f9747d375984348bab
Oct 08 20:04:41 pplxnsms02 pacemaker-based [2416] (cib_process_replace) info: Replaced 0.524.0 with 0.524.0 from pplxnsms02
Oct 08 20:04:41 pplxnsms02 pacemaker-based [2416] (cib_process_request) info: Completed cib_replace operation for section 'all': OK (rc=0, origin=pplxnsms02/crmd/17, version=0.524.0)
Oct 08 20:04:41 pplxnsms02 pacemaker-controld [2422] (controld_delete_node_state) info: Deleting resource history for node pplxnsms02 (via CIB call 19) | xpath=//node_state[@uname='pplxnsms02']/lrm
Oct 08 20:04:41 pplxnsms02 pacemaker-based [2416] (cib_process_request) info: Forwarding cib_modify operation for section nodes to all (origin=local/crmd/18)
Oct 08 20:04:41 pplxnsms02 pacemaker-based [2416] (cib_process_request) info: Forwarding cib_delete operation for section //node_state[@uname='pplxnsms02']/lrm to all (origin=local/crmd/19)
Oct 08 20:04:41 pplxnsms02 pacemaker-based [2416] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/20)
Oct 08 20:04:41 pplxnsms02 pacemaker-based [2416] (cib_process_request) info: Completed cib_modify operation for section nodes: OK (rc=0, origin=pplxnsms02/crmd/18, version=0.524.0)
Oct 08 20:04:41 pplxnsms02 pacemaker-based [2416] (cib_process_request) info: Completed cib_delete operation for section //node_state[@uname='pplxnsms02']/lrm: OK (rc=0, origin=pplxnsms02/crmd/19, version=0.524.0)
Oct 08 20:04:41 pplxnsms02 pacemaker-based [2416] (cib_perform_op) info: Diff: --- 0.524.0 2
Oct 08 20:04:41 pplxnsms02 pacemaker-based [2416] (cib_perform_op) info: Diff: +++ 0.524.1 (null)
Oct 08 20:04:41 pplxnsms02 pacemaker-based [2416] (cib_perform_op) info: + /cib: @num_updates=1
Oct 08 20:04:41 pplxnsms02 pacemaker-based [2416] (cib_perform_op) info: ++ /cib/status:
Oct 08 20:04:41 pplxnsms02 pacemaker-based [2416] (cib_perform_op) info: ++
Oct 08 20:04:41 pplxnsms02 pacemaker-based [2416] (cib_perform_op) info: ++
Oct 08 20:04:41 pplxnsms02 pacemaker-based [2416] (cib_perform_op) info: ++
Oct 08 20:04:41 pplxnsms02 pacemaker-based [2416] (cib_perform_op) info: ++
Oct 08 20:04:41 pplxnsms02 pacemaker-based [2416] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/20, version=0.524.1)
Oct 08 20:04:41 pplxnsms02 pacemaker-controld [2422] (do_state_transition) info: State transition S_FINALIZE_JOIN -> S_POLICY_ENGINE | input=I_FINALIZED cause=C_FSA_INTERNAL origin=check_join_state
Oct 08 20:04:41 pplxnsms02 pacemaker-controld [2422] (create_node_state_update) info: Node update for pplxnsms01 cancelled: no state, not seen yet
Oct 08 20:04:41 pplxnsms02 pacemaker-controld [2422] (abort_transition_graph) info: Transition -1 aborted: Quorum lost | source=crm_update_quorum:435 complete=true
Oct 08 20:04:41 pplxnsms02 pacemaker-controld [2422] (abort_transition_graph) info: Transition -1 aborted: Peer Cancelled | source=do_te_invoke:129 complete=true
Oct 08 20:04:41 pplxnsms02 pacemaker-based [2416] (cib_process_request) info: Forwarding cib_modify operation for section nodes to all (origin=local/crmd/23)
Oct 08 20:04:41 pplxnsms02 pacemaker-based [2416] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/24)
Oct 08 20:04:41 pplxnsms02 pacemaker-based [2416] (cib_process_request) info: Forwarding cib_modify operation for section cib to all (origin=local/crmd/25)
Oct 08 20:04:41 pplxnsms02 pacemaker-based [2416] (cib_process_request) info: Completed cib_modify operation for section nodes: OK (rc=0, origin=pplxnsms02/crmd/23, version=0.524.1)
Oct 08 20:04:41 pplxnsms02 pacemaker-based [2416] (cib_perform_op) info: Diff: --- 0.524.1 2
Oct 08 20:04:41 pplxnsms02 pacemaker-based [2416] (cib_perform_op) info: Diff: +++ 0.524.2 (null)
Oct 08 20:04:41 pplxnsms02 pacemaker-based [2416] (cib_perform_op) info: + /cib: @num_updates=2
Oct 08 20:04:41 pplxnsms02 pacemaker-based [2416] (cib_perform_op) info: + /cib/status/node_state[@id='2']: @crm-debug-origin=do_state_transition, @join=member, @expected=member
Oct 08 20:04:41 pplxnsms02 pacemaker-based [2416] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/24, version=0.524.2)
Oct 08 20:04:41 pplxnsms02 pacemaker-based [2416] (cib_perform_op) info: Diff: --- 0.524.2 2
Oct 08 20:04:41 pplxnsms02 pacemaker-based [2416] (cib_perform_op) info: Diff: +++ 0.524.3 (null)
Oct 08 20:04:41 pplxnsms02 pacemaker-based [2416] (cib_perform_op) info: + /cib: @num_updates=3, @have-quorum=0, @dc-uuid=2
Oct 08 20:04:41 pplxnsms02 pacemaker-based [2416] (cib_process_request) info: Completed cib_modify operation for section cib: OK (rc=0, origin=pplxnsms02/crmd/25, version=0.524.3)
Oct 08 20:04:41 pplxnsms02 pacemaker-based [2416] (cib_file_backup) info: Archived previous version as /var/lib/pacemaker/cib/cib-42.raw
Oct 08 20:04:41 pplxnsms02 pacemaker-based [2416] (cib_file_write_with_digest) info: Wrote version 0.524.0 of the CIB to disk (digest: 5f07fd23352926b460d3ab762d2665be)
Oct 08 20:04:41 pplxnsms02 pacemaker-based [2416] (cib_file_write_with_digest) info: Reading cluster configuration file /var/lib/pacemaker/cib/cib.M0BXPv (digest: /var/lib/pacemaker/cib/cib.DvEpfh)
Oct 08 20:04:42 pplxnsms02 pacemaker-schedulerd[2421] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 08 20:04:42 pplxnsms02 pacemaker-schedulerd[2421] (unpack_config) notice: On loss of quorum: Ignore
Oct 08 20:04:42 pplxnsms02 pacemaker-schedulerd[2421] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 08 20:04:42 pplxnsms02 pacemaker-schedulerd[2421] (determine_online_status) info: Node pplxnsms02 is online
Oct 08 20:04:42 pplxnsms02 pacemaker-schedulerd[2421] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 08 20:04:42 pplxnsms02 pacemaker-schedulerd[2421] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 08 20:04:42 pplxnsms02 pacemaker-schedulerd[2421] (RecurringOp) info: Start recurring monitor (10s) for itm_vip on pplxnsms02
Oct 08 20:04:42 pplxnsms02 pacemaker-schedulerd[2421] (RecurringOp) info: Start recurring monitor (30s) for itm_lvm on pplxnsms02
Oct 08 20:04:42 pplxnsms02 pacemaker-schedulerd[2421] (RecurringOp) info: Start recurring monitor (20s) for itm_fs on pplxnsms02
Oct 08 20:04:42 pplxnsms02 pacemaker-schedulerd[2421] (RecurringOp) info: Start recurring monitor (20s) for itm_fs2 on pplxnsms02
Oct 08 20:04:42 pplxnsms02 pacemaker-schedulerd[2421] (RecurringOp) info: Start recurring monitor (20s) for itm_fs3 on pplxnsms02
Oct 08 20:04:42 pplxnsms02 pacemaker-schedulerd[2421] (RecurringOp) info: Start recurring monitor (20s) for nco_db2 on pplxnsms02
Oct 08 20:04:42 pplxnsms02 pacemaker-schedulerd[2421] (RecurringOp) info: Start recurring monitor (60s) for nco_omni on pplxnsms02
Oct 08 20:04:42 pplxnsms02 pacemaker-schedulerd[2421] (RecurringOp) info: Start recurring monitor (300s) for nco_itnm on pplxnsms02
Oct 08 20:04:42 pplxnsms02 pacemaker-schedulerd[2421] (RecurringOp) info: Start recurring monitor (10s) for nco_cognos on pplxnsms02
Oct 08 20:04:42 pplxnsms02 pacemaker-schedulerd[2421] (RecurringOp) info: Start recurring monitor (10s) for siem_vip on pplxnsms02
Oct 08 20:04:42 pplxnsms02 pacemaker-schedulerd[2421] (RecurringOp) info: Start recurring monitor (30s) for siem_lvm on pplxnsms02
Oct 08 20:04:42 pplxnsms02 pacemaker-schedulerd[2421] (RecurringOp) info: Start recurring monitor (20s) for siem_fs on pplxnsms02
Oct 08 20:04:42 pplxnsms02 pacemaker-schedulerd[2421] (RecurringOp) info: Start recurring monitor (10s) for siem_rsyslog on pplxnsms02
Oct 08 20:04:42 pplxnsms02 pacemaker-schedulerd[2421] (RecurringOp) info: Start recurring monitor (60s) for fence-sbd on pplxnsms02
Oct 08 20:04:42 pplxnsms02 pacemaker-schedulerd[2421] (stage6) warning: Scheduling Node pplxnsms01 for STONITH
Oct 08 20:04:42 pplxnsms02 pacemaker-schedulerd[2421] (log_list_item) notice: Actions: Fence (reboot) pplxnsms01 'node is unclean'
Oct 08 20:04:42 pplxnsms02 pacemaker-schedulerd[2421] (log_list_item) notice: Actions: Start itm_vip ( pplxnsms02 )
Oct 08 20:04:42 pplxnsms02 pacemaker-schedulerd[2421] (log_list_item) notice: Actions: Start itm_lvm ( pplxnsms02 )
Oct 08 20:04:42 pplxnsms02 pacemaker-schedulerd[2421] (log_list_item) notice: Actions: Start itm_fs ( pplxnsms02 )
Oct 08 20:04:42 pplxnsms02 pacemaker-schedulerd[2421] (log_list_item) notice: Actions: Start itm_fs2 ( pplxnsms02 )
Oct 08 20:04:42 pplxnsms02 pacemaker-schedulerd[2421] (log_list_item) notice: Actions: Start itm_fs3 ( pplxnsms02 )
Oct 08 20:04:42 pplxnsms02 pacemaker-schedulerd[2421] (log_list_item) notice: Actions: Start nco_db2 ( pplxnsms02 )
Oct 08 20:04:42 pplxnsms02 pacemaker-schedulerd[2421] (log_list_item) notice: Actions: Start nco_omni ( pplxnsms02 )
Oct 08 20:04:42 pplxnsms02 pacemaker-schedulerd[2421] (log_list_item) notice: Actions: Start nco_itnm ( pplxnsms02 )
Oct 08 20:04:42 pplxnsms02 pacemaker-schedulerd[2421] (log_list_item) notice: Actions: Start nco_cognos ( pplxnsms02 )
Oct 08 20:04:42 pplxnsms02 pacemaker-schedulerd[2421] (log_list_item) notice: Actions: Start siem_vip ( pplxnsms02 )
Oct 08 20:04:42 pplxnsms02 pacemaker-schedulerd[2421] (log_list_item) notice: Actions: Start siem_lvm ( pplxnsms02 )
Oct 08 20:04:42 pplxnsms02 pacemaker-schedulerd[2421] (log_list_item) notice: Actions: Start siem_fs ( pplxnsms02 )
Oct 08 20:04:42 pplxnsms02 pacemaker-schedulerd[2421] (log_list_item) notice: Actions: Start siem_rsyslog ( pplxnsms02 )
Oct 08 20:04:42 pplxnsms02 pacemaker-schedulerd[2421] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 08 20:04:42 pplxnsms02 pacemaker-schedulerd[2421] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 08 20:04:42 pplxnsms02 pacemaker-schedulerd[2421] (log_list_item) notice: Actions: Start fence-sbd ( pplxnsms02 )
Oct 08 20:04:42 pplxnsms02 pacemaker-schedulerd[2421] (pcmk__log_transition_summary) warning: Calculated transition 0 (with warnings), saving inputs in /var/lib/pacemaker/pengine/pe-warn-97.bz2
Oct 08 20:04:42 pplxnsms02 pacemaker-controld [2422] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 08 20:04:42 pplxnsms02 pacemaker-controld [2422] (do_te_invoke) info: Processing graph 0 (ref=pe_calc-dc-1728389082-8) derived from /var/lib/pacemaker/pengine/pe-warn-97.bz2
Oct 08 20:04:42 pplxnsms02 pacemaker-controld [2422] (te_rsc_command) notice: Initiating monitor operation itm_vip_monitor_0 locally on pplxnsms02 | action 1
Oct 08 20:04:42 pplxnsms02 pacemaker-execd [2418] (process_lrmd_get_rsc_info) info: Agent information for 'itm_vip' not in cache
Oct 08 20:04:42 pplxnsms02 pacemaker-execd [2418] (process_lrmd_rsc_register) info: Cached agent information for 'itm_vip'
Oct 08 20:04:42 pplxnsms02 pacemaker-controld [2422] (do_lrm_rsc_op) notice: Requesting local execution of probe operation for itm_vip on pplxnsms02 | transition_key=1:0:7:4a6bffb4-939f-43ba-ae14-590611334275 op_key=itm_vip_monitor_0
Oct 08 20:04:42 pplxnsms02 pacemaker-controld [2422] (wait_for_sync_result) info: IPaddr2_meta-data_0[4936] exited with status 0
Oct 08 20:04:42 pplxnsms02 pacemaker-based [2416] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/29)
Oct 08 20:04:42 pplxnsms02 pacemaker-controld [2422] (te_rsc_command) notice: Initiating monitor operation itm_lvm_monitor_0 locally on pplxnsms02 | action 2
Oct 08 20:04:42 pplxnsms02 pacemaker-based [2416] (cib_perform_op) info: Diff: --- 0.524.3 2
Oct 08 20:04:42 pplxnsms02 pacemaker-based [2416] (cib_perform_op) info: Diff: +++ 0.524.4 (null)
Oct 08 20:04:42 pplxnsms02 pacemaker-based [2416] (cib_perform_op) info: + /cib: @num_updates=4
Oct 08 20:04:42 pplxnsms02 pacemaker-based [2416] (cib_perform_op) info: + /cib/status/node_state[@id='2']: @crm-debug-origin=do_update_resource
Oct 08 20:04:42 pplxnsms02 pacemaker-based [2416] (cib_perform_op) info: ++ /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources:
Oct 08 20:04:42 pplxnsms02 pacemaker-based [2416] (cib_perform_op) info: ++
Oct 08 20:04:42 pplxnsms02 pacemaker-based [2416] (cib_perform_op) info: ++
Oct 08 20:04:42 pplxnsms02 pacemaker-based [2416] (cib_perform_op) info: ++
Oct 08 20:04:42 pplxnsms02 pacemaker-based [2416] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/31, version=0.524.6)
Oct 08 20:04:42 pplxnsms02 pacemaker-execd [2418] (process_lrmd_get_rsc_info) info: Agent information for 'itm_fs2' not in cache
Oct 08 20:04:42 pplxnsms02 pacemaker-execd [2418] (process_lrmd_rsc_register) info: Cached agent information for 'itm_fs2'
Oct 08 20:04:42 pplxnsms02 pacemaker-controld [2422] (do_lrm_rsc_op) notice: Requesting local execution of probe operation for itm_fs2 on pplxnsms02 | transition_key=4:0:7:4a6bffb4-939f-43ba-ae14-590611334275 op_key=itm_fs2_monitor_0
Oct 08 20:04:42 pplxnsms02 pacemaker-based [2416] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/32)
Oct 08 20:04:42 pplxnsms02 pacemaker-based [2416] (cib_perform_op) info: Diff: --- 0.524.6 2
Oct 08 20:04:42 pplxnsms02 pacemaker-based [2416] (cib_perform_op) info: Diff: +++ 0.524.7 (null)
Oct 08 20:04:42 pplxnsms02 pacemaker-based [2416] (cib_perform_op) info: + /cib: @num_updates=7
Oct 08 20:04:42 pplxnsms02 pacemaker-based [2416] (cib_perform_op) info: ++ /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources:
Oct 08 20:04:42 pplxnsms02 pacemaker-based [2416] (cib_perform_op) info: ++
Oct 08 20:04:42 pplxnsms02 pacemaker-based [2416] (cib_perform_op) info: ++
Oct 08 20:04:42 pplxnsms02 pacemaker-based [2416] (cib_perform_op) info: ++
Oct 08 20:04:42 pplxnsms02 pacemaker-based [2416] (cib_perform_op) info: ++
Oct 08 20:04:42 pplxnsms02 pacemaker-based [2416] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/38, version=0.524.13)
Oct 08 20:04:42 pplxnsms02 pacemaker-based [2416] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/39)
Oct 08 20:04:42 pplxnsms02 pacemaker-based [2416] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/40)
Oct 08 20:04:42 pplxnsms02 pacemaker-based [2416] (cib_perform_op) info: Diff: --- 0.524.13 2
Oct 08 20:04:42 pplxnsms02 pacemaker-based [2416] (cib_perform_op) info: Diff: +++ 0.524.14 (null)
Oct 08 20:04:42 pplxnsms02 pacemaker-based [2416] (cib_perform_op) info: + /cib: @num_updates=14
Oct 08 20:04:42 pplxnsms02 pacemaker-based [2416] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='itm_fs3']/lrm_rsc_op[@id='itm_fs3_last_0']: @transition-magic=0:7;5:0:7:4a6bffb4-939f-43ba-ae14-590611334275, @call-id=21, @rc-code=7, @op-status=0, @exec-time=346
Oct 08 20:04:42 pplxnsms02 pacemaker-based [2416] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/39, version=0.524.14)
Oct 08 20:04:42 pplxnsms02 pacemaker-based [2416] (cib_perform_op) info: Diff: --- 0.524.14 2
Oct 08 20:04:42 pplxnsms02 pacemaker-based [2416] (cib_perform_op) info: Diff: +++ 0.524.15 (null)
Oct 08 20:04:42 pplxnsms02 pacemaker-based [2416] (cib_perform_op) info: + /cib: @num_updates=15
Oct 08 20:04:42 pplxnsms02 pacemaker-based [2416] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='itm_fs']/lrm_rsc_op[@id='itm_fs_last_0']: @transition-magic=0:7;3:0:7:4a6bffb4-939f-43ba-ae14-590611334275, @call-id=13, @rc-code=7, @op-status=0, @exec-time=358
Oct 08 20:04:42 pplxnsms02 pacemaker-based [2416] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/40, version=0.524.15)
Oct 08 20:04:42 pplxnsms02 pacemaker-controld [2422] (process_graph_event) info: Transition 0 action 5 (itm_fs3_monitor_0 on pplxnsms02) confirmed: not running | rc=7 call-id=21
Oct 08 20:04:42 pplxnsms02 pacemaker-controld [2422] (process_graph_event) info: Transition 0 action 3 (itm_fs_monitor_0 on pplxnsms02) confirmed: not running | rc=7 call-id=13
Oct 08 20:04:42 pplxnsms02 pacemaker-controld [2422] (te_rsc_command) notice: Initiating monitor operation nco_itnm_monitor_0 locally on pplxnsms02 | action 8
Oct 08 20:04:42 pplxnsms02 pacemaker-execd [2418] (process_lrmd_get_rsc_info) info: Agent information for 'nco_itnm' not in cache
Oct 08 20:04:42 pplxnsms02 pacemaker-execd [2418] (process_lrmd_rsc_register) info: Cached agent information for 'nco_itnm'
Oct 08 20:04:42 pplxnsms02 pacemaker-controld [2422] (do_lrm_rsc_op) notice: Requesting local execution of probe operation for nco_itnm on pplxnsms02 | transition_key=8:0:7:4a6bffb4-939f-43ba-ae14-590611334275 op_key=nco_itnm_monitor_0
Oct 08 20:04:42 omnibus(nco_omni)[5378]: ERROR: Cannot find the directory /san/tivoli/netcool!
Oct 08 20:04:42 pplxnsms02 pacemaker-controld [2422] (wait_for_sync_result) info: itnm_meta-data_0[5381] exited with status 0
Oct 08 20:04:42 pplxnsms02 pacemaker-based [2416] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/41)
Oct 08 20:04:42 pplxnsms02 pacemaker-based [2416] (cib_perform_op) info: Diff: --- 0.524.15 2
Oct 08 20:04:42 pplxnsms02 pacemaker-based [2416] (cib_perform_op) info: Diff: +++ 0.524.16 (null)
Oct 08 20:04:42 pplxnsms02 pacemaker-based [2416] (cib_perform_op) info: + /cib: @num_updates=16
Oct 08 20:04:42 pplxnsms02 pacemaker-based [2416] (cib_perform_op) info: ++ /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources:
Oct 08 20:04:42 pplxnsms02 pacemaker-based [2416] (cib_perform_op) info: ++
Oct 08 20:04:42 pplxnsms02 pacemaker-based [2416] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/41, version=0.524.16)
Oct 08 20:04:42 pplxnsms02 pacemaker-controld [2422] (te_rsc_command) notice: Initiating monitor operation nco_cognos_monitor_0 locally on pplxnsms02 | action 9
Oct 08 20:04:42 pplxnsms02 pacemaker-execd [2418] (process_lrmd_get_rsc_info) info: Agent information for 'nco_cognos' not in cache
Oct 08 20:04:42 pplxnsms02 pacemaker-execd [2418] (process_lrmd_rsc_register) info: Cached agent information for 'nco_cognos'
Oct 08 20:04:42 pplxnsms02 pacemaker-controld [2422] (do_lrm_rsc_op) notice: Requesting local execution of probe operation for nco_cognos on pplxnsms02 | transition_key=9:0:7:4a6bffb4-939f-43ba-ae14-590611334275 op_key=nco_cognos_monitor_0
Oct 08 20:04:42 itnm(nco_itnm)[5395]: ERROR: Cannot find the directory /san/tivoli/netcool!
Oct 08 20:04:42 pplxnsms02 pacemaker-controld [2422] (wait_for_sync_result) info: Cognos_meta-data_0[5398] exited with status 0
Oct 08 20:04:42 pplxnsms02 pacemaker-based [2416] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/42)
Oct 08 20:04:42 pplxnsms02 pacemaker-based [2416] (cib_perform_op) info: Diff: --- 0.524.16 2
Oct 08 20:04:42 pplxnsms02 pacemaker-based [2416] (cib_perform_op) info: Diff: +++ 0.524.17 (null)
Oct 08 20:04:42 pplxnsms02 pacemaker-based [2416] (cib_perform_op) info: + /cib: @num_updates=17
Oct 08 20:04:42 pplxnsms02 pacemaker-based [2416] (cib_perform_op) info: ++ /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources:
Oct 08 20:04:42 pplxnsms02 pacemaker-based [2416] (cib_perform_op) info: ++
Oct 08 20:04:42 pplxnsms02 pacemaker-based [2416] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/42, version=0.524.17)
Oct 08 20:04:42 pplxnsms02 pacemaker-controld [2422] (log_executor_event) notice: Result of probe operation for nco_omni on pplxnsms02: not running | CIB update 43, graph action confirmed; call=29 key=nco_omni_monitor_0 rc=7
Oct 08 20:04:42 pplxnsms02 pacemaker-based [2416] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/43)
Oct 08 20:04:42 pplxnsms02 pacemaker-based [2416] (cib_perform_op) info: Diff: --- 0.524.17 2
Oct 08 20:04:42 pplxnsms02 pacemaker-based [2416] (cib_perform_op) info: Diff: +++ 0.524.18 (null)
Oct 08 20:04:42 pplxnsms02 pacemaker-based [2416] (cib_perform_op) info: + /cib: @num_updates=18
Oct 08 20:04:42 pplxnsms02 pacemaker-based [2416] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='nco_omni']/lrm_rsc_op[@id='nco_omni_last_0']: @transition-magic=0:7;7:0:7:4a6bffb4-939f-43ba-ae14-590611334275, @call-id=29, @rc-code=7, @op-status=0, @exec-time=36
Oct 08 20:04:42 pplxnsms02 pacemaker-based [2416] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/43, version=0.524.18)
Oct 08 20:04:42 pplxnsms02 pacemaker-controld [2422] (process_graph_event) info: Transition 0 action 7 (nco_omni_monitor_0 on pplxnsms02) confirmed: not running | rc=7 call-id=29
Oct 08 20:04:42 pplxnsms02 pacemaker-controld [2422] (te_rsc_command) notice: Initiating monitor operation siem_vip_monitor_0 locally on pplxnsms02 | action 10
Oct 08 20:04:42 pplxnsms02 pacemaker-execd [2418] (process_lrmd_get_rsc_info) info: Agent information for 'siem_vip' not in cache
Oct 08 20:04:42 pplxnsms02 pacemaker-execd [2418] (process_lrmd_rsc_register) info: Cached agent information for 'siem_vip'
Oct 08 20:04:42 pplxnsms02 pacemaker-controld [2422] (do_lrm_rsc_op) notice: Requesting local execution of probe operation for siem_vip on pplxnsms02 | transition_key=10:0:7:4a6bffb4-939f-43ba-ae14-590611334275 op_key=siem_vip_monitor_0
Oct 08 20:04:42 pplxnsms02 pacemaker-based [2416] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/44)
Oct 08 20:04:42 pplxnsms02 pacemaker-based [2416] (cib_perform_op) info: Diff: --- 0.524.18 2
Oct 08 20:04:42 pplxnsms02 pacemaker-based [2416] (cib_perform_op) info: Diff: +++ 0.524.19 (null)
Oct 08 20:04:42 pplxnsms02 pacemaker-based [2416] (cib_perform_op) info: + /cib: @num_updates=19
Oct 08 20:04:42 pplxnsms02 pacemaker-based [2416] (cib_perform_op) info: ++ /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources:
Oct 08 20:04:42 pplxnsms02 pacemaker-based [2416] (cib_perform_op) info: ++
Oct 08 20:04:42 pplxnsms02 pacemaker-based [2416] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/44, version=0.524.19)
Oct 08 20:04:42 Cognos(nco_cognos)[5409]: ERROR: Cannot find the directory /san/tivoli/IBM/WebSphere!
Oct 08 20:04:42 pplxnsms02 pacemaker-controld [2422] (log_executor_event) notice: Result of probe operation for nco_itnm on pplxnsms02: not running | CIB update 45, graph action confirmed; call=33 key=nco_itnm_monitor_0 rc=7
Oct 08 20:04:42 pplxnsms02 pacemaker-based [2416] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/45)
Oct 08 20:04:42 pplxnsms02 pacemaker-based [2416] (cib_perform_op) info: Diff: --- 0.524.19 2
Oct 08 20:04:42 pplxnsms02 pacemaker-based [2416] (cib_perform_op) info: Diff: +++ 0.524.20 (null)
Oct 08 20:04:42 pplxnsms02 pacemaker-based [2416] (cib_perform_op) info: + /cib: @num_updates=20
Oct 08 20:04:42 pplxnsms02 pacemaker-based [2416] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='nco_itnm']/lrm_rsc_op[@id='nco_itnm_last_0']: @transition-magic=0:7;8:0:7:4a6bffb4-939f-43ba-ae14-590611334275, @call-id=33, @rc-code=7, @op-status=0, @exec-time=73
Oct 08 20:04:42 pplxnsms02 pacemaker-controld [2422] (process_graph_event) info: Transition 0 action 8 (nco_itnm_monitor_0 on pplxnsms02) confirmed: not running | rc=7 call-id=33
Oct 08 20:04:42 pplxnsms02 pacemaker-controld [2422] (te_rsc_command) notice: Initiating monitor operation siem_lvm_monitor_0 locally on pplxnsms02 | action 11
Oct 08 20:04:42 pplxnsms02 pacemaker-execd [2418] (process_lrmd_get_rsc_info) info: Agent information for 'siem_lvm' not in cache
Oct 08 20:04:42 pplxnsms02 pacemaker-execd [2418] (process_lrmd_rsc_register) info: Cached agent information for 'siem_lvm'
Oct 08 20:04:42 pplxnsms02 pacemaker-controld [2422] (do_lrm_rsc_op) notice: Requesting local execution of probe operation for siem_lvm on pplxnsms02 | transition_key=11:0:7:4a6bffb4-939f-43ba-ae14-590611334275 op_key=siem_lvm_monitor_0
Oct 08 20:04:42 pplxnsms02 pacemaker-based [2416] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/45, version=0.524.20)
Oct 08 20:04:42 pplxnsms02 pacemaker-based [2416] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/46)
Oct 08 20:04:42 pplxnsms02 pacemaker-based [2416] (cib_perform_op) info: Diff: --- 0.524.20 2
Oct 08 20:04:42 pplxnsms02 pacemaker-based [2416] (cib_perform_op) info: Diff: +++ 0.524.21 (null)
Oct 08 20:04:42 pplxnsms02 pacemaker-based [2416] (cib_perform_op) info: + /cib: @num_updates=21
Oct 08 20:04:42 pplxnsms02 pacemaker-based [2416] (cib_perform_op) info: ++ /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources:
Oct 08 20:04:42 pplxnsms02 pacemaker-based [2416] (cib_perform_op) info: ++
Oct 08 20:04:42 pplxnsms02 pacemaker-based [2416] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/46, version=0.524.21)
Oct 08 20:04:42 pplxnsms02 pacemaker-controld [2422] (log_executor_event) notice: Result of probe operation for nco_cognos on pplxnsms02: not running | CIB update 47, graph action confirmed; call=37 key=nco_cognos_monitor_0 rc=7
Oct 08 20:04:42 pplxnsms02 pacemaker-based [2416] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/47)
Oct 08 20:04:42 pplxnsms02 pacemaker-based [2416] (cib_perform_op) info: Diff: --- 0.524.21 2
Oct 08 20:04:42 pplxnsms02 pacemaker-based [2416] (cib_perform_op) info: Diff: +++ 0.524.22 (null)
Oct 08 20:04:42 pplxnsms02 pacemaker-based [2416] (cib_perform_op) info: + /cib: @num_updates=22
Oct 08 20:04:42 pplxnsms02 pacemaker-based [2416] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='nco_cognos']/lrm_rsc_op[@id='nco_cognos_last_0']: @transition-magic=0:7;9:0:7:4a6bffb4-939f-43ba-ae14-590611334275, @call-id=37, @rc-code=7, @op-status=0, @exec-time=47
Oct 08 20:04:42 pplxnsms02 pacemaker-based [2416] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/47, version=0.524.22)
Oct 08 20:04:42 pplxnsms02 pacemaker-controld [2422] (process_graph_event) info: Transition 0 action 9 (nco_cognos_monitor_0 on pplxnsms02) confirmed: not running | rc=7 call-id=37
Oct 08 20:04:42 pplxnsms02 pacemaker-controld [2422] (te_rsc_command) notice: Initiating monitor operation siem_fs_monitor_0 locally on pplxnsms02 | action 12
Oct 08 20:04:42 pplxnsms02 pacemaker-execd [2418] (process_lrmd_get_rsc_info) info: Agent information for 'siem_fs' not in cache
Oct 08 20:04:42 pplxnsms02 pacemaker-execd [2418] (process_lrmd_rsc_register) info: Cached agent information for 'siem_fs'
Oct 08 20:04:42 pplxnsms02 pacemaker-controld [2422] (do_lrm_rsc_op) notice: Requesting local execution of probe operation for siem_fs on pplxnsms02 | transition_key=12:0:7:4a6bffb4-939f-43ba-ae14-590611334275 op_key=siem_fs_monitor_0
Oct 08 20:04:42 pplxnsms02 pacemaker-based [2416] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/48)
Oct 08 20:04:42 pplxnsms02 pacemaker-based [2416] (cib_perform_op) info: Diff: --- 0.524.22 2
Oct 08 20:04:42 pplxnsms02 pacemaker-based [2416] (cib_perform_op) info: Diff: +++ 0.524.23 (null)
Oct 08 20:04:42 pplxnsms02 pacemaker-based [2416] (cib_perform_op) info: + /cib: @num_updates=23
Oct 08 20:04:42 pplxnsms02 pacemaker-based [2416] (cib_perform_op) info: ++ /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources:
Oct 08 20:04:42 pplxnsms02 pacemaker-based [2416] (cib_perform_op) info: ++
Oct 08 20:04:42 pplxnsms02 pacemaker-based [2416] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/48, version=0.524.23)
Oct 08 20:04:42 pplxnsms02 pacemaker-controld [2422] (log_executor_event) notice: Result of probe operation for siem_lvm on pplxnsms02: not running | CIB update 49, graph action confirmed; call=45 key=siem_lvm_monitor_0 rc=7
Oct 08 20:04:42 pplxnsms02 pacemaker-based [2416] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/49)
Oct 08 20:04:42 pplxnsms02 pacemaker-based [2416] (cib_perform_op) info: Diff: --- 0.524.23 2
Oct 08 20:04:42 pplxnsms02 pacemaker-based [2416] (cib_perform_op) info: Diff: +++ 0.524.24 (null)
Oct 08 20:04:42 pplxnsms02 pacemaker-based [2416] (cib_perform_op) info: + /cib: @num_updates=24
Oct 08 20:04:42 pplxnsms02 pacemaker-based [2416] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='siem_lvm']/lrm_rsc_op[@id='siem_lvm_last_0']: @transition-magic=0:7;11:0:7:4a6bffb4-939f-43ba-ae14-590611334275, @call-id=45, @rc-code=7, @op-status=0, @exec-time=36
Oct 08 20:04:42 pplxnsms02 pacemaker-based [2416] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/49, version=0.524.24)
Oct 08 20:04:42 pplxnsms02 pacemaker-controld [2422] (process_graph_event) info: Transition 0 action 11 (siem_lvm_monitor_0 on pplxnsms02) confirmed: not running | rc=7 call-id=45
Oct 08 20:04:42 pplxnsms02 pacemaker-controld [2422] (te_rsc_command) notice: Initiating monitor operation siem_rsyslog_monitor_0 locally on pplxnsms02 | action 13
Oct 08 20:04:42 pplxnsms02 pacemaker-execd [2418] (process_lrmd_get_rsc_info) info: Agent information for 'siem_rsyslog' not in cache
Oct 08 20:04:42 pplxnsms02 pacemaker-execd [2418] (process_lrmd_rsc_register) info: Cached agent information for 'siem_rsyslog'
Oct 08 20:04:42 pplxnsms02 pacemaker-controld [2422] (do_lrm_rsc_op) notice: Requesting local execution of probe operation for siem_rsyslog on pplxnsms02 | transition_key=13:0:7:4a6bffb4-939f-43ba-ae14-590611334275 op_key=siem_rsyslog_monitor_0
Oct 08 20:04:42 pplxnsms02 pacemaker-controld [2422] (wait_for_sync_result) info: siemsyslog_meta-data_0[5467] exited with status 0
Oct 08 20:04:42 pplxnsms02 pacemaker-based [2416] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/50)
Oct 08 20:04:42 pplxnsms02 pacemaker-based [2416] (cib_perform_op) info: Diff: --- 0.524.24 2
Oct 08 20:04:42 pplxnsms02 pacemaker-based [2416] (cib_perform_op) info: Diff: +++ 0.524.25 (null)
Oct 08 20:04:42 pplxnsms02 pacemaker-based [2416] (cib_perform_op) info: + /cib: @num_updates=25
Oct 08 20:04:42 pplxnsms02 pacemaker-based [2416] (cib_perform_op) info: ++ /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources:
Oct 08 20:04:42 pplxnsms02 pacemaker-based [2416] (cib_perform_op) info: ++
Oct 08 20:04:42 pplxnsms02 pacemaker-based [2416] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/50, version=0.524.25)
Oct 08 20:04:42 pplxnsms02 pacemaker-controld [2422] (log_executor_event) notice: Result of probe operation for siem_vip on pplxnsms02: not running | CIB update 51, graph action confirmed; call=41 key=siem_vip_monitor_0 rc=7
Oct 08 20:04:42 pplxnsms02 pacemaker-based [2416] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/51)
Oct 08 20:04:42 pplxnsms02 pacemaker-based [2416] (cib_perform_op) info: Diff: --- 0.524.25 2
Oct 08 20:04:42 pplxnsms02 pacemaker-based [2416] (cib_perform_op) info: Diff: +++ 0.524.26 (null)
Oct 08 20:04:42 pplxnsms02 pacemaker-based [2416] (cib_perform_op) info: + /cib: @num_updates=26
Oct 08 20:04:42 pplxnsms02 pacemaker-based [2416] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='siem_vip']/lrm_rsc_op[@id='siem_vip_last_0']: @transition-magic=0:7;10:0:7:4a6bffb4-939f-43ba-ae14-590611334275, @call-id=41, @rc-code=7, @op-status=0, @exec-time=122
Oct 08 20:04:42 pplxnsms02 pacemaker-based [2416] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/51, version=0.524.26)
Oct 08 20:04:42 pplxnsms02 pacemaker-controld [2422] (process_graph_event) info: Transition 0 action 10 (siem_vip_monitor_0 on pplxnsms02) confirmed: not running | rc=7 call-id=41
Oct 08 20:04:42 pplxnsms02 pacemaker-controld [2422] (te_rsc_command) notice: Initiating monitor operation web_mariadb_monitor_0 locally on pplxnsms02 | action 14
Oct 08 20:04:42 pplxnsms02 pacemaker-execd [2418] (process_lrmd_get_rsc_info) info: Agent information for 'web_mariadb' not in cache
Oct 08 20:04:42 pplxnsms02 pacemaker-execd [2418] (process_lrmd_rsc_register) info: Cached agent information for 'web_mariadb'
Oct 08 20:04:42 pplxnsms02 pacemaker-controld [2422] (do_lrm_rsc_op) notice: Requesting local execution of probe operation for web_mariadb on pplxnsms02 | transition_key=14:0:7:4a6bffb4-939f-43ba-ae14-590611334275 op_key=web_mariadb_monitor_0
Oct 08 20:04:42 Filesystem(siem_fs)[5430]: WARNING: Couldn't find device [/dev/vgslog/lv_log01]. Expected /dev/??? to exist
Oct 08 20:04:42 pplxnsms02 pacemaker-execd [2418] (log_op_output) info: siem_rsyslog_monitor_0[5498] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 3453 1 0 20:04 ? 00:00:00 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:04:43 pplxnsms02 pacemaker-controld [2422] (wait_for_sync_result) info: mysql_meta-data_0[5540] exited with status 0
Oct 08 20:04:43 pplxnsms02 pacemaker-based [2416] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/52)
Oct 08 20:04:43 pplxnsms02 pacemaker-based [2416] (cib_perform_op) info: Diff: --- 0.524.26 2
Oct 08 20:04:43 pplxnsms02 pacemaker-based [2416] (cib_perform_op) info: Diff: +++ 0.524.27 (null)
Oct 08 20:04:43 pplxnsms02 pacemaker-based [2416] (cib_perform_op) info: + /cib: @num_updates=27
Oct 08 20:04:43 pplxnsms02 pacemaker-based [2416] (cib_perform_op) info: ++ /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources:
Oct 08 20:04:43 pplxnsms02 pacemaker-based [2416] (cib_perform_op) info: ++
Oct 08 20:04:43 pplxnsms02 pacemaker-based [2416] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/52, version=0.524.27)
Oct 08 20:04:43 pplxnsms02 pacemaker-controld [2422] (log_executor_event) notice: Result of probe operation for siem_rsyslog on pplxnsms02: not running | CIB update 53, graph action confirmed; call=53 key=siem_rsyslog_monitor_0 rc=7
Oct 08 20:04:43 pplxnsms02 pacemaker-controld [2422] (log_executor_event) notice: siem_rsyslog_monitor_0@pplxnsms02 output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 3453 1 0 20:04 ? 00:00:00 /usr/sbin/rsyslogd -n: integer expression expected\n ]
Oct 08 20:04:43 pplxnsms02 pacemaker-controld [2422] (log_executor_event) notice: Result of probe operation for siem_fs on pplxnsms02: not running | CIB update 54, graph action confirmed; call=49 key=siem_fs_monitor_0 rc=7
Oct 08 20:04:43 pplxnsms02 pacemaker-based [2416] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/53)
Oct 08 20:04:43 pplxnsms02 pacemaker-based [2416] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/54)
Oct 08 20:04:43 pplxnsms02 pacemaker-based [2416] (cib_perform_op) info: Diff: --- 0.524.27 2
Oct 08 20:04:43 pplxnsms02 pacemaker-based [2416] (cib_perform_op) info: Diff: +++ 0.524.28 (null)
Oct 08 20:04:43 pplxnsms02 pacemaker-based [2416] (cib_perform_op) info: + /cib: @num_updates=28
Oct 08 20:04:43 pplxnsms02 pacemaker-based [2416] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='siem_rsyslog']/lrm_rsc_op[@id='siem_rsyslog_last_0']: @transition-magic=0:7;13:0:7:4a6bffb4-939f-43ba-ae14-590611334275, @call-id=53, @rc-code=7, @op-status=0, @exec-time=77
Oct 08 20:04:43 pplxnsms02 pacemaker-controld [2422] (process_graph_event) info: Transition 0 action 13 (siem_rsyslog_monitor_0 on pplxnsms02) confirmed: not running | rc=7 call-id=53
Oct 08 20:04:43 pplxnsms02 pacemaker-controld [2422] (te_rsc_command) notice: Initiating monitor operation web_matomo_monitor_0 locally on pplxnsms02 | action 15
Oct 08 20:04:43 pplxnsms02 pacemaker-based [2416] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/53, version=0.524.28)
Oct 08 20:04:43 pplxnsms02 pacemaker-based [2416] (cib_perform_op) info: Diff: --- 0.524.28 2
Oct 08 20:04:43 pplxnsms02 pacemaker-based [2416] (cib_perform_op) info: Diff: +++ 0.524.29 (null)
Oct 08 20:04:43 pplxnsms02 pacemaker-based [2416] (cib_perform_op) info: + /cib: @num_updates=29
Oct 08 20:04:43 pplxnsms02 pacemaker-based [2416] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='siem_fs']/lrm_rsc_op[@id='siem_fs_last_0']: @transition-magic=0:7;12:0:7:4a6bffb4-939f-43ba-ae14-590611334275, @call-id=49, @rc-code=7, @op-status=0, @exec-time=214
Oct 08 20:04:43 pplxnsms02 pacemaker-based [2416] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/54, version=0.524.29)
Oct 08 20:04:43 pplxnsms02 pacemaker-execd [2418] (process_lrmd_get_rsc_info) info: Agent information for 'web_matomo' not in cache
Oct 08 20:04:43 pplxnsms02 pacemaker-execd [2418] (process_lrmd_rsc_register) info: Cached agent information for 'web_matomo'
Oct 08 20:04:43 pplxnsms02 pacemaker-controld [2422] (do_lrm_rsc_op) notice: Requesting local execution of probe operation for web_matomo on pplxnsms02 | transition_key=15:0:7:4a6bffb4-939f-43ba-ae14-590611334275 op_key=web_matomo_monitor_0
Oct 08 20:04:43 pplxnsms02 pacemaker-controld [2422] (wait_for_sync_result) info: apache_meta-data_0[5665] exited with status 0
Oct 08 20:04:43 pplxnsms02 pacemaker-based [2416] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/55)
Oct 08 20:04:43 pplxnsms02 pacemaker-based [2416] (cib_perform_op) info: Diff: --- 0.524.29 2
Oct 08 20:04:43 pplxnsms02 pacemaker-based [2416] (cib_perform_op) info: Diff: +++ 0.524.30 (null)
Oct 08 20:04:43 pplxnsms02 pacemaker-based [2416] (cib_perform_op) info: + /cib: @num_updates=30
Oct 08 20:04:43 pplxnsms02 pacemaker-based [2416] (cib_perform_op) info: ++ /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources:
Oct 08 20:04:43 pplxnsms02 pacemaker-based [2416] (cib_perform_op) info: ++
Oct 08 20:04:43 pplxnsms02 pacemaker-based [2416] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/55, version=0.524.30)
Oct 08 20:04:43 pplxnsms02 pacemaker-controld [2422] (process_graph_event) info: Transition 0 action 12 (siem_fs_monitor_0 on pplxnsms02) confirmed: not running | rc=7 call-id=49
Oct 08 20:04:43 pplxnsms02 pacemaker-controld [2422] (te_rsc_command) notice: Initiating monitor operation fence-sbd_monitor_0 locally on pplxnsms02 | action 16
Oct 08 20:04:43 pplxnsms02 pacemaker-execd [2418] (process_lrmd_get_rsc_info) info: Agent information for 'fence-sbd' not in cache
Oct 08 20:04:43 pplxnsms02 pacemaker-execd [2418] (process_lrmd_rsc_register) info: Cached agent information for 'fence-sbd'
Oct 08 20:04:43 pplxnsms02 pacemaker-controld [2422] (do_lrm_rsc_op) notice: Requesting local execution of probe operation for fence-sbd on pplxnsms02 | transition_key=16:0:7:4a6bffb4-939f-43ba-ae14-590611334275 op_key=fence-sbd_monitor_0
Oct 08 20:04:43 mysql(web_mariadb)[5656]: ERROR: Datadir /siemlog/mysql doesn't exist
Oct 08 20:04:43 mysql(web_mariadb)[5656]: INFO: MySQL is not running
Oct 08 20:04:43 pplxnsms02 pacemaker-fenced [2417] (dynamic_list_search_cb) info: Refreshing target list for fence-sbd
Oct 08 20:04:43 pplxnsms02 pacemaker-fenced [2417] (process_remote_stonith_query) info: Query result 1 of 1 from pplxnsms02 for pplxnsms01/reboot (1 device) a8e030d5-bffc-4b4a-862b-0905b94192c0
Oct 08 20:04:43 pplxnsms02 pacemaker-fenced [2417] (process_remote_stonith_query) info: All query replies have arrived, continuing (1 expected/1 received)
Oct 08 20:04:43 pplxnsms02 pacemaker-fenced [2417] (request_peer_fencing) info: Total timeout set to 60 for peer's fencing targeting pplxnsms01 for pacemaker-controld.2422|id=a8e030d5
Oct 08 20:04:43 pplxnsms02 pacemaker-fenced [2417] (request_peer_fencing) notice: Requesting that pplxnsms02 perform 'reboot' action targeting pplxnsms01 | for client pacemaker-controld.2422 (72s, 0s)
Oct 08 20:04:43 pplxnsms02 pacemaker-fenced [2417] (can_fence_host_with_device) notice: fence-sbd is eligible to fence (reboot) pplxnsms01: dynamic-list
Oct 08 20:04:43 pplxnsms02 pacemaker-fenced [2417] (stonith_fence_get_devices_cb) info: Found 1 matching device for target 'pplxnsms01'
Oct 08 20:04:43 pplxnsms02 pacemaker-execd [2418] (log_op_output) info: web_mariadb_monitor_0[5656] error output [ ocf-exit-reason:Datadir /siemlog/mysql doesn't exist ]
Oct 08 20:04:43 pplxnsms02 pacemaker-controld [2422] (wait_for_sync_result) info: fence_sbd_metadata_1[5769] exited with status 0
Oct 08 20:04:43 pplxnsms02 pacemaker-based [2416] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/56)
Oct 08 20:04:43 pplxnsms02 pacemaker-based [2416] (cib_perform_op) info: Diff: --- 0.524.30 2
Oct 08 20:04:43 pplxnsms02 pacemaker-based [2416] (cib_perform_op) info: Diff: +++ 0.524.31 (null)
Oct 08 20:04:43 pplxnsms02 pacemaker-based [2416] (cib_perform_op) info: + /cib: @num_updates=31
Oct 08 20:04:43 pplxnsms02 pacemaker-based [2416] (cib_perform_op) info: ++ /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources:
Oct 08 20:04:43 pplxnsms02 pacemaker-based [2416] (cib_perform_op) info: ++
Oct 08 20:04:43 pplxnsms02 pacemaker-based [2416] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/56, version=0.524.31)
Oct 08 20:04:43 pplxnsms02 pacemaker-controld [2422] (log_executor_event) notice: Result of probe operation for web_mariadb on pplxnsms02: not running (Datadir /siemlog/mysql doesn't exist) | CIB update 57, graph action confirmed; call=57 key=web_mariadb_monitor_0 rc=7
Oct 08 20:04:43 pplxnsms02 pacemaker-controld [2422] (log_executor_event) notice: web_mariadb_monitor_0@pplxnsms02 output [ ocf-exit-reason:Datadir /siemlog/mysql doesn't exist\n ]
Oct 08 20:04:43 pplxnsms02 pacemaker-based [2416] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/57)
Oct 08 20:04:43 pplxnsms02 pacemaker-based [2416] (cib_perform_op) info: Diff: --- 0.524.31 2
Oct 08 20:04:43 pplxnsms02 pacemaker-based [2416] (cib_perform_op) info: Diff: +++ 0.524.32 (null)
Oct 08 20:04:43 pplxnsms02 pacemaker-based [2416] (cib_perform_op) info: + /cib: @num_updates=32
Oct 08 20:04:43 pplxnsms02 pacemaker-based [2416] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='web_mariadb']/lrm_rsc_op[@id='web_mariadb_last_0']: @transition-magic=0:7;14:0:7:4a6bffb4-939f-43ba-ae14-590611334275, @call-id=57, @rc-code=7, @op-status=0, @last-rc-change=1728389083, @exec-time=157
Oct 08 20:04:43 pplxnsms02 pacemaker-based [2416] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/57, version=0.524.32)
Oct 08 20:04:43 pplxnsms02 pacemaker-controld [2422] (process_graph_event) info: Transition 0 action 14 (web_mariadb_monitor_0 on pplxnsms02) confirmed: not running | rc=7 call-id=57
Oct 08 20:04:43 pplxnsms02 pacemaker-controld [2422] (log_executor_event) notice: Result of probe operation for fence-sbd on pplxnsms02: not running | CIB update 58, graph action confirmed; call=65 key=fence-sbd_monitor_0 rc=7
Oct 08 20:04:43 pplxnsms02 pacemaker-based [2416] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/58)
Oct 08 20:04:43 pplxnsms02 pacemaker-based [2416] (cib_perform_op) info: Diff: --- 0.524.32 2
Oct 08 20:04:43 pplxnsms02 pacemaker-based [2416] (cib_perform_op) info: Diff: +++ 0.524.33 (null)
Oct 08 20:04:43 pplxnsms02 pacemaker-based [2416] (cib_perform_op) info: + /cib: @num_updates=33
Oct 08 20:04:43 pplxnsms02 pacemaker-based [2416] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='fence-sbd']/lrm_rsc_op[@id='fence-sbd_last_0']: @transition-magic=0:7;16:0:7:4a6bffb4-939f-43ba-ae14-590611334275, @call-id=65, @rc-code=7, @op-status=0, @exec-time=5
Oct 08 20:04:43 pplxnsms02 pacemaker-based [2416] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/58, version=0.524.33)
Oct 08 20:04:43 pplxnsms02 pacemaker-controld [2422] (process_graph_event) info: Transition 0 action 16 (fence-sbd_monitor_0 on pplxnsms02) confirmed: not running | rc=7 call-id=65
Oct 08 20:04:43 apache(web_matomo)[5759]: INFO: apache not running
Oct 08 20:04:43 pplxnsms02 pacemaker-controld [2422] (log_executor_event) notice: Result of probe operation for web_matomo on pplxnsms02: not running | CIB update 59, graph action confirmed; call=61 key=web_matomo_monitor_0 rc=7
Oct 08 20:04:43 pplxnsms02 pacemaker-based [2416] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/59)
Oct 08 20:04:43 pplxnsms02 pacemaker-based [2416] (cib_perform_op) info: Diff: --- 0.524.33 2
Oct 08 20:04:43 pplxnsms02 pacemaker-based [2416] (cib_perform_op) info: Diff: +++ 0.524.34 (null)
Oct 08 20:04:43 pplxnsms02 pacemaker-based [2416] (cib_perform_op) info: + /cib: @num_updates=34
Oct 08 20:04:43 pplxnsms02 pacemaker-based [2416] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='web_matomo']/lrm_rsc_op[@id='web_matomo_last_0']: @transition-magic=0:7;15:0:7:4a6bffb4-939f-43ba-ae14-590611334275, @call-id=61, @rc-code=7, @op-status=0, @exec-time=222
Oct 08 20:04:43 pplxnsms02 pacemaker-controld [2422] (process_graph_event) info: Transition 0 action 15 (web_matomo_monitor_0 on pplxnsms02) confirmed: not running | rc=7 call-id=61
Oct 08 20:04:43 pplxnsms02 pacemaker-based [2416] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/59, version=0.524.34)
Oct 08 20:04:44 pplxnsms02 pacemaker-controld [2422] (log_executor_event) notice: Result of probe operation for nco_db2 on pplxnsms02: not running | CIB update 60, graph action confirmed; call=25 key=nco_db2_monitor_0 rc=7
Oct 08 20:04:44 pplxnsms02 pacemaker-based [2416] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/60)
Oct 08 20:04:44 pplxnsms02 pacemaker-based [2416] (cib_perform_op) info: Diff: --- 0.524.34 2
Oct 08 20:04:44 pplxnsms02 pacemaker-based [2416] (cib_perform_op) info: Diff: +++ 0.524.35 (null)
Oct 08 20:04:44 pplxnsms02 pacemaker-based [2416] (cib_perform_op) info: + /cib: @num_updates=35
Oct 08 20:04:44 pplxnsms02 pacemaker-based [2416] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='nco_db2']/lrm_rsc_op[@id='nco_db2_last_0']: @transition-magic=0:7;6:0:7:4a6bffb4-939f-43ba-ae14-590611334275, @call-id=25, @rc-code=7, @op-status=0, @exec-time=2501
Oct 08 20:04:44 pplxnsms02 pacemaker-based [2416] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/60, version=0.524.35)
Oct 08 20:04:44 pplxnsms02 pacemaker-controld [2422] (process_graph_event) info: Transition 0 action 6 (nco_db2_monitor_0 on pplxnsms02) confirmed: not running | rc=7 call-id=25
Oct 08 20:04:49 pplxnsms02 pacemaker-based [2416] (cib_process_ping) info: Reporting our current digest to pplxnsms02: 8931c9c0e2fdb7356621e96f3afe40ce for 0.524.35 (0x558913344290 0)
Oct 08 20:04:50 pplxnsms02 pacemaker-controld [2422] (pcmk__procfs_pid_of) info: Found pacemaker-based active as process 2416
Oct 08 20:04:50 pplxnsms02 pacemaker-controld [2422] (throttle_send_command) info: New throttle mode: low load (was undetermined)
Oct 08 20:05:03 pplxnsms02 pacemaker-fenced [2417] (log_async_result) notice: Operation 'reboot' [5783] targeting pplxnsms01 using fence-sbd returned 0 | call 4 from pacemaker-controld.2422
Oct 08 20:05:03 pplxnsms02 pacemaker-fenced [2417] (finalize_op) notice: Operation 'reboot' targeting pplxnsms01 by pplxnsms02 for pacemaker-controld.2422@pplxnsms02: OK (complete) | id=a8e030d5
Oct 08 20:05:03 pplxnsms02 pacemaker-controld [2422] (tengine_stonith_callback) notice: Fence operation 4 for pplxnsms01 passed
Oct 08 20:05:03 pplxnsms02 pacemaker-controld [2422] (update_peer_state_iter) notice: Node pplxnsms01 state is now lost | nodeid=1 previous=unknown source=crmd_peer_down
Oct 08 20:05:03 pplxnsms02 pacemaker-controld [2422] (peer_update_callback) info: Cluster node pplxnsms01 is now lost (was in unknown state)
Oct 08 20:05:03 pplxnsms02 pacemaker-controld [2422] (crm_update_peer_proc) info: crmd_peer_down: Node pplxnsms01[1] - all processes are now offline
Oct 08 20:05:03 pplxnsms02 pacemaker-controld [2422] (peer_update_callback) info: Node pplxnsms01 is no longer a peer | DC=true old=0x0000000 new=0x0000001
Oct 08 20:05:03 pplxnsms02 pacemaker-controld [2422] (pcmk__update_peer_expected) info: crmd_peer_down: Node pplxnsms01[1] - expected state is now down (was (null))
Oct 08 20:05:03 pplxnsms02 pacemaker-controld [2422] (controld_delete_node_state) info: Deleting all state for node pplxnsms01 (via CIB call 63) | xpath=//node_state[@uname='pplxnsms01']/*
Oct 08 20:05:03 pplxnsms02 pacemaker-controld [2422] (handle_fence_notification) notice: Peer pplxnsms01 was terminated (reboot) by pplxnsms02 on behalf of pacemaker-controld.2422@pplxnsms02: OK | event=a8e030d5-bffc-4b4a-862b-0905b94192c0
Oct 08 20:05:03 pplxnsms02 pacemaker-controld [2422] (controld_delete_node_state) info: Deleting all state for node pplxnsms01 (via CIB call 65) | xpath=//node_state[@uname='pplxnsms01']/*
Oct 08 20:05:03 pplxnsms02 pacemaker-controld [2422] (te_rsc_command) notice: Initiating start operation itm_vip_start_0 locally on pplxnsms02 | action 17
Oct 08 20:05:03 pplxnsms02 pacemaker-controld [2422] (do_lrm_rsc_op) notice: Requesting local execution of start operation for itm_vip on pplxnsms02 | transition_key=17:0:0:4a6bffb4-939f-43ba-ae14-590611334275 op_key=itm_vip_start_0
Oct 08 20:05:03 pplxnsms02 pacemaker-based [2416] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/61)
Oct 08 20:05:03 pplxnsms02 pacemaker-execd [2418] (log_execute) info: executing - rsc:itm_vip action:start call_id:66
Oct 08 20:05:03 pplxnsms02 pacemaker-based [2416] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/62)
Oct 08 20:05:03 pplxnsms02 pacemaker-based [2416] (cib_process_request) info: Forwarding cib_delete operation for section //node_state[@uname='pplxnsms01']/* to all (origin=local/crmd/63)
Oct 08 20:05:03 pplxnsms02 pacemaker-based [2416] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/64)
Oct 08 20:05:03 pplxnsms02 pacemaker-based [2416] (cib_process_request) info: Forwarding cib_delete operation for section //node_state[@uname='pplxnsms01']/* to all (origin=local/crmd/65)
Oct 08 20:05:03 pplxnsms02 pacemaker-based [2416] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/66)
Oct 08 20:05:03 pplxnsms02 pacemaker-based [2416] (cib_perform_op) info: Diff: --- 0.524.35 2
Oct 08 20:05:03 pplxnsms02 pacemaker-based [2416] (cib_perform_op) info: Diff: +++ 0.524.36 (null)
Oct 08 20:05:03 pplxnsms02 pacemaker-based [2416] (cib_perform_op) info: + /cib: @num_updates=36
Oct 08 20:05:03 pplxnsms02 pacemaker-based [2416] (cib_perform_op) info: ++ /cib/status:
Oct 08 20:05:03 pplxnsms02 pacemaker-based [2416] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/61, version=0.524.36)
Oct 08 20:05:03 pplxnsms02 pacemaker-based [2416] (cib_perform_op) info: Diff: --- 0.524.36 2
Oct 08 20:05:03 pplxnsms02 pacemaker-based [2416] (cib_perform_op) info: Diff: +++ 0.524.37 (null)
Oct 08 20:05:03 pplxnsms02 pacemaker-based [2416] (cib_perform_op) info: + /cib: @num_updates=37
Oct 08 20:05:03 pplxnsms02 pacemaker-based [2416] (cib_perform_op) info: + /cib/status/node_state[@id='1']: @crm-debug-origin=send_stonith_update, @in_ccm=false, @join=down, @expected=down
Oct 08 20:05:03 pplxnsms02 pacemaker-based [2416] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/62, version=0.524.37)
Oct 08 20:05:03 pplxnsms02 pacemaker-based [2416] (cib_process_request) info: Completed cib_delete operation for section //node_state[@uname='pplxnsms01']/*: OK (rc=0, origin=pplxnsms02/crmd/63, version=0.524.37)
Oct 08 20:05:03 pplxnsms02 pacemaker-based [2416] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/64, version=0.524.37)
Oct 08 20:05:03 pplxnsms02 pacemaker-controld [2422] (te_rsc_command) notice: Initiating start operation siem_vip_start_0 locally on pplxnsms02 | action 39
Oct 08 20:05:03 pplxnsms02 pacemaker-controld [2422] (do_lrm_rsc_op) notice: Requesting local execution of start operation for siem_vip on pplxnsms02 | transition_key=39:0:0:4a6bffb4-939f-43ba-ae14-590611334275 op_key=siem_vip_start_0
Oct 08 20:05:03 pplxnsms02 pacemaker-execd [2418] (log_execute) info: executing - rsc:siem_vip action:start call_id:67
Oct 08 20:05:03 pplxnsms02 pacemaker-controld [2422] (te_rsc_command) notice: Initiating start operation fence-sbd_start_0 locally on pplxnsms02 | action 51
Oct 08 20:05:03 pplxnsms02 pacemaker-controld [2422] (do_lrm_rsc_op) notice: Requesting local execution of start operation for fence-sbd on pplxnsms02 | transition_key=51:0:0:4a6bffb4-939f-43ba-ae14-590611334275 op_key=fence-sbd_start_0
Oct 08 20:05:03 pplxnsms02 pacemaker-based [2416] (cib_process_request) info: Completed cib_delete operation for section //node_state[@uname='pplxnsms01']/*: OK (rc=0, origin=pplxnsms02/crmd/65, version=0.524.37)
Oct 08 20:05:03 pplxnsms02 pacemaker-based [2416] (cib_perform_op) info: Diff: --- 0.524.37 2
Oct 08 20:05:03 pplxnsms02 pacemaker-based [2416] (cib_perform_op) info: Diff: +++ 0.524.38 (null)
Oct 08 20:05:03 pplxnsms02 pacemaker-based [2416] (cib_perform_op) info: + /cib: @num_updates=38
Oct 08 20:05:03 pplxnsms02 pacemaker-based [2416] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='itm_vip']/lrm_rsc_op[@id='itm_vip_last_0']: @operation_key=itm_vip_start_0, @operation=start, @transition-key=17:0:0:4a6bffb4-939f-43ba-ae14-590611334275, @transition-magic=-1:193;17:0:0:4a6bffb4-939f-43ba-ae14-590611334275, @call-id=-1, @rc-code=193, @op-status=-1, @last-rc-change=1728389103, @exec-time=0
Oct 08 20:05:03 pplxnsms02 pacemaker-based [2416] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/66, version=0.524.38)
Oct 08 20:05:03 pplxnsms02 pacemaker-based [2416] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/67)
Oct 08 20:05:03 pplxnsms02 pacemaker-execd [2418] (log_execute) info: executing - rsc:fence-sbd action:start call_id:68
Oct 08 20:05:03 pplxnsms02 pacemaker-controld [2422] (cib_fencing_updated) info: Fencing update 62 for pplxnsms01: complete
Oct 08 20:05:03 pplxnsms02 pacemaker-controld [2422] (cib_fencing_updated) info: Fencing update 64 for pplxnsms01: complete
Oct 08 20:05:03 pplxnsms02 pacemaker-based [2416] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/68)
Oct 08 20:05:03 pplxnsms02 pacemaker-based [2416] (cib_perform_op) info: Diff: --- 0.524.38 2
Oct 08 20:05:03 pplxnsms02 pacemaker-based [2416] (cib_perform_op) info: Diff: +++ 0.524.39 (null)
Oct 08 20:05:03 pplxnsms02 pacemaker-based [2416] (cib_perform_op) info: + /cib: @num_updates=39
Oct 08 20:05:03 pplxnsms02 pacemaker-based [2416] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='siem_vip']/lrm_rsc_op[@id='siem_vip_last_0']: @operation_key=siem_vip_start_0, @operation=start, @transition-key=39:0:0:4a6bffb4-939f-43ba-ae14-590611334275, @transition-magic=-1:193;39:0:0:4a6bffb4-939f-43ba-ae14-590611334275, @call-id=-1, @rc-code=193, @op-status=-1, @last-rc-change=1728389103, @exec-time=0
Oct 08 20:05:03 pplxnsms02 pacemaker-based [2416] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/67, version=0.524.39)
Oct 08 20:05:03 pplxnsms02 pacemaker-based [2416] (cib_perform_op) info: Diff: --- 0.524.39 2
Oct 08 20:05:03 pplxnsms02 pacemaker-based [2416] (cib_perform_op) info: Diff: +++ 0.524.40 (null)
Oct 08 20:05:03 pplxnsms02 pacemaker-based [2416] (cib_perform_op) info: + /cib: @num_updates=40
Oct 08 20:05:03 pplxnsms02 pacemaker-based [2416] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='fence-sbd']/lrm_rsc_op[@id='fence-sbd_last_0']: @operation_key=fence-sbd_start_0, @operation=start, @transition-key=51:0:0:4a6bffb4-939f-43ba-ae14-590611334275, @transition-magic=-1:193;51:0:0:4a6bffb4-939f-43ba-ae14-590611334275, @call-id=-1, @rc-code=193, @op-status=-1, @last-rc-change=1728389103, @exec-time=0
Oct 08 20:05:03 pplxnsms02 pacemaker-based [2416] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/68, version=0.524.40)
Oct 08 20:05:03 IPaddr2(itm_vip)[6428]: INFO: Adding inet address 192.168.133.136/24 with broadcast address 192.168.133.255 to device ens224
Oct 08 20:05:03 IPaddr2(itm_vip)[6428]: INFO: Bringing device ens224 up
Oct 08 20:05:03 IPaddr2(itm_vip)[6428]: INFO: /usr/libexec/heartbeat/send_arp -i 200 -r 5 -p /run/resource-agents/send_arp-192.168.133.136 ens224 192.168.133.136 auto not_used not_used
Oct 08 20:05:03 pplxnsms02 pacemaker-execd [2418] (log_finished) info: itm_vip start (call 66, PID 6428) exited with status 0 (execution time 128ms)
Oct 08 20:05:03 IPaddr2(siem_vip)[6431]: INFO: Adding inet address 192.168.133.40/24 with broadcast address 192.168.133.255 to device ens224
Oct 08 20:05:03 IPaddr2(siem_vip)[6431]: INFO: Bringing device ens224 up
Oct 08 20:05:03 IPaddr2(siem_vip)[6431]: INFO: /usr/libexec/heartbeat/send_arp -i 200 -r 5 -p /run/resource-agents/send_arp-192.168.133.40 ens224 192.168.133.40 auto not_used not_used
Oct 08 20:05:03 pplxnsms02 pacemaker-controld [2422] (wait_for_sync_result) info: IPaddr2_meta-data_0[6565] exited with status 0
Oct 08 20:05:03 pplxnsms02 pacemaker-controld [2422] (log_executor_event) notice: Result of start operation for itm_vip on pplxnsms02: ok | CIB update 69, graph action confirmed; call=66 key=itm_vip_start_0 rc=0
Oct 08 20:05:03 pplxnsms02 pacemaker-based [2416] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/69)
Oct 08 20:05:03 pplxnsms02 pacemaker-execd [2418] (log_finished) info: siem_vip start (call 67, PID 6431) exited with status 0 (execution time 163ms)
Oct 08 20:05:03 pplxnsms02 pacemaker-based [2416] (cib_perform_op) info: Diff: --- 0.524.40 2
Oct 08 20:05:03 pplxnsms02 pacemaker-based [2416] (cib_perform_op) info: Diff: +++ 0.524.41 (null)
Oct 08 20:05:03 pplxnsms02 pacemaker-based [2416] (cib_perform_op) info: + /cib: @num_updates=41
Oct 08 20:05:03 pplxnsms02 pacemaker-based [2416] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='itm_vip']/lrm_rsc_op[@id='itm_vip_last_0']: @transition-magic=0:0;17:0:0:4a6bffb4-939f-43ba-ae14-590611334275, @call-id=66, @rc-code=0, @op-status=0, @exec-time=128
Oct 08 20:05:03 pplxnsms02 pacemaker-based [2416] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/69, version=0.524.41)
Oct 08 20:05:03 pplxnsms02 pacemaker-controld [2422] (wait_for_sync_result) info: IPaddr2_meta-data_0[6599] exited with status 0
Oct 08 20:05:03 pplxnsms02 pacemaker-controld [2422] (log_executor_event) notice: Result of start operation for siem_vip on pplxnsms02: ok | CIB update 70, graph action confirmed; call=67 key=siem_vip_start_0 rc=0
Oct 08 20:05:03 pplxnsms02 pacemaker-based [2416] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/70)
Oct 08 20:05:03 pplxnsms02 pacemaker-controld [2422] (process_graph_event) info: Transition 0 action 17 (itm_vip_start_0 on pplxnsms02) confirmed: ok | rc=0 call-id=66
Oct 08 20:05:03 pplxnsms02 pacemaker-controld [2422] (te_rsc_command) notice: Initiating monitor operation itm_vip_monitor_10000 locally on pplxnsms02 | action 18
Oct 08 20:05:03 pplxnsms02 pacemaker-controld [2422] (do_lrm_rsc_op) notice: Requesting local execution of monitor operation for itm_vip on pplxnsms02 | transition_key=18:0:0:4a6bffb4-939f-43ba-ae14-590611334275 op_key=itm_vip_monitor_10000
Oct 08 20:05:03 pplxnsms02 pacemaker-based [2416] (cib_perform_op) info: Diff: --- 0.524.41 2
Oct 08 20:05:03 pplxnsms02 pacemaker-based [2416] (cib_perform_op) info: Diff: +++ 0.524.42 (null)
Oct 08 20:05:03 pplxnsms02 pacemaker-based [2416] (cib_perform_op) info: + /cib: @num_updates=42
Oct 08 20:05:03 pplxnsms02 pacemaker-based [2416] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='siem_vip']/lrm_rsc_op[@id='siem_vip_last_0']: @transition-magic=0:0;39:0:0:4a6bffb4-939f-43ba-ae14-590611334275, @call-id=67, @rc-code=0, @op-status=0, @exec-time=163
Oct 08 20:05:03 pplxnsms02 pacemaker-controld [2422] (te_rsc_command) notice: Initiating start operation itm_lvm_start_0 locally on pplxnsms02 | action 19
Oct 08 20:05:03 pplxnsms02 pacemaker-controld [2422] (do_lrm_rsc_op) notice: Requesting local execution of start operation for itm_lvm on pplxnsms02 | transition_key=19:0:0:4a6bffb4-939f-43ba-ae14-590611334275 op_key=itm_lvm_start_0
Oct 08 20:05:03 pplxnsms02 pacemaker-based [2416] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/70, version=0.524.42)
Oct 08 20:05:03 pplxnsms02 pacemaker-execd [2418] (log_execute) info: executing - rsc:itm_lvm action:start call_id:70
Oct 08 20:05:03 pplxnsms02 pacemaker-based [2416] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/71)
Oct 08 20:05:03 pplxnsms02 pacemaker-based [2416] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/72)
Oct 08 20:05:03 pplxnsms02 pacemaker-based [2416] (cib_perform_op) info: Diff: --- 0.524.42 2
Oct 08 20:05:03 pplxnsms02 pacemaker-based [2416] (cib_perform_op) info: Diff: +++ 0.524.43 (null)
Oct 08 20:05:03 pplxnsms02 pacemaker-based [2416] (cib_perform_op) info: + /cib: @num_updates=43
Oct 08 20:05:03 pplxnsms02 pacemaker-based [2416] (cib_perform_op) info: ++ /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='itm_vip']: old=0x0000000 new=0x4000000
Oct 08 20:05:45 pplxnsms02 pacemaker-controld [2430] (te_trigger_stonith_history_sync) info: Fence history will be synchronized cluster-wide within 5 seconds
Oct 08 20:05:45 pplxnsms02 pacemaker-controld [2430] (pcmk__corosync_connect) info: Connection to corosync established
Oct 08 20:05:45 pplxnsms02 pacemaker-attrd [2428] (main) info: Cluster connection active
Oct 08 20:05:45 pplxnsms02 pacemaker-attrd [2428] (attrd_erase_attrs) info: Clearing transient attributes from CIB | xpath=//node_state[@uname='pplxnsms02']/transient_attributes
Oct 08 20:05:45 pplxnsms02 pacemaker-based [2425] (cib_process_request) info: Forwarding cib_delete operation for section //node_state[@uname='pplxnsms02']/transient_attributes to all (origin=local/attrd/2)
Oct 08 20:05:45 pplxnsms02 pacemaker-attrd [2428] (qb_ipcs_us_publish) info: server name: attrd
Oct 08 20:05:45 pplxnsms02 pacemaker-attrd [2428] (main) notice: Pacemaker node attribute manager successfully started and accepting connections
Oct 08 20:05:45 pplxnsms02 pacemaker-attrd [2428] (pcmk_cpg_membership) info: Group attrd event 0: node 2 pid 2428 joined via cpg_join
Oct 08 20:05:45 pplxnsms02 pacemaker-attrd [2428] (pcmk_cpg_membership) info: Group attrd event 0: pplxnsms02 (node 2 pid 2428) is member
Oct 08 20:05:45 pplxnsms02 pacemaker-based [2425] (cib_process_request) info: Completed cib_delete operation for section //node_state[@uname='pplxnsms02']/transient_attributes: OK (rc=0, origin=pplxnsms02/attrd/2, version=0.524.0)
Oct 08 20:05:45 pplxnsms02 pacemaker-attrd [2428] (attrd_peer_update) notice: Setting #attrd-protocol[pplxnsms02]: (unset) -> 3 | from pplxnsms02
Oct 08 20:05:45 pplxnsms02 pacemaker-attrd [2428] (attrd_start_election_if_needed) info: Starting an election to determine the writer
Oct 08 20:05:45 pplxnsms02 pacemaker-controld [2430] (pcmk__corosync_quorum_connect) warning: No quorum
Oct 08 20:05:45 pplxnsms02 pacemaker-attrd [2428] (election_check) info: election-attrd won by local node
Oct 08 20:05:45 pplxnsms02 pacemaker-attrd [2428] (attrd_declare_winner) notice: Recorded local node as attribute writer (was unset)
Oct 08 20:05:45 pplxnsms02 pacemaker-attrd [2428] (write_attribute) info: Processed 1 private change for #attrd-protocol, id=n/a, set=n/a
Oct 08 20:05:45 pplxnsms02 pacemaker-controld [2430] (crm_get_peer) info: Created entry e494ff7a-d069-44fe-b1c7-541e7b7c6c63/0x55696e0a97e0 for node pplxnsms01/1 (2 total)
Oct 08 20:05:45 pplxnsms02 pacemaker-controld [2430] (crm_get_peer) info: Node 1 is now known as pplxnsms01
Oct 08 20:05:45 pplxnsms02 pacemaker-controld [2430] (peer_update_callback) info: Cluster node pplxnsms01 is now in unknown state
Oct 08 20:05:45 pplxnsms02 pacemaker-controld [2430] (crm_get_peer) info: Node 1 has uuid 1
Oct 08 20:05:45 pplxnsms02 pacemaker-controld [2430] (do_ha_control) info: Connected to the cluster
Oct 08 20:05:45 pplxnsms02 pacemaker-controld [2430] (lrmd_ipc_connect) info: Connecting to executor
Oct 08 20:05:45 pplxnsms02 pacemaker-based [2425] (cib_process_request) info: Forwarding cib_modify operation for section nodes to all (origin=local/crmd/4)
Oct 08 20:05:45 pplxnsms02 pacemaker-based [2425] (cib_process_request) info: Completed cib_modify operation for section nodes: OK (rc=0, origin=pplxnsms02/crmd/4, version=0.524.0)
Oct 08 20:05:45 pplxnsms02 pacemaker-controld [2430] (try_local_executor_connect) info: Connection to the local executor established
Oct 08 20:05:45 pplxnsms02 pacemaker-controld [2430] (do_started) info: Delaying start, no membership data (0000000000100000)
Oct 08 20:05:45 pplxnsms02 pacemaker-controld [2430] (do_started) info: Delaying start, no membership data (0000000000100000)
Oct 08 20:05:45 pplxnsms02 pacemaker-controld [2430] (quorum_notification_cb) info: Quorum still lost | membership=1330 members=1
Oct 08 20:05:45 pplxnsms02 pacemaker-controld [2430] (update_peer_state_iter) notice: Node pplxnsms02 state is now member | nodeid=2 previous=unknown source=quorum_notification_cb
Oct 08 20:05:45 pplxnsms02 pacemaker-controld [2430] (peer_update_callback) info: Cluster node pplxnsms02 is now member (was in unknown state)
Oct 08 20:05:45 pplxnsms02 pacemaker-controld [2430] (pcmk__reap_unseen_nodes) info: State of node pplxnsms01[1] is still unknown
Oct 08 20:05:45 pplxnsms02 pacemaker-controld [2430] (do_started) info: Delaying start, Config not read (0000000000000040)
Oct 08 20:05:45 pplxnsms02 pacemaker-controld [2430] (pcmk_cpg_membership) info: Group crmd event 0: node 2 pid 2430 joined via cpg_join
Oct 08 20:05:45 pplxnsms02 pacemaker-controld [2430] (pcmk_cpg_membership) info: Group crmd event 0: pplxnsms02 (node 2 pid 2430) is member
Oct 08 20:05:45 pplxnsms02 pacemaker-controld [2430] (do_started) info: Delaying start, Config not read (0000000000000040)
Oct 08 20:05:45 pplxnsms02 pacemaker-controld [2430] (do_started) info: Delaying start, Config not read (0000000000000040)
Oct 08 20:05:45 pplxnsms02 pacemaker-controld [2430] (qb_ipcs_us_publish) info: server name: crmd
Oct 08 20:05:45 pplxnsms02 pacemaker-controld [2430] (do_started) notice: Pacemaker controller successfully started and accepting connections
Oct 08 20:05:45 pplxnsms02 pacemaker-controld [2430] (do_log) info: Input I_PENDING received in state S_STARTING from do_started
Oct 08 20:05:45 pplxnsms02 pacemaker-controld [2430] (do_state_transition) notice: State transition S_STARTING -> S_PENDING | input=I_PENDING cause=C_FSA_INTERNAL origin=do_started
Oct 08 20:05:46 pplxnsms02 pacemaker-fenced [2426] (wait_for_sync_result) info: fence_sbd_metadata_1[2485] exited with status 0
Oct 08 20:05:46 pplxnsms02 pacemaker-fenced [2426] (stonith_device_register) notice: Added 'fence-sbd' to device list (1 active device)
Oct 08 20:05:46 pplxnsms02 pacemaker-controld [2430] (te_trigger_stonith_history_sync) info: Fence history will be synchronized cluster-wide within 30 seconds
Oct 08 20:05:46 pplxnsms02 pacemaker-controld [2430] (te_connect_stonith) notice: Fencer successfully connected
Oct 08 20:06:06 pplxnsms02 pacemaker-controld [2430] (crm_timer_popped) info: Election Trigger just popped | input=I_DC_TIMEOUT time=20000ms
Oct 08 20:06:06 pplxnsms02 pacemaker-controld [2430] (do_log) warning: Input I_DC_TIMEOUT received in state S_PENDING from crm_timer_popped
Oct 08 20:06:06 pplxnsms02 pacemaker-controld [2430] (do_state_transition) info: State transition S_PENDING -> S_ELECTION | input=I_DC_TIMEOUT cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 08 20:06:06 pplxnsms02 pacemaker-controld [2430] (election_check) info: election-DC won by local node
Oct 08 20:06:06 pplxnsms02 pacemaker-controld [2430] (do_log) info: Input I_ELECTION_DC received in state S_ELECTION from election_win_cb
Oct 08 20:06:06 pplxnsms02 pacemaker-controld [2430] (do_state_transition) notice: State transition S_ELECTION -> S_INTEGRATION | input=I_ELECTION_DC cause=C_FSA_INTERNAL origin=election_win_cb
Oct 08 20:06:06 pplxnsms02 pacemaker-controld [2430] (do_te_control) info: Registering TE UUID: 00c010d1-f636-44e8-903c-cbd8ba175192
Oct 08 20:06:06 pplxnsms02 pacemaker-controld [2430] (pcmk__pid_active) info: Could not read from /proc/1651/exe: Permission denied | errno=13
Oct 08 20:06:06 pplxnsms02 pacemaker-controld [2430] (do_dc_takeover) info: Taking over DC status for this partition
Oct 08 20:06:06 pplxnsms02 pacemaker-based [2425] (cib_process_readwrite) info: We are now in R/W mode
Oct 08 20:06:06 pplxnsms02 pacemaker-based [2425] (cib_process_request) info: Completed cib_master operation for section 'all': OK (rc=0, origin=local/crmd/7, version=0.524.0)
Oct 08 20:06:06 pplxnsms02 pacemaker-based [2425] (cib_process_request) info: Forwarding cib_modify operation for section cib to all (origin=local/crmd/8)
Oct 08 20:06:06 pplxnsms02 pacemaker-based [2425] (cib_process_request) info: Completed cib_modify operation for section cib: OK (rc=0, origin=pplxnsms02/crmd/8, version=0.524.0)
Oct 08 20:06:06 pplxnsms02 pacemaker-based [2425] (cib_process_request) info: Forwarding cib_modify operation for section crm_config to all (origin=local/crmd/10)
Oct 08 20:06:06 pplxnsms02 pacemaker-based [2425] (cib_process_request) info: Completed cib_modify operation for section crm_config: OK (rc=0, origin=pplxnsms02/crmd/10, version=0.524.0)
Oct 08 20:06:06 pplxnsms02 pacemaker-based [2425] (cib_process_request) info: Forwarding cib_modify operation for section crm_config to all (origin=local/crmd/12)
Oct 08 20:06:06 pplxnsms02 pacemaker-controld [2430] (join_make_offer) info: Making join-1 offers based on membership event 1330
Oct 08 20:06:06 pplxnsms02 pacemaker-controld [2430] (join_make_offer) info: Sending join-1 offer to pplxnsms02
Oct 08 20:06:06 pplxnsms02 pacemaker-controld [2430] (join_make_offer) info: Not making join-1 offer to inactive node pplxnsms01
Oct 08 20:06:06 pplxnsms02 pacemaker-controld [2430] (do_dc_join_offer_all) info: Waiting on join-1 requests from 1 outstanding node
Oct 08 20:06:06 pplxnsms02 pacemaker-controld [2430] (update_dc) info: Set DC to pplxnsms02 (3.13.0)
Oct 08 20:06:06 pplxnsms02 pacemaker-controld [2430] (pcmk__update_peer_expected) info: update_dc: Node pplxnsms02[2] - expected state is now member (was (null))
Oct 08 20:06:06 pplxnsms02 pacemaker-based [2425] (cib_process_request) info: Completed cib_modify operation for section crm_config: OK (rc=0, origin=pplxnsms02/crmd/12, version=0.524.0)
Oct 08 20:06:06 pplxnsms02 pacemaker-based [2425] (cib_process_request) info: Forwarding cib_modify operation for section crm_config to all (origin=local/crmd/14)
Oct 08 20:06:06 pplxnsms02 pacemaker-controld [2430] (stonith__watchdog_fencing_enabled_for_node_api) notice: Cluster does not have watchdog fencing device
Oct 08 20:06:06 pplxnsms02 pacemaker-controld [2430] (do_state_transition) info: State transition S_INTEGRATION -> S_FINALIZE_JOIN | input=I_INTEGRATED cause=C_FSA_INTERNAL origin=check_join_state
Oct 08 20:06:06 pplxnsms02 pacemaker-based [2425] (cib_process_request) info: Completed cib_modify operation for section crm_config: OK (rc=0, origin=pplxnsms02/crmd/14, version=0.524.0)
Oct 08 20:06:06 pplxnsms02 pacemaker-based [2425] (cib_process_replace) info: Digest matched on replace from pplxnsms02: 3ee2a3044e50b4f9747d375984348bab
Oct 08 20:06:06 pplxnsms02 pacemaker-based [2425] (cib_process_replace) info: Replaced 0.524.0 with 0.524.0 from pplxnsms02
Oct 08 20:06:06 pplxnsms02 pacemaker-based [2425] (cib_process_request) info: Completed cib_replace operation for section 'all': OK (rc=0, origin=pplxnsms02/crmd/17, version=0.524.0)
Oct 08 20:06:06 pplxnsms02 pacemaker-controld [2430] (controld_delete_node_state) info: Deleting resource history for node pplxnsms02 (via CIB call 19) | xpath=//node_state[@uname='pplxnsms02']/lrm
Oct 08 20:06:06 pplxnsms02 pacemaker-based [2425] (cib_process_request) info: Forwarding cib_modify operation for section nodes to all (origin=local/crmd/18)
Oct 08 20:06:06 pplxnsms02 pacemaker-based [2425] (cib_process_request) info: Forwarding cib_delete operation for section //node_state[@uname='pplxnsms02']/lrm to all (origin=local/crmd/19)
Oct 08 20:06:06 pplxnsms02 pacemaker-based [2425] (cib_process_request) info: Completed cib_modify operation for section nodes: OK (rc=0, origin=pplxnsms02/crmd/18, version=0.524.0)
Oct 08 20:06:06 pplxnsms02 pacemaker-based [2425] (cib_process_request) info: Completed cib_delete operation for section //node_state[@uname='pplxnsms02']/lrm: OK (rc=0, origin=pplxnsms02/crmd/19, version=0.524.0)
Oct 08 20:06:06 pplxnsms02 pacemaker-based [2425] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/20)
Oct 08 20:06:06 pplxnsms02 pacemaker-based [2425] (cib_perform_op) info: Diff: --- 0.524.0 2
Oct 08 20:06:06 pplxnsms02 pacemaker-based [2425] (cib_perform_op) info: Diff: +++ 0.524.1 (null)
Oct 08 20:06:06 pplxnsms02 pacemaker-based [2425] (cib_perform_op) info: + /cib: @num_updates=1
Oct 08 20:06:06 pplxnsms02 pacemaker-based [2425] (cib_perform_op) info: ++ /cib/status:
Oct 08 20:06:06 pplxnsms02 pacemaker-based [2425] (cib_perform_op) info: ++
Oct 08 20:06:06 pplxnsms02 pacemaker-based [2425] (cib_perform_op) info: ++
Oct 08 20:06:06 pplxnsms02 pacemaker-based [2425] (cib_perform_op) info: ++
Oct 08 20:06:06 pplxnsms02 pacemaker-based [2425] (cib_perform_op) info: ++
Oct 08 20:06:06 pplxnsms02 pacemaker-based [2425] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/20, version=0.524.1)
Oct 08 20:06:06 pplxnsms02 pacemaker-controld [2430] (do_state_transition) info: State transition S_FINALIZE_JOIN -> S_POLICY_ENGINE | input=I_FINALIZED cause=C_FSA_INTERNAL origin=check_join_state
Oct 08 20:06:06 pplxnsms02 pacemaker-controld [2430] (create_node_state_update) info: Node update for pplxnsms01 cancelled: no state, not seen yet
Oct 08 20:06:06 pplxnsms02 pacemaker-controld [2430] (abort_transition_graph) info: Transition -1 aborted: Quorum lost | source=crm_update_quorum:435 complete=true
Oct 08 20:06:06 pplxnsms02 pacemaker-controld [2430] (abort_transition_graph) info: Transition -1 aborted: Peer Cancelled | source=do_te_invoke:129 complete=true
Oct 08 20:06:06 pplxnsms02 pacemaker-based [2425] (cib_process_request) info: Forwarding cib_modify operation for section nodes to all (origin=local/crmd/23)
Oct 08 20:06:06 pplxnsms02 pacemaker-based [2425] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/24)
Oct 08 20:06:06 pplxnsms02 pacemaker-based [2425] (cib_process_request) info: Forwarding cib_modify operation for section cib to all (origin=local/crmd/25)
Oct 08 20:06:06 pplxnsms02 pacemaker-based [2425] (cib_process_request) info: Completed cib_modify operation for section nodes: OK (rc=0, origin=pplxnsms02/crmd/23, version=0.524.1)
Oct 08 20:06:06 pplxnsms02 pacemaker-based [2425] (cib_perform_op) info: Diff: --- 0.524.1 2
Oct 08 20:06:06 pplxnsms02 pacemaker-based [2425] (cib_perform_op) info: Diff: +++ 0.524.2 (null)
Oct 08 20:06:06 pplxnsms02 pacemaker-based [2425] (cib_perform_op) info: + /cib: @num_updates=2
Oct 08 20:06:06 pplxnsms02 pacemaker-based [2425] (cib_perform_op) info: + /cib/status/node_state[@id='2']: @crm-debug-origin=do_state_transition, @join=member, @expected=member
Oct 08 20:06:06 pplxnsms02 pacemaker-based [2425] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/24, version=0.524.2)
Oct 08 20:06:06 pplxnsms02 pacemaker-based [2425] (cib_perform_op) info: Diff: --- 0.524.2 2
Oct 08 20:06:06 pplxnsms02 pacemaker-based [2425] (cib_perform_op) info: Diff: +++ 0.524.3 (null)
Oct 08 20:06:06 pplxnsms02 pacemaker-based [2425] (cib_perform_op) info: + /cib: @num_updates=3, @have-quorum=0, @dc-uuid=2
Oct 08 20:06:06 pplxnsms02 pacemaker-based [2425] (cib_process_request) info: Completed cib_modify operation for section cib: OK (rc=0, origin=pplxnsms02/crmd/25, version=0.524.3)
Oct 08 20:06:06 pplxnsms02 pacemaker-based [2425] (cib_file_backup) info: Archived previous version as /var/lib/pacemaker/cib/cib-44.raw
Oct 08 20:06:06 pplxnsms02 pacemaker-based [2425] (cib_file_write_with_digest) info: Wrote version 0.524.0 of the CIB to disk (digest: 96af1578dcfcb025d2483cf61fa5b3e6)
Oct 08 20:06:06 pplxnsms02 pacemaker-based [2425] (cib_file_write_with_digest) info: Reading cluster configuration file /var/lib/pacemaker/cib/cib.1Q3kWl (digest: /var/lib/pacemaker/cib/cib.KwjQo6)
Oct 08 20:06:07 pplxnsms02 pacemaker-schedulerd[2429] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 08 20:06:07 pplxnsms02 pacemaker-schedulerd[2429] (unpack_config) notice: On loss of quorum: Ignore
Oct 08 20:06:07 pplxnsms02 pacemaker-schedulerd[2429] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 08 20:06:07 pplxnsms02 pacemaker-schedulerd[2429] (determine_online_status) info: Node pplxnsms02 is online
Oct 08 20:06:07 pplxnsms02 pacemaker-schedulerd[2429] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 08 20:06:07 pplxnsms02 pacemaker-schedulerd[2429] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 08 20:06:07 pplxnsms02 pacemaker-schedulerd[2429] (RecurringOp) info: Start recurring monitor (10s) for itm_vip on pplxnsms02
Oct 08 20:06:07 pplxnsms02 pacemaker-schedulerd[2429] (RecurringOp) info: Start recurring monitor (30s) for itm_lvm on pplxnsms02
Oct 08 20:06:07 pplxnsms02 pacemaker-schedulerd[2429] (RecurringOp) info: Start recurring monitor (20s) for itm_fs on pplxnsms02
Oct 08 20:06:07 pplxnsms02 pacemaker-schedulerd[2429] (RecurringOp) info: Start recurring monitor (20s) for itm_fs2 on pplxnsms02
Oct 08 20:06:07 pplxnsms02 pacemaker-schedulerd[2429] (RecurringOp) info: Start recurring monitor (20s) for itm_fs3 on pplxnsms02
Oct 08 20:06:07 pplxnsms02 pacemaker-schedulerd[2429] (RecurringOp) info: Start recurring monitor (20s) for nco_db2 on pplxnsms02
Oct 08 20:06:07 pplxnsms02 pacemaker-schedulerd[2429] (RecurringOp) info: Start recurring monitor (60s) for nco_omni on pplxnsms02
Oct 08 20:06:07 pplxnsms02 pacemaker-schedulerd[2429] (RecurringOp) info: Start recurring monitor (300s) for nco_itnm on pplxnsms02
Oct 08 20:06:07 pplxnsms02 pacemaker-schedulerd[2429] (RecurringOp) info: Start recurring monitor (10s) for nco_cognos on pplxnsms02
Oct 08 20:06:07 pplxnsms02 pacemaker-schedulerd[2429] (RecurringOp) info: Start recurring monitor (10s) for siem_vip on pplxnsms02
Oct 08 20:06:07 pplxnsms02 pacemaker-schedulerd[2429] (RecurringOp) info: Start recurring monitor (30s) for siem_lvm on pplxnsms02
Oct 08 20:06:07 pplxnsms02 pacemaker-schedulerd[2429] (RecurringOp) info: Start recurring monitor (20s) for siem_fs on pplxnsms02
Oct 08 20:06:07 pplxnsms02 pacemaker-schedulerd[2429] (RecurringOp) info: Start recurring monitor (10s) for siem_rsyslog on pplxnsms02
Oct 08 20:06:07 pplxnsms02 pacemaker-schedulerd[2429] (RecurringOp) info: Start recurring monitor (60s) for fence-sbd on pplxnsms02
Oct 08 20:06:07 pplxnsms02 pacemaker-schedulerd[2429] (stage6) warning: Scheduling Node pplxnsms01 for STONITH
Oct 08 20:06:07 pplxnsms02 pacemaker-schedulerd[2429] (log_list_item) notice: Actions: Fence (reboot) pplxnsms01 'node is unclean'
Oct 08 20:06:07 pplxnsms02 pacemaker-schedulerd[2429] (log_list_item) notice: Actions: Start itm_vip ( pplxnsms02 )
Oct 08 20:06:07 pplxnsms02 pacemaker-schedulerd[2429] (log_list_item) notice: Actions: Start itm_lvm ( pplxnsms02 )
Oct 08 20:06:07 pplxnsms02 pacemaker-schedulerd[2429] (log_list_item) notice: Actions: Start itm_fs ( pplxnsms02 )
Oct 08 20:06:07 pplxnsms02 pacemaker-schedulerd[2429] (log_list_item) notice: Actions: Start itm_fs2 ( pplxnsms02 )
Oct 08 20:06:07 pplxnsms02 pacemaker-schedulerd[2429] (log_list_item) notice: Actions: Start itm_fs3 ( pplxnsms02 )
Oct 08 20:06:07 pplxnsms02 pacemaker-schedulerd[2429] (log_list_item) notice: Actions: Start nco_db2 ( pplxnsms02 )
Oct 08 20:06:07 pplxnsms02 pacemaker-schedulerd[2429] (log_list_item) notice: Actions: Start nco_omni ( pplxnsms02 )
Oct 08 20:06:07 pplxnsms02 pacemaker-schedulerd[2429] (log_list_item) notice: Actions: Start nco_itnm ( pplxnsms02 )
Oct 08 20:06:07 pplxnsms02 pacemaker-schedulerd[2429] (log_list_item) notice: Actions: Start nco_cognos ( pplxnsms02 )
Oct 08 20:06:07 pplxnsms02 pacemaker-schedulerd[2429] (log_list_item) notice: Actions: Start siem_vip ( pplxnsms02 )
Oct 08 20:06:07 pplxnsms02 pacemaker-schedulerd[2429] (log_list_item) notice: Actions: Start siem_lvm ( pplxnsms02 )
Oct 08 20:06:07 pplxnsms02 pacemaker-schedulerd[2429] (log_list_item) notice: Actions: Start siem_fs ( pplxnsms02 )
Oct 08 20:06:07 pplxnsms02 pacemaker-schedulerd[2429] (log_list_item) notice: Actions: Start siem_rsyslog ( pplxnsms02 )
Oct 08 20:06:07 pplxnsms02 pacemaker-schedulerd[2429] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 08 20:06:07 pplxnsms02 pacemaker-schedulerd[2429] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 08 20:06:07 pplxnsms02 pacemaker-schedulerd[2429] (log_list_item) notice: Actions: Start fence-sbd ( pplxnsms02 )
Oct 08 20:06:07 pplxnsms02 pacemaker-schedulerd[2429] (pcmk__log_transition_summary) warning: Calculated transition 0 (with warnings), saving inputs in /var/lib/pacemaker/pengine/pe-warn-98.bz2
Oct 08 20:06:07 pplxnsms02 pacemaker-controld [2430] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 08 20:06:07 pplxnsms02 pacemaker-controld [2430] (do_te_invoke) info: Processing graph 0 (ref=pe_calc-dc-1728389167-8) derived from /var/lib/pacemaker/pengine/pe-warn-98.bz2
Oct 08 20:06:07 pplxnsms02 pacemaker-controld [2430] (te_rsc_command) notice: Initiating monitor operation itm_vip_monitor_0 locally on pplxnsms02 | action 1
Oct 08 20:06:07 pplxnsms02 pacemaker-execd [2427] (process_lrmd_get_rsc_info) info: Agent information for 'itm_vip' not in cache
Oct 08 20:06:07 pplxnsms02 pacemaker-execd [2427] (process_lrmd_rsc_register) info: Cached agent information for 'itm_vip'
Oct 08 20:06:07 pplxnsms02 pacemaker-controld [2430] (do_lrm_rsc_op) notice: Requesting local execution of probe operation for itm_vip on pplxnsms02 | transition_key=1:0:7:00c010d1-f636-44e8-903c-cbd8ba175192 op_key=itm_vip_monitor_0
Oct 08 20:06:07 pplxnsms02 pacemaker-controld [2430] (wait_for_sync_result) info: IPaddr2_meta-data_0[4642] exited with status 0
Oct 08 20:06:07 pplxnsms02 pacemaker-based [2425] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/29)
Oct 08 20:06:07 pplxnsms02 pacemaker-controld [2430] (te_rsc_command) notice: Initiating monitor operation itm_lvm_monitor_0 locally on pplxnsms02 | action 2
Oct 08 20:06:07 pplxnsms02 pacemaker-based [2425] (cib_perform_op) info: Diff: --- 0.524.3 2
Oct 08 20:06:07 pplxnsms02 pacemaker-based [2425] (cib_perform_op) info: Diff: +++ 0.524.4 (null)
Oct 08 20:06:07 pplxnsms02 pacemaker-based [2425] (cib_perform_op) info: + /cib: @num_updates=4
Oct 08 20:06:07 pplxnsms02 pacemaker-based [2425] (cib_perform_op) info: + /cib/status/node_state[@id='2']: @crm-debug-origin=do_update_resource
Oct 08 20:06:07 pplxnsms02 pacemaker-based [2425] (cib_perform_op) info: ++ /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources:
Oct 08 20:06:07 pplxnsms02 pacemaker-based [2425] (cib_perform_op) info: ++
Oct 08 20:06:07 pplxnsms02 pacemaker-based [2425] (cib_perform_op) info: ++
Oct 08 20:06:08 pplxnsms02 pacemaker-based [2425] (cib_perform_op) info: ++
Oct 08 20:06:08 pplxnsms02 pacemaker-based [2425] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/31, version=0.524.6)
Oct 08 20:06:08 pplxnsms02 pacemaker-controld [2430] (te_rsc_command) notice: Initiating monitor operation itm_fs2_monitor_0 locally on pplxnsms02 | action 4
Oct 08 20:06:08 pplxnsms02 pacemaker-execd [2427] (process_lrmd_get_rsc_info) info: Agent information for 'itm_fs2' not in cache
Oct 08 20:06:08 pplxnsms02 pacemaker-execd [2427] (process_lrmd_rsc_register) info: Cached agent information for 'itm_fs2'
Oct 08 20:06:08 pplxnsms02 pacemaker-controld [2430] (do_lrm_rsc_op) notice: Requesting local execution of probe operation for itm_fs2 on pplxnsms02 | transition_key=4:0:7:00c010d1-f636-44e8-903c-cbd8ba175192 op_key=itm_fs2_monitor_0
Oct 08 20:06:08 pplxnsms02 pacemaker-based [2425] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/32)
Oct 08 20:06:08 pplxnsms02 pacemaker-based [2425] (cib_perform_op) info: Diff: --- 0.524.6 2
Oct 08 20:06:08 pplxnsms02 pacemaker-based [2425] (cib_perform_op) info: Diff: +++ 0.524.7 (null)
Oct 08 20:06:08 pplxnsms02 pacemaker-based [2425] (cib_perform_op) info: + /cib: @num_updates=7
Oct 08 20:06:08 pplxnsms02 pacemaker-based [2425] (cib_perform_op) info: ++ /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources:
Oct 08 20:06:08 pplxnsms02 pacemaker-based [2425] (cib_perform_op) info: ++
Oct 08 20:06:08 pplxnsms02 pacemaker-based [2425] (cib_perform_op) info: ++
Oct 08 20:06:08 pplxnsms02 pacemaker-based [2425] (cib_perform_op) info: ++
Oct 08 20:06:08 pplxnsms02 pacemaker-based [2425] (cib_perform_op) info: ++
Oct 08 20:06:08 pplxnsms02 pacemaker-based [2425] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/38, version=0.524.13)
Oct 08 20:06:08 pplxnsms02 pacemaker-controld [2430] (log_executor_event) notice: Result of probe operation for itm_fs2 on pplxnsms02: not running | CIB update 39, graph action confirmed; call=17 key=itm_fs2_monitor_0 rc=7
Oct 08 20:06:08 pplxnsms02 pacemaker-controld [2430] (log_executor_event) notice: Result of probe operation for itm_fs on pplxnsms02: not running | CIB update 40, graph action confirmed; call=13 key=itm_fs_monitor_0 rc=7
Oct 08 20:06:08 pplxnsms02 pacemaker-based [2425] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/39)
Oct 08 20:06:08 pplxnsms02 pacemaker-based [2425] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/40)
Oct 08 20:06:08 pplxnsms02 pacemaker-based [2425] (cib_perform_op) info: Diff: --- 0.524.13 2
Oct 08 20:06:08 pplxnsms02 pacemaker-based [2425] (cib_perform_op) info: Diff: +++ 0.524.14 (null)
Oct 08 20:06:08 pplxnsms02 pacemaker-based [2425] (cib_perform_op) info: + /cib: @num_updates=14
Oct 08 20:06:08 pplxnsms02 pacemaker-based [2425] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='itm_fs2']/lrm_rsc_op[@id='itm_fs2_last_0']: @transition-magic=0:7;4:0:7:00c010d1-f636-44e8-903c-cbd8ba175192, @call-id=17, @rc-code=7, @op-status=0, @exec-time=587, @queue-time=2
Oct 08 20:06:08 pplxnsms02 pacemaker-based [2425] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/39, version=0.524.14)
Oct 08 20:06:08 pplxnsms02 pacemaker-based [2425] (cib_perform_op) info: Diff: --- 0.524.14 2
Oct 08 20:06:08 pplxnsms02 pacemaker-based [2425] (cib_perform_op) info: Diff: +++ 0.524.15 (null)
Oct 08 20:06:08 pplxnsms02 pacemaker-based [2425] (cib_perform_op) info: + /cib: @num_updates=15
Oct 08 20:06:08 pplxnsms02 pacemaker-based [2425] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='itm_fs']/lrm_rsc_op[@id='itm_fs_last_0']: @transition-magic=0:7;3:0:7:00c010d1-f636-44e8-903c-cbd8ba175192, @call-id=13, @rc-code=7, @op-status=0, @last-rc-change=1728389168, @exec-time=614
Oct 08 20:06:08 pplxnsms02 pacemaker-based [2425] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/40, version=0.524.15)
Oct 08 20:06:08 pplxnsms02 pacemaker-controld [2430] (process_graph_event) info: Transition 0 action 4 (itm_fs2_monitor_0 on pplxnsms02) confirmed: not running | rc=7 call-id=17
Oct 08 20:06:08 pplxnsms02 pacemaker-controld [2430] (process_graph_event) info: Transition 0 action 3 (itm_fs_monitor_0 on pplxnsms02) confirmed: not running | rc=7 call-id=13
Oct 08 20:06:08 pplxnsms02 pacemaker-controld [2430] (te_rsc_command) notice: Initiating monitor operation nco_itnm_monitor_0 locally on pplxnsms02 | action 8
Oct 08 20:06:08 pplxnsms02 pacemaker-execd [2427] (process_lrmd_get_rsc_info) info: Agent information for 'nco_itnm' not in cache
Oct 08 20:06:08 pplxnsms02 pacemaker-execd [2427] (process_lrmd_rsc_register) info: Cached agent information for 'nco_itnm'
Oct 08 20:06:08 pplxnsms02 pacemaker-controld [2430] (do_lrm_rsc_op) notice: Requesting local execution of probe operation for nco_itnm on pplxnsms02 | transition_key=8:0:7:00c010d1-f636-44e8-903c-cbd8ba175192 op_key=nco_itnm_monitor_0
Oct 08 20:06:08 omnibus(nco_omni)[5272]: ERROR: Cannot find the directory /san/tivoli/netcool!
Oct 08 20:06:08 pplxnsms02 pacemaker-controld [2430] (wait_for_sync_result) info: itnm_meta-data_0[5283] exited with status 0
Oct 08 20:06:08 pplxnsms02 pacemaker-based [2425] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/41)
Oct 08 20:06:08 pplxnsms02 pacemaker-based [2425] (cib_perform_op) info: Diff: --- 0.524.15 2
Oct 08 20:06:08 pplxnsms02 pacemaker-based [2425] (cib_perform_op) info: Diff: +++ 0.524.16 (null)
Oct 08 20:06:08 pplxnsms02 pacemaker-based [2425] (cib_perform_op) info: + /cib: @num_updates=16
Oct 08 20:06:08 pplxnsms02 pacemaker-based [2425] (cib_perform_op) info: ++ /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources:
Oct 08 20:06:08 pplxnsms02 pacemaker-based [2425] (cib_perform_op) info: ++
Oct 08 20:06:08 pplxnsms02 pacemaker-based [2425] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/41, version=0.524.16)
Oct 08 20:06:08 pplxnsms02 pacemaker-controld [2430] (te_rsc_command) notice: Initiating monitor operation nco_cognos_monitor_0 locally on pplxnsms02 | action 9
Oct 08 20:06:08 pplxnsms02 pacemaker-execd [2427] (process_lrmd_get_rsc_info) info: Agent information for 'nco_cognos' not in cache
Oct 08 20:06:08 pplxnsms02 pacemaker-execd [2427] (process_lrmd_rsc_register) info: Cached agent information for 'nco_cognos'
Oct 08 20:06:08 pplxnsms02 pacemaker-controld [2430] (do_lrm_rsc_op) notice: Requesting local execution of probe operation for nco_cognos on pplxnsms02 | transition_key=9:0:7:00c010d1-f636-44e8-903c-cbd8ba175192 op_key=nco_cognos_monitor_0
Oct 08 20:06:08 itnm(nco_itnm)[5305]: ERROR: Cannot find the directory /san/tivoli/netcool!
Oct 08 20:06:08 pplxnsms02 pacemaker-controld [2430] (wait_for_sync_result) info: Cognos_meta-data_0[5311] exited with status 0
Oct 08 20:06:08 pplxnsms02 pacemaker-based [2425] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/42)
Oct 08 20:06:08 pplxnsms02 pacemaker-based [2425] (cib_perform_op) info: Diff: --- 0.524.16 2
Oct 08 20:06:08 pplxnsms02 pacemaker-based [2425] (cib_perform_op) info: Diff: +++ 0.524.17 (null)
Oct 08 20:06:08 pplxnsms02 pacemaker-based [2425] (cib_perform_op) info: + /cib: @num_updates=17
Oct 08 20:06:08 pplxnsms02 pacemaker-based [2425] (cib_perform_op) info: ++ /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources:
Oct 08 20:06:08 pplxnsms02 pacemaker-based [2425] (cib_perform_op) info: ++
Oct 08 20:06:08 pplxnsms02 pacemaker-based [2425] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/42, version=0.524.17)
Oct 08 20:06:08 pplxnsms02 pacemaker-controld [2430] (log_executor_event) notice: Result of probe operation for nco_omni on pplxnsms02: not running | CIB update 43, graph action confirmed; call=29 key=nco_omni_monitor_0 rc=7
Oct 08 20:06:08 pplxnsms02 pacemaker-based [2425] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/43)
Oct 08 20:06:08 pplxnsms02 pacemaker-based [2425] (cib_perform_op) info: Diff: --- 0.524.17 2
Oct 08 20:06:08 pplxnsms02 pacemaker-based [2425] (cib_perform_op) info: Diff: +++ 0.524.18 (null)
Oct 08 20:06:08 pplxnsms02 pacemaker-based [2425] (cib_perform_op) info: + /cib: @num_updates=18
Oct 08 20:06:08 pplxnsms02 pacemaker-based [2425] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='nco_omni']/lrm_rsc_op[@id='nco_omni_last_0']: @transition-magic=0:7;7:0:7:00c010d1-f636-44e8-903c-cbd8ba175192, @call-id=29, @rc-code=7, @op-status=0, @exec-time=54
Oct 08 20:06:08 pplxnsms02 pacemaker-based [2425] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/43, version=0.524.18)
Oct 08 20:06:08 pplxnsms02 pacemaker-controld [2430] (process_graph_event) info: Transition 0 action 7 (nco_omni_monitor_0 on pplxnsms02) confirmed: not running | rc=7 call-id=29
Oct 08 20:06:08 pplxnsms02 pacemaker-controld [2430] (log_executor_event) notice: Result of probe operation for nco_itnm on pplxnsms02: not running | CIB update 44, graph action confirmed; call=33 key=nco_itnm_monitor_0 rc=7
Oct 08 20:06:08 pplxnsms02 pacemaker-controld [2430] (te_rsc_command) notice: Initiating monitor operation siem_vip_monitor_0 locally on pplxnsms02 | action 10
Oct 08 20:06:08 pplxnsms02 pacemaker-based [2425] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/44)
Oct 08 20:06:08 pplxnsms02 pacemaker-based [2425] (cib_perform_op) info: Diff: --- 0.524.18 2
Oct 08 20:06:08 pplxnsms02 pacemaker-based [2425] (cib_perform_op) info: Diff: +++ 0.524.19 (null)
Oct 08 20:06:08 pplxnsms02 pacemaker-based [2425] (cib_perform_op) info: + /cib: @num_updates=19
Oct 08 20:06:08 pplxnsms02 pacemaker-based [2425] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='nco_itnm']/lrm_rsc_op[@id='nco_itnm_last_0']: @transition-magic=0:7;8:0:7:00c010d1-f636-44e8-903c-cbd8ba175192, @call-id=33, @rc-code=7, @op-status=0, @exec-time=70
Oct 08 20:06:08 pplxnsms02 pacemaker-based [2425] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/44, version=0.524.19)
Oct 08 20:06:08 pplxnsms02 pacemaker-execd [2427] (process_lrmd_get_rsc_info) info: Agent information for 'siem_vip' not in cache
Oct 08 20:06:08 pplxnsms02 pacemaker-execd [2427] (process_lrmd_rsc_register) info: Cached agent information for 'siem_vip'
Oct 08 20:06:08 pplxnsms02 pacemaker-controld [2430] (do_lrm_rsc_op) notice: Requesting local execution of probe operation for siem_vip on pplxnsms02 | transition_key=10:0:7:00c010d1-f636-44e8-903c-cbd8ba175192 op_key=siem_vip_monitor_0
Oct 08 20:06:08 pplxnsms02 pacemaker-based [2425] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/45)
Oct 08 20:06:08 pplxnsms02 pacemaker-based [2425] (cib_perform_op) info: Diff: --- 0.524.19 2
Oct 08 20:06:08 pplxnsms02 pacemaker-based [2425] (cib_perform_op) info: Diff: +++ 0.524.20 (null)
Oct 08 20:06:08 pplxnsms02 pacemaker-based [2425] (cib_perform_op) info: + /cib: @num_updates=20
Oct 08 20:06:08 pplxnsms02 pacemaker-based [2425] (cib_perform_op) info: ++ /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources:
Oct 08 20:06:08 pplxnsms02 pacemaker-based [2425] (cib_perform_op) info: ++
Oct 08 20:06:08 pplxnsms02 pacemaker-based [2425] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/45, version=0.524.20)
Oct 08 20:06:08 pplxnsms02 pacemaker-controld [2430] (process_graph_event) info: Transition 0 action 8 (nco_itnm_monitor_0 on pplxnsms02) confirmed: not running | rc=7 call-id=33
Oct 08 20:06:08 pplxnsms02 pacemaker-controld [2430] (te_rsc_command) notice: Initiating monitor operation siem_lvm_monitor_0 locally on pplxnsms02 | action 11
Oct 08 20:06:08 pplxnsms02 pacemaker-execd [2427] (process_lrmd_get_rsc_info) info: Agent information for 'siem_lvm' not in cache
Oct 08 20:06:08 pplxnsms02 pacemaker-execd [2427] (process_lrmd_rsc_register) info: Cached agent information for 'siem_lvm'
Oct 08 20:06:08 pplxnsms02 pacemaker-controld [2430] (do_lrm_rsc_op) notice: Requesting local execution of probe operation for siem_lvm on pplxnsms02 | transition_key=11:0:7:00c010d1-f636-44e8-903c-cbd8ba175192 op_key=siem_lvm_monitor_0
Oct 08 20:06:08 pplxnsms02 pacemaker-based [2425] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/46)
Oct 08 20:06:08 pplxnsms02 pacemaker-based [2425] (cib_perform_op) info: Diff: --- 0.524.20 2
Oct 08 20:06:08 pplxnsms02 pacemaker-based [2425] (cib_perform_op) info: Diff: +++ 0.524.21 (null)
Oct 08 20:06:08 pplxnsms02 pacemaker-based [2425] (cib_perform_op) info: + /cib: @num_updates=21
Oct 08 20:06:08 pplxnsms02 pacemaker-based [2425] (cib_perform_op) info: ++ /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources:
Oct 08 20:06:08 pplxnsms02 pacemaker-based [2425] (cib_perform_op) info: ++
Oct 08 20:06:08 pplxnsms02 pacemaker-based [2425] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/46, version=0.524.21)
Oct 08 20:06:08 Cognos(nco_cognos)[5341]: ERROR: Cannot find the directory /san/tivoli/IBM/WebSphere!
Oct 08 20:06:08 pplxnsms02 pacemaker-fenced [2426] (dynamic_list_search_cb) info: Refreshing target list for fence-sbd
Oct 08 20:06:08 pplxnsms02 pacemaker-fenced [2426] (process_remote_stonith_query) info: Query result 1 of 1 from pplxnsms02 for pplxnsms01/reboot (1 device) b5c31e1a-dfb7-457d-a048-bd65f6b628e6
Oct 08 20:06:08 pplxnsms02 pacemaker-fenced [2426] (process_remote_stonith_query) info: All query replies have arrived, continuing (1 expected/1 received)
Oct 08 20:06:08 pplxnsms02 pacemaker-fenced [2426] (request_peer_fencing) info: Total timeout set to 60 for peer's fencing targeting pplxnsms01 for pacemaker-controld.2430|id=b5c31e1a
Oct 08 20:06:08 pplxnsms02 pacemaker-fenced [2426] (request_peer_fencing) notice: Requesting that pplxnsms02 perform 'reboot' action targeting pplxnsms01 | for client pacemaker-controld.2430 (72s, 0s)
Oct 08 20:06:08 pplxnsms02 pacemaker-fenced [2426] (can_fence_host_with_device) notice: fence-sbd is eligible to fence (reboot) pplxnsms01: dynamic-list
Oct 08 20:06:08 pplxnsms02 pacemaker-fenced [2426] (stonith_fence_get_devices_cb) info: Found 1 matching device for target 'pplxnsms01'
Oct 08 20:06:09 pplxnsms02 pacemaker-controld [2430] (log_executor_event) notice: Result of probe operation for nco_cognos on pplxnsms02: not running | CIB update 47, graph action confirmed; call=37 key=nco_cognos_monitor_0 rc=7
Oct 08 20:06:09 pplxnsms02 pacemaker-based [2425] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/47)
Oct 08 20:06:09 pplxnsms02 pacemaker-controld [2430] (log_executor_event) notice: Result of probe operation for siem_lvm on pplxnsms02: not running | CIB update 48, graph action confirmed; call=45 key=siem_lvm_monitor_0 rc=7
Oct 08 20:06:09 pplxnsms02 pacemaker-based [2425] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/48)
Oct 08 20:06:09 pplxnsms02 pacemaker-based [2425] (cib_perform_op) info: Diff: --- 0.524.21 2
Oct 08 20:06:09 pplxnsms02 pacemaker-based [2425] (cib_perform_op) info: Diff: +++ 0.524.22 (null)
Oct 08 20:06:09 pplxnsms02 pacemaker-based [2425] (cib_perform_op) info: + /cib: @num_updates=22
Oct 08 20:06:09 pplxnsms02 pacemaker-based [2425] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='nco_cognos']/lrm_rsc_op[@id='nco_cognos_last_0']: @transition-magic=0:7;9:0:7:00c010d1-f636-44e8-903c-cbd8ba175192, @call-id=37, @rc-code=7, @op-status=0, @exec-time=131
Oct 08 20:06:09 pplxnsms02 pacemaker-based [2425] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/47, version=0.524.22)
Oct 08 20:06:09 pplxnsms02 pacemaker-based [2425] (cib_perform_op) info: Diff: --- 0.524.22 2
Oct 08 20:06:09 pplxnsms02 pacemaker-based [2425] (cib_perform_op) info: Diff: +++ 0.524.23 (null)
Oct 08 20:06:09 pplxnsms02 pacemaker-based [2425] (cib_perform_op) info: + /cib: @num_updates=23
Oct 08 20:06:09 pplxnsms02 pacemaker-based [2425] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='siem_lvm']/lrm_rsc_op[@id='siem_lvm_last_0']: @transition-magic=0:7;11:0:7:00c010d1-f636-44e8-903c-cbd8ba175192, @call-id=45, @rc-code=7, @op-status=0, @exec-time=83
Oct 08 20:06:09 pplxnsms02 pacemaker-based [2425] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/48, version=0.524.23)
Oct 08 20:06:09 pplxnsms02 pacemaker-controld [2430] (process_graph_event) info: Transition 0 action 9 (nco_cognos_monitor_0 on pplxnsms02) confirmed: not running | rc=7 call-id=37
Oct 08 20:06:09 pplxnsms02 pacemaker-controld [2430] (process_graph_event) info: Transition 0 action 11 (siem_lvm_monitor_0 on pplxnsms02) confirmed: not running | rc=7 call-id=45
Oct 08 20:06:09 pplxnsms02 pacemaker-controld [2430] (te_rsc_command) notice: Initiating monitor operation siem_fs_monitor_0 locally on pplxnsms02 | action 12
Oct 08 20:06:09 pplxnsms02 pacemaker-execd [2427] (process_lrmd_get_rsc_info) info: Agent information for 'siem_fs' not in cache
Oct 08 20:06:09 pplxnsms02 pacemaker-execd [2427] (process_lrmd_rsc_register) info: Cached agent information for 'siem_fs'
Oct 08 20:06:09 pplxnsms02 pacemaker-controld [2430] (do_lrm_rsc_op) notice: Requesting local execution of probe operation for siem_fs on pplxnsms02 | transition_key=12:0:7:00c010d1-f636-44e8-903c-cbd8ba175192 op_key=siem_fs_monitor_0
Oct 08 20:06:09 pplxnsms02 pacemaker-based [2425] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/49)
Oct 08 20:06:09 pplxnsms02 pacemaker-based [2425] (cib_perform_op) info: Diff: --- 0.524.23 2
Oct 08 20:06:09 pplxnsms02 pacemaker-based [2425] (cib_perform_op) info: Diff: +++ 0.524.24 (null)
Oct 08 20:06:09 pplxnsms02 pacemaker-based [2425] (cib_perform_op) info: + /cib: @num_updates=24
Oct 08 20:06:09 pplxnsms02 pacemaker-based [2425] (cib_perform_op) info: ++ /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources:
Oct 08 20:06:09 pplxnsms02 pacemaker-based [2425] (cib_perform_op) info: ++
Oct 08 20:06:09 pplxnsms02 pacemaker-controld [2430] (te_rsc_command) notice: Initiating monitor operation siem_rsyslog_monitor_0 locally on pplxnsms02 | action 13
Oct 08 20:06:09 pplxnsms02 pacemaker-execd [2427] (process_lrmd_get_rsc_info) info: Agent information for 'siem_rsyslog' not in cache
Oct 08 20:06:09 pplxnsms02 pacemaker-execd [2427] (process_lrmd_rsc_register) info: Cached agent information for 'siem_rsyslog'
Oct 08 20:06:09 pplxnsms02 pacemaker-controld [2430] (do_lrm_rsc_op) notice: Requesting local execution of probe operation for siem_rsyslog on pplxnsms02 | transition_key=13:0:7:00c010d1-f636-44e8-903c-cbd8ba175192 op_key=siem_rsyslog_monitor_0
Oct 08 20:06:09 pplxnsms02 pacemaker-based [2425] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/49, version=0.524.24)
Oct 08 20:06:09 pplxnsms02 pacemaker-controld [2430] (wait_for_sync_result) info: siemsyslog_meta-data_0[5435] exited with status 0
Oct 08 20:06:09 pplxnsms02 pacemaker-based [2425] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/50)
Oct 08 20:06:09 pplxnsms02 pacemaker-based [2425] (cib_perform_op) info: Diff: --- 0.524.24 2
Oct 08 20:06:09 pplxnsms02 pacemaker-based [2425] (cib_perform_op) info: Diff: +++ 0.524.25 (null)
Oct 08 20:06:09 pplxnsms02 pacemaker-based [2425] (cib_perform_op) info: + /cib: @num_updates=25
Oct 08 20:06:09 pplxnsms02 pacemaker-based [2425] (cib_perform_op) info: ++ /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources:
Oct 08 20:06:09 pplxnsms02 pacemaker-based [2425] (cib_perform_op) info: ++
Oct 08 20:06:09 pplxnsms02 pacemaker-based [2425] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/50, version=0.524.25)
Oct 08 20:06:09 pplxnsms02 pacemaker-execd [2427] (log_op_output) info: siem_rsyslog_monitor_0[5468] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 3077 1 0 20:05 ? 00:00:00 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:06:09 pplxnsms02 pacemaker-controld [2430] (log_executor_event) notice: Result of probe operation for siem_rsyslog on pplxnsms02: not running | CIB update 51, graph action confirmed; call=53 key=siem_rsyslog_monitor_0 rc=7
Oct 08 20:06:09 pplxnsms02 pacemaker-controld [2430] (log_executor_event) notice: siem_rsyslog_monitor_0@pplxnsms02 output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 3077 1 0 20:05 ? 00:00:00 /usr/sbin/rsyslogd -n: integer expression expected\n ]
Oct 08 20:06:09 pplxnsms02 pacemaker-based [2425] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/51)
Oct 08 20:06:09 pplxnsms02 pacemaker-based [2425] (cib_perform_op) info: Diff: --- 0.524.25 2
Oct 08 20:06:09 pplxnsms02 pacemaker-based [2425] (cib_perform_op) info: Diff: +++ 0.524.26 (null)
Oct 08 20:06:09 pplxnsms02 pacemaker-based [2425] (cib_perform_op) info: + /cib: @num_updates=26
Oct 08 20:06:09 pplxnsms02 pacemaker-based [2425] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='siem_rsyslog']/lrm_rsc_op[@id='siem_rsyslog_last_0']: @transition-magic=0:7;13:0:7:00c010d1-f636-44e8-903c-cbd8ba175192, @call-id=53, @rc-code=7, @op-status=0, @exec-time=104
Oct 08 20:06:09 pplxnsms02 pacemaker-based [2425] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/51, version=0.524.26)
Oct 08 20:06:09 pplxnsms02 pacemaker-controld [2430] (process_graph_event) info: Transition 0 action 13 (siem_rsyslog_monitor_0 on pplxnsms02) confirmed: not running | rc=7 call-id=53
Oct 08 20:06:09 pplxnsms02 pacemaker-controld [2430] (te_rsc_command) notice: Initiating monitor operation web_mariadb_monitor_0 locally on pplxnsms02 | action 14
Oct 08 20:06:09 pplxnsms02 pacemaker-execd [2427] (process_lrmd_get_rsc_info) info: Agent information for 'web_mariadb' not in cache
Oct 08 20:06:09 pplxnsms02 pacemaker-execd [2427] (process_lrmd_rsc_register) info: Cached agent information for 'web_mariadb'
Oct 08 20:06:09 pplxnsms02 pacemaker-controld [2430] (do_lrm_rsc_op) notice: Requesting local execution of probe operation for web_mariadb on pplxnsms02 | transition_key=14:0:7:00c010d1-f636-44e8-903c-cbd8ba175192 op_key=web_mariadb_monitor_0
Oct 08 20:06:09 Filesystem(siem_fs)[5432]: WARNING: Couldn't find device [/dev/vgslog/lv_log01]. Expected /dev/??? to exist
Oct 08 20:06:09 pplxnsms02 pacemaker-controld [2430] (wait_for_sync_result) info: mysql_meta-data_0[5559] exited with status 0
Oct 08 20:06:09 pplxnsms02 pacemaker-based [2425] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/52)
Oct 08 20:06:09 pplxnsms02 pacemaker-controld [2430] (log_executor_event) notice: Result of probe operation for siem_vip on pplxnsms02: not running | CIB update 53, graph action confirmed; call=41 key=siem_vip_monitor_0 rc=7
Oct 08 20:06:09 pplxnsms02 pacemaker-based [2425] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/53)
Oct 08 20:06:09 pplxnsms02 pacemaker-based [2425] (cib_perform_op) info: Diff: --- 0.524.26 2
Oct 08 20:06:09 pplxnsms02 pacemaker-based [2425] (cib_perform_op) info: Diff: +++ 0.524.27 (null)
Oct 08 20:06:09 pplxnsms02 pacemaker-based [2425] (cib_perform_op) info: + /cib: @num_updates=27
Oct 08 20:06:09 pplxnsms02 pacemaker-based [2425] (cib_perform_op) info: ++ /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources:
Oct 08 20:06:09 pplxnsms02 pacemaker-based [2425] (cib_perform_op) info: ++
Oct 08 20:06:09 pplxnsms02 pacemaker-based [2425] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/52, version=0.524.27)
Oct 08 20:06:09 pplxnsms02 pacemaker-based [2425] (cib_perform_op) info: Diff: --- 0.524.27 2
Oct 08 20:06:09 pplxnsms02 pacemaker-based [2425] (cib_perform_op) info: Diff: +++ 0.524.28 (null)
Oct 08 20:06:09 pplxnsms02 pacemaker-based [2425] (cib_perform_op) info: + /cib: @num_updates=28
Oct 08 20:06:09 pplxnsms02 pacemaker-based [2425] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='siem_vip']/lrm_rsc_op[@id='siem_vip_last_0']: @transition-magic=0:7;10:0:7:00c010d1-f636-44e8-903c-cbd8ba175192, @call-id=41, @rc-code=7, @op-status=0, @exec-time=312
Oct 08 20:06:09 pplxnsms02 pacemaker-based [2425] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/53, version=0.524.28)
Oct 08 20:06:09 pplxnsms02 pacemaker-controld [2430] (process_graph_event) info: Transition 0 action 10 (siem_vip_monitor_0 on pplxnsms02) confirmed: not running | rc=7 call-id=41
Oct 08 20:06:09 pplxnsms02 pacemaker-controld [2430] (te_rsc_command) notice: Initiating monitor operation web_matomo_monitor_0 locally on pplxnsms02 | action 15
Oct 08 20:06:09 pplxnsms02 pacemaker-execd [2427] (process_lrmd_get_rsc_info) info: Agent information for 'web_matomo' not in cache
Oct 08 20:06:09 pplxnsms02 pacemaker-execd [2427] (process_lrmd_rsc_register) info: Cached agent information for 'web_matomo'
Oct 08 20:06:09 pplxnsms02 pacemaker-controld [2430] (do_lrm_rsc_op) notice: Requesting local execution of probe operation for web_matomo on pplxnsms02 | transition_key=15:0:7:00c010d1-f636-44e8-903c-cbd8ba175192 op_key=web_matomo_monitor_0
Oct 08 20:06:09 pplxnsms02 pacemaker-controld [2430] (wait_for_sync_result) info: apache_meta-data_0[5738] exited with status 0
Oct 08 20:06:09 pplxnsms02 pacemaker-based [2425] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/54)
Oct 08 20:06:09 pplxnsms02 pacemaker-based [2425] (cib_perform_op) info: Diff: --- 0.524.28 2
Oct 08 20:06:09 pplxnsms02 pacemaker-based [2425] (cib_perform_op) info: Diff: +++ 0.524.29 (null)
Oct 08 20:06:09 pplxnsms02 pacemaker-based [2425] (cib_perform_op) info: + /cib: @num_updates=29
Oct 08 20:06:09 pplxnsms02 pacemaker-based [2425] (cib_perform_op) info: ++ /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources:
Oct 08 20:06:09 pplxnsms02 pacemaker-based [2425] (cib_perform_op) info: ++
Oct 08 20:06:09 pplxnsms02 pacemaker-based [2425] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/54, version=0.524.29)
Oct 08 20:06:09 pplxnsms02 pacemaker-controld [2430] (log_executor_event) notice: Result of probe operation for siem_fs on pplxnsms02: not running | CIB update 55, graph action confirmed; call=49 key=siem_fs_monitor_0 rc=7
Oct 08 20:06:09 pplxnsms02 pacemaker-based [2425] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/55)
Oct 08 20:06:09 pplxnsms02 pacemaker-based [2425] (cib_perform_op) info: Diff: --- 0.524.29 2
Oct 08 20:06:09 pplxnsms02 pacemaker-based [2425] (cib_perform_op) info: Diff: +++ 0.524.30 (null)
Oct 08 20:06:09 pplxnsms02 pacemaker-based [2425] (cib_perform_op) info: + /cib: @num_updates=30
Oct 08 20:06:09 pplxnsms02 pacemaker-based [2425] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='siem_fs']/lrm_rsc_op[@id='siem_fs_last_0']: @transition-magic=0:7;12:0:7:00c010d1-f636-44e8-903c-cbd8ba175192, @call-id=49, @rc-code=7, @op-status=0, @exec-time=339
Oct 08 20:06:09 pplxnsms02 pacemaker-based [2425] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/55, version=0.524.30)
Oct 08 20:06:09 pplxnsms02 pacemaker-controld [2430] (process_graph_event) info: Transition 0 action 12 (siem_fs_monitor_0 on pplxnsms02) confirmed: not running | rc=7 call-id=49
Oct 08 20:06:09 pplxnsms02 pacemaker-controld [2430] (te_rsc_command) notice: Initiating monitor operation fence-sbd_monitor_0 locally on pplxnsms02 | action 16
Oct 08 20:06:09 pplxnsms02 pacemaker-execd [2427] (process_lrmd_get_rsc_info) info: Agent information for 'fence-sbd' not in cache
Oct 08 20:06:09 pplxnsms02 pacemaker-execd [2427] (process_lrmd_rsc_register) info: Cached agent information for 'fence-sbd'
Oct 08 20:06:09 pplxnsms02 pacemaker-controld [2430] (do_lrm_rsc_op) notice: Requesting local execution of probe operation for fence-sbd on pplxnsms02 | transition_key=16:0:7:00c010d1-f636-44e8-903c-cbd8ba175192 op_key=fence-sbd_monitor_0
Oct 08 20:06:09 pplxnsms02 pacemaker-controld [2430] (wait_for_sync_result) info: fence_sbd_metadata_1[5840] exited with status 0
Oct 08 20:06:09 pplxnsms02 pacemaker-based [2425] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/56)
Oct 08 20:06:09 pplxnsms02 pacemaker-based [2425] (cib_perform_op) info: Diff: --- 0.524.30 2
Oct 08 20:06:09 pplxnsms02 pacemaker-based [2425] (cib_perform_op) info: Diff: +++ 0.524.31 (null)
Oct 08 20:06:09 pplxnsms02 pacemaker-based [2425] (cib_perform_op) info: + /cib: @num_updates=31
Oct 08 20:06:09 pplxnsms02 pacemaker-based [2425] (cib_perform_op) info: ++ /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources:
Oct 08 20:06:09 pplxnsms02 pacemaker-based [2425] (cib_perform_op) info: ++
Oct 08 20:06:09 pplxnsms02 pacemaker-based [2425] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/56, version=0.524.31)
Oct 08 20:06:09 pplxnsms02 pacemaker-controld [2430] (log_executor_event) notice: Result of probe operation for fence-sbd on pplxnsms02: not running | CIB update 57, graph action confirmed; call=65 key=fence-sbd_monitor_0 rc=7
Oct 08 20:06:09 pplxnsms02 pacemaker-based [2425] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/57)
Oct 08 20:06:09 pplxnsms02 pacemaker-based [2425] (cib_perform_op) info: Diff: --- 0.524.31 2
Oct 08 20:06:09 pplxnsms02 pacemaker-based [2425] (cib_perform_op) info: Diff: +++ 0.524.32 (null)
Oct 08 20:06:09 pplxnsms02 pacemaker-based [2425] (cib_perform_op) info: + /cib: @num_updates=32
Oct 08 20:06:09 pplxnsms02 pacemaker-based [2425] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='fence-sbd']/lrm_rsc_op[@id='fence-sbd_last_0']: @transition-magic=0:7;16:0:7:00c010d1-f636-44e8-903c-cbd8ba175192, @call-id=65, @rc-code=7, @op-status=0, @exec-time=2
Oct 08 20:06:09 pplxnsms02 pacemaker-based [2425] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/57, version=0.524.32)
Oct 08 20:06:09 pplxnsms02 pacemaker-controld [2430] (process_graph_event) info: Transition 0 action 16 (fence-sbd_monitor_0 on pplxnsms02) confirmed: not running | rc=7 call-id=65
Oct 08 20:06:09 apache(web_matomo)[5811]: INFO: apache not running
Oct 08 20:06:09 mysql(web_mariadb)[5736]: ERROR: Datadir /siemlog/mysql doesn't exist
Oct 08 20:06:09 pplxnsms02 pacemaker-controld [2430] (log_executor_event) notice: Result of probe operation for web_matomo on pplxnsms02: not running | CIB update 58, graph action confirmed; call=61 key=web_matomo_monitor_0 rc=7
Oct 08 20:06:09 pplxnsms02 pacemaker-based [2425] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/58)
Oct 08 20:06:09 pplxnsms02 pacemaker-based [2425] (cib_perform_op) info: Diff: --- 0.524.32 2
Oct 08 20:06:09 pplxnsms02 pacemaker-based [2425] (cib_perform_op) info: Diff: +++ 0.524.33 (null)
Oct 08 20:06:09 pplxnsms02 pacemaker-based [2425] (cib_perform_op) info: + /cib: @num_updates=33
Oct 08 20:06:09 pplxnsms02 pacemaker-based [2425] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='web_matomo']/lrm_rsc_op[@id='web_matomo_last_0']: @transition-magic=0:7;15:0:7:00c010d1-f636-44e8-903c-cbd8ba175192, @call-id=61, @rc-code=7, @op-status=0, @exec-time=141
Oct 08 20:06:09 pplxnsms02 pacemaker-based [2425] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/58, version=0.524.33)
Oct 08 20:06:09 pplxnsms02 pacemaker-controld [2430] (process_graph_event) info: Transition 0 action 15 (web_matomo_monitor_0 on pplxnsms02) confirmed: not running | rc=7 call-id=61
Oct 08 20:06:09 mysql(web_mariadb)[5736]: INFO: MySQL is not running
Oct 08 20:06:09 pplxnsms02 pacemaker-execd [2427] (log_op_output) info: web_mariadb_monitor_0[5736] error output [ ocf-exit-reason:Datadir /siemlog/mysql doesn't exist ]
Oct 08 20:06:09 pplxnsms02 pacemaker-controld [2430] (log_executor_event) notice: Result of probe operation for web_mariadb on pplxnsms02: not running (Datadir /siemlog/mysql doesn't exist) | CIB update 59, graph action confirmed; call=57 key=web_mariadb_monitor_0 rc=7
Oct 08 20:06:09 pplxnsms02 pacemaker-controld [2430] (log_executor_event) notice: web_mariadb_monitor_0@pplxnsms02 output [ ocf-exit-reason:Datadir /siemlog/mysql doesn't exist\n ]
Oct 08 20:06:09 pplxnsms02 pacemaker-based [2425] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/59)
Oct 08 20:06:09 pplxnsms02 pacemaker-based [2425] (cib_perform_op) info: Diff: --- 0.524.33 2
Oct 08 20:06:09 pplxnsms02 pacemaker-based [2425] (cib_perform_op) info: Diff: +++ 0.524.34 (null)
Oct 08 20:06:09 pplxnsms02 pacemaker-based [2425] (cib_perform_op) info: + /cib: @num_updates=34
Oct 08 20:06:09 pplxnsms02 pacemaker-based [2425] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='web_mariadb']/lrm_rsc_op[@id='web_mariadb_last_0']: @transition-magic=0:7;14:0:7:00c010d1-f636-44e8-903c-cbd8ba175192, @call-id=57, @rc-code=7, @op-status=0, @exec-time=211
Oct 08 20:06:09 pplxnsms02 pacemaker-based [2425] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/59, version=0.524.34)
Oct 08 20:06:09 pplxnsms02 pacemaker-controld [2430] (process_graph_event) info: Transition 0 action 14 (web_mariadb_monitor_0 on pplxnsms02) confirmed: not running | rc=7 call-id=57
Oct 08 20:06:10 pplxnsms02 pacemaker-controld [2430] (log_executor_event) notice: Result of probe operation for nco_db2 on pplxnsms02: not running | CIB update 60, graph action confirmed; call=25 key=nco_db2_monitor_0 rc=7
Oct 08 20:06:10 pplxnsms02 pacemaker-based [2425] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/60)
Oct 08 20:06:10 pplxnsms02 pacemaker-based [2425] (cib_perform_op) info: Diff: --- 0.524.34 2
Oct 08 20:06:10 pplxnsms02 pacemaker-based [2425] (cib_perform_op) info: Diff: +++ 0.524.35 (null)
Oct 08 20:06:10 pplxnsms02 pacemaker-based [2425] (cib_perform_op) info: + /cib: @num_updates=35
Oct 08 20:06:10 pplxnsms02 pacemaker-based [2425] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='nco_db2']/lrm_rsc_op[@id='nco_db2_last_0']: @transition-magic=0:7;6:0:7:00c010d1-f636-44e8-903c-cbd8ba175192, @call-id=25, @rc-code=7, @op-status=0, @exec-time=2782
Oct 08 20:06:10 pplxnsms02 pacemaker-based [2425] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/60, version=0.524.35)
Oct 08 20:06:10 pplxnsms02 pacemaker-controld [2430] (process_graph_event) info: Transition 0 action 6 (nco_db2_monitor_0 on pplxnsms02) confirmed: not running | rc=7 call-id=25
Oct 08 20:06:15 pplxnsms02 pacemaker-controld [2430] (pcmk__procfs_pid_of) info: Found pacemaker-based active as process 2425
Oct 08 20:06:15 pplxnsms02 pacemaker-controld [2430] (throttle_send_command) info: New throttle mode: low load (was undetermined)
Oct 08 20:06:15 pplxnsms02 pacemaker-based [2425] (cib_process_ping) info: Reporting our current digest to pplxnsms02: 9522a6901a099b369053fb61cacad1fa for 0.524.35 (0x55d7a7e7fd30 0)
Oct 08 20:06:29 pplxnsms02 pacemaker-fenced [2426] (log_async_result) notice: Operation 'reboot' [5406] targeting pplxnsms01 using fence-sbd returned 0 | call 4 from pacemaker-controld.2430
Oct 08 20:06:29 pplxnsms02 pacemaker-fenced [2426] (finalize_op) notice: Operation 'reboot' targeting pplxnsms01 by pplxnsms02 for pacemaker-controld.2430@pplxnsms02: OK (complete) | id=b5c31e1a
Oct 08 20:06:29 pplxnsms02 pacemaker-controld [2430] (tengine_stonith_callback) notice: Fence operation 4 for pplxnsms01 passed
Oct 08 20:06:29 pplxnsms02 pacemaker-controld [2430] (update_peer_state_iter) notice: Node pplxnsms01 state is now lost | nodeid=1 previous=unknown source=crmd_peer_down
Oct 08 20:06:29 pplxnsms02 pacemaker-controld [2430] (peer_update_callback) info: Cluster node pplxnsms01 is now lost (was in unknown state)
Oct 08 20:06:29 pplxnsms02 pacemaker-controld [2430] (crm_update_peer_proc) info: crmd_peer_down: Node pplxnsms01[1] - all processes are now offline
Oct 08 20:06:29 pplxnsms02 pacemaker-controld [2430] (peer_update_callback) info: Node pplxnsms01 is no longer a peer | DC=true old=0x0000000 new=0x0000001
Oct 08 20:06:29 pplxnsms02 pacemaker-controld [2430] (pcmk__update_peer_expected) info: crmd_peer_down: Node pplxnsms01[1] - expected state is now down (was (null))
Oct 08 20:06:29 pplxnsms02 pacemaker-controld [2430] (controld_delete_node_state) info: Deleting all state for node pplxnsms01 (via CIB call 63) | xpath=//node_state[@uname='pplxnsms01']/*
Oct 08 20:06:29 pplxnsms02 pacemaker-controld [2430] (handle_fence_notification) notice: Peer pplxnsms01 was terminated (reboot) by pplxnsms02 on behalf of pacemaker-controld.2430@pplxnsms02: OK | event=b5c31e1a-dfb7-457d-a048-bd65f6b628e6
Oct 08 20:06:29 pplxnsms02 pacemaker-controld [2430] (controld_delete_node_state) info: Deleting all state for node pplxnsms01 (via CIB call 65) | xpath=//node_state[@uname='pplxnsms01']/*
Oct 08 20:06:29 pplxnsms02 pacemaker-controld [2430] (te_rsc_command) notice: Initiating start operation itm_vip_start_0 locally on pplxnsms02 | action 17
Oct 08 20:06:29 pplxnsms02 pacemaker-controld [2430] (do_lrm_rsc_op) notice: Requesting local execution of start operation for itm_vip on pplxnsms02 | transition_key=17:0:0:00c010d1-f636-44e8-903c-cbd8ba175192 op_key=itm_vip_start_0
Oct 08 20:06:29 pplxnsms02 pacemaker-execd [2427] (log_execute) info: executing - rsc:itm_vip action:start call_id:66
Oct 08 20:06:29 pplxnsms02 pacemaker-based [2425] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/61)
Oct 08 20:06:29 pplxnsms02 pacemaker-based [2425] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/62)
Oct 08 20:06:29 pplxnsms02 pacemaker-based [2425] (cib_process_request) info: Forwarding cib_delete operation for section //node_state[@uname='pplxnsms01']/* to all (origin=local/crmd/63)
Oct 08 20:06:29 pplxnsms02 pacemaker-based [2425] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/64)
Oct 08 20:06:29 pplxnsms02 pacemaker-based [2425] (cib_process_request) info: Forwarding cib_delete operation for section //node_state[@uname='pplxnsms01']/* to all (origin=local/crmd/65)
Oct 08 20:06:29 pplxnsms02 pacemaker-controld [2430] (te_rsc_command) notice: Initiating start operation siem_vip_start_0 locally on pplxnsms02 | action 39
Oct 08 20:06:29 pplxnsms02 pacemaker-controld [2430] (do_lrm_rsc_op) notice: Requesting local execution of start operation for siem_vip on pplxnsms02 | transition_key=39:0:0:00c010d1-f636-44e8-903c-cbd8ba175192 op_key=siem_vip_start_0
Oct 08 20:06:29 pplxnsms02 pacemaker-execd [2427] (log_execute) info: executing - rsc:siem_vip action:start call_id:67
Oct 08 20:06:29 pplxnsms02 pacemaker-controld [2430] (te_rsc_command) notice: Initiating start operation fence-sbd_start_0 locally on pplxnsms02 | action 51
Oct 08 20:06:29 pplxnsms02 pacemaker-controld [2430] (do_lrm_rsc_op) notice: Requesting local execution of start operation for fence-sbd on pplxnsms02 | transition_key=51:0:0:00c010d1-f636-44e8-903c-cbd8ba175192 op_key=fence-sbd_start_0
Oct 08 20:06:29 pplxnsms02 pacemaker-execd [2427] (log_execute) info: executing - rsc:fence-sbd action:start call_id:68
Oct 08 20:06:29 pplxnsms02 pacemaker-based [2425] (cib_perform_op) info: Diff: --- 0.524.35 2
Oct 08 20:06:29 pplxnsms02 pacemaker-based [2425] (cib_perform_op) info: Diff: +++ 0.524.36 (null)
Oct 08 20:06:29 pplxnsms02 pacemaker-based [2425] (cib_perform_op) info: + /cib: @num_updates=36
Oct 08 20:06:29 pplxnsms02 pacemaker-based [2425] (cib_perform_op) info: ++ /cib/status:
Oct 08 20:06:29 pplxnsms02 pacemaker-based [2425] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/61, version=0.524.36)
Oct 08 20:06:29 pplxnsms02 pacemaker-based [2425] (cib_perform_op) info: Diff: --- 0.524.36 2
Oct 08 20:06:29 pplxnsms02 pacemaker-based [2425] (cib_perform_op) info: Diff: +++ 0.524.37 (null)
Oct 08 20:06:29 pplxnsms02 pacemaker-based [2425] (cib_perform_op) info: + /cib: @num_updates=37
Oct 08 20:06:29 pplxnsms02 pacemaker-based [2425] (cib_perform_op) info: + /cib/status/node_state[@id='1']: @crm-debug-origin=send_stonith_update, @in_ccm=false, @join=down, @expected=down
Oct 08 20:06:29 pplxnsms02 pacemaker-based [2425] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/62, version=0.524.37)
Oct 08 20:06:29 pplxnsms02 pacemaker-based [2425] (cib_process_request) info: Completed cib_delete operation for section //node_state[@uname='pplxnsms01']/*: OK (rc=0, origin=pplxnsms02/crmd/63, version=0.524.37)
Oct 08 20:06:29 pplxnsms02 pacemaker-based [2425] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/64, version=0.524.37)
Oct 08 20:06:29 pplxnsms02 pacemaker-based [2425] (cib_process_request) info: Completed cib_delete operation for section //node_state[@uname='pplxnsms01']/*: OK (rc=0, origin=pplxnsms02/crmd/65, version=0.524.37)
Oct 08 20:06:29 pplxnsms02 pacemaker-based [2425] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/66)
Oct 08 20:06:29 pplxnsms02 pacemaker-based [2425] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/67)
Oct 08 20:06:29 pplxnsms02 pacemaker-controld [2430] (cib_fencing_updated) info: Fencing update 62 for pplxnsms01: complete
Oct 08 20:06:29 pplxnsms02 pacemaker-controld [2430] (cib_fencing_updated) info: Fencing update 64 for pplxnsms01: complete
Oct 08 20:06:29 pplxnsms02 pacemaker-based [2425] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/68)
Oct 08 20:06:29 pplxnsms02 pacemaker-based [2425] (cib_perform_op) info: Diff: --- 0.524.37 2
Oct 08 20:06:29 pplxnsms02 pacemaker-based [2425] (cib_perform_op) info: Diff: +++ 0.524.38 (null)
Oct 08 20:06:29 pplxnsms02 pacemaker-based [2425] (cib_perform_op) info: + /cib: @num_updates=38
Oct 08 20:06:29 pplxnsms02 pacemaker-based [2425] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='itm_vip']/lrm_rsc_op[@id='itm_vip_last_0']: @operation_key=itm_vip_start_0, @operation=start, @transition-key=17:0:0:00c010d1-f636-44e8-903c-cbd8ba175192, @transition-magic=-1:193;17:0:0:00c010d1-f636-44e8-903c-cbd8ba175192, @call-id=-1, @rc-code=193, @op-status=-1, @last-rc-change=1728389189, @exec-time=0
Oct 08 20:06:29 pplxnsms02 pacemaker-based [2425] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/66, version=0.524.38)
Oct 08 20:06:29 pplxnsms02 pacemaker-based [2425] (cib_perform_op) info: Diff: --- 0.524.38 2
Oct 08 20:06:29 pplxnsms02 pacemaker-based [2425] (cib_perform_op) info: Diff: +++ 0.524.39 (null)
Oct 08 20:06:29 pplxnsms02 pacemaker-based [2425] (cib_perform_op) info: + /cib: @num_updates=39
Oct 08 20:06:29 pplxnsms02 pacemaker-based [2425] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='siem_vip']/lrm_rsc_op[@id='siem_vip_last_0']: @operation_key=siem_vip_start_0, @operation=start, @transition-key=39:0:0:00c010d1-f636-44e8-903c-cbd8ba175192, @transition-magic=-1:193;39:0:0:00c010d1-f636-44e8-903c-cbd8ba175192, @call-id=-1, @rc-code=193, @op-status=-1, @last-rc-change=1728389189, @exec-time=0
Oct 08 20:06:29 pplxnsms02 pacemaker-based [2425] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/67, version=0.524.39)
Oct 08 20:06:29 pplxnsms02 pacemaker-based [2425] (cib_perform_op) info: Diff: --- 0.524.39 2
Oct 08 20:06:29 pplxnsms02 pacemaker-based [2425] (cib_perform_op) info: Diff: +++ 0.524.40 (null)
Oct 08 20:06:29 pplxnsms02 pacemaker-based [2425] (cib_perform_op) info: + /cib: @num_updates=40
Oct 08 20:06:29 pplxnsms02 pacemaker-based [2425] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='fence-sbd']/lrm_rsc_op[@id='fence-sbd_last_0']: @operation_key=fence-sbd_start_0, @operation=start, @transition-key=51:0:0:00c010d1-f636-44e8-903c-cbd8ba175192, @transition-magic=-1:193;51:0:0:00c010d1-f636-44e8-903c-cbd8ba175192, @call-id=-1, @rc-code=193, @op-status=-1, @last-rc-change=1728389189, @exec-time=0
Oct 08 20:06:29 pplxnsms02 pacemaker-based [2425] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/68, version=0.524.40)
Oct 08 20:06:29 IPaddr2(siem_vip)[6425]: INFO: Adding inet address 192.168.133.40/24 with broadcast address 192.168.133.255 to device ens224
Oct 08 20:06:29 IPaddr2(itm_vip)[6424]: INFO: Adding inet address 192.168.133.136/24 with broadcast address 192.168.133.255 to device ens224
Oct 08 20:06:29 IPaddr2(siem_vip)[6425]: INFO: Bringing device ens224 up
Oct 08 20:06:29 IPaddr2(itm_vip)[6424]: INFO: Bringing device ens224 up
Oct 08 20:06:29 IPaddr2(siem_vip)[6425]: INFO: /usr/libexec/heartbeat/send_arp -i 200 -r 5 -p /run/resource-agents/send_arp-192.168.133.40 ens224 192.168.133.40 auto not_used not_used
Oct 08 20:06:29 IPaddr2(itm_vip)[6424]: INFO: /usr/libexec/heartbeat/send_arp -i 200 -r 5 -p /run/resource-agents/send_arp-192.168.133.136 ens224 192.168.133.136 auto not_used not_used
Oct 08 20:06:29 pplxnsms02 pacemaker-execd [2427] (log_finished) info: siem_vip start (call 67, PID 6425) exited with status 0 (execution time 148ms)
Oct 08 20:06:29 pplxnsms02 pacemaker-execd [2427] (log_finished) info: itm_vip start (call 66, PID 6424) exited with status 0 (execution time 153ms)
Oct 08 20:06:29 pplxnsms02 pacemaker-controld [2430] (wait_for_sync_result) info: IPaddr2_meta-data_0[6586] exited with status 0
Oct 08 20:06:29 pplxnsms02 pacemaker-controld [2430] (log_executor_event) notice: Result of start operation for siem_vip on pplxnsms02: ok | CIB update 69, graph action confirmed; call=67 key=siem_vip_start_0 rc=0
Oct 08 20:06:29 pplxnsms02 pacemaker-based [2425] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/69)
Oct 08 20:06:29 pplxnsms02 pacemaker-based [2425] (cib_perform_op) info: Diff: --- 0.524.40 2
Oct 08 20:06:29 pplxnsms02 pacemaker-based [2425] (cib_perform_op) info: Diff: +++ 0.524.41 (null)
Oct 08 20:06:29 pplxnsms02 pacemaker-based [2425] (cib_perform_op) info: + /cib: @num_updates=41
Oct 08 20:06:29 pplxnsms02 pacemaker-based [2425] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='siem_vip']/lrm_rsc_op[@id='siem_vip_last_0']: @transition-magic=0:0;39:0:0:00c010d1-f636-44e8-903c-cbd8ba175192, @call-id=67, @rc-code=0, @op-status=0, @exec-time=148
Oct 08 20:06:29 pplxnsms02 pacemaker-based [2425] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/69, version=0.524.41)
Oct 08 20:06:29 pplxnsms02 pacemaker-controld [2430] (wait_for_sync_result) info: IPaddr2_meta-data_0[6597] exited with status 0
Oct 08 20:06:29 pplxnsms02 pacemaker-controld [2430] (log_executor_event) notice: Result of start operation for itm_vip on pplxnsms02: ok | CIB update 70, graph action confirmed; call=66 key=itm_vip_start_0 rc=0
Oct 08 20:06:29 pplxnsms02 pacemaker-controld [2430] (process_graph_event) info: Transition 0 action 39 (siem_vip_start_0 on pplxnsms02) confirmed: ok | rc=0 call-id=67
Oct 08 20:06:29 pplxnsms02 pacemaker-controld [2430] (te_rsc_command) notice: Initiating monitor operation siem_vip_monitor_10000 locally on pplxnsms02 | action 40
Oct 08 20:06:29 pplxnsms02 pacemaker-controld [2430] (do_lrm_rsc_op) notice: Requesting local execution of monitor operation for siem_vip on pplxnsms02 | transition_key=40:0:0:00c010d1-f636-44e8-903c-cbd8ba175192 op_key=siem_vip_monitor_10000
Oct 08 20:06:29 pplxnsms02 pacemaker-based [2425] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/70)
Oct 08 20:06:29 pplxnsms02 pacemaker-based [2425] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/71)
Oct 08 20:06:29 pplxnsms02 pacemaker-based [2425] (cib_perform_op) info: Diff: --- 0.524.41 2
Oct 08 20:06:29 pplxnsms02 pacemaker-based [2425] (cib_perform_op) info: Diff: +++ 0.524.42 (null)
Oct 08 20:06:29 pplxnsms02 pacemaker-based [2425] (cib_perform_op) info: + /cib: @num_updates=42
Oct 08 20:06:29 pplxnsms02 pacemaker-based [2425] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='itm_vip']/lrm_rsc_op[@id='itm_vip_last_0']: @transition-magic=0:0;17:0:0:00c010d1-f636-44e8-903c-cbd8ba175192, @call-id=66, @rc-code=0, @op-status=0, @exec-time=153
Oct 08 20:06:29 pplxnsms02 pacemaker-based [2425] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/70, version=0.524.42)
Oct 08 20:06:29 pplxnsms02 pacemaker-based [2425] (cib_perform_op) info: Diff: --- 0.524.42 2
Oct 08 20:06:29 pplxnsms02 pacemaker-based [2425] (cib_perform_op) info: Diff: +++ 0.524.43 (null)
Oct 08 20:06:29 pplxnsms02 pacemaker-based [2425] (cib_perform_op) info: + /cib: @num_updates=43
Oct 08 20:06:29 pplxnsms02 pacemaker-based [2425] (cib_perform_op) info: ++ /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='siem_vip']: old=0x0000000 new=0x4000000
Oct 08 20:07:10 pplxnsms02 pacemaker-controld [2398] (te_trigger_stonith_history_sync) info: Fence history will be synchronized cluster-wide within 5 seconds
Oct 08 20:07:10 pplxnsms02 pacemaker-controld [2398] (pcmk__corosync_connect) info: Connection to corosync established
Oct 08 20:07:10 pplxnsms02 pacemaker-attrd [2396] (qb_ipcs_us_publish) info: server name: attrd
Oct 08 20:07:10 pplxnsms02 pacemaker-attrd [2396] (main) notice: Pacemaker node attribute manager successfully started and accepting connections
Oct 08 20:07:10 pplxnsms02 pacemaker-attrd [2396] (pcmk_cpg_membership) info: Group attrd event 0: node 2 pid 2396 joined via cpg_join
Oct 08 20:07:10 pplxnsms02 pacemaker-attrd [2396] (pcmk_cpg_membership) info: Group attrd event 0: pplxnsms02 (node 2 pid 2396) is member
Oct 08 20:07:10 pplxnsms02 pacemaker-attrd [2396] (attrd_peer_update) notice: Setting #attrd-protocol[pplxnsms02]: (unset) -> 3 | from pplxnsms02
Oct 08 20:07:10 pplxnsms02 pacemaker-attrd [2396] (attrd_start_election_if_needed) info: Starting an election to determine the writer
Oct 08 20:07:10 pplxnsms02 pacemaker-attrd [2396] (election_check) info: election-attrd won by local node
Oct 08 20:07:10 pplxnsms02 pacemaker-attrd [2396] (attrd_declare_winner) notice: Recorded local node as attribute writer (was unset)
Oct 08 20:07:10 pplxnsms02 pacemaker-attrd [2396] (write_attribute) info: Processed 1 private change for #attrd-protocol, id=n/a, set=n/a
Oct 08 20:07:10 pplxnsms02 pacemaker-based [2393] (cib_process_request) info: Completed cib_delete operation for section //node_state[@uname='pplxnsms02']/transient_attributes: OK (rc=0, origin=pplxnsms02/attrd/2, version=0.524.0)
Oct 08 20:07:10 pplxnsms02 pacemaker-controld [2398] (pcmk__corosync_quorum_connect) warning: No quorum
Oct 08 20:07:10 pplxnsms02 pacemaker-controld [2398] (crm_get_peer) info: Created entry f661c121-d216-4499-9a88-e4c082e8119b/0x55d75aefe7e0 for node pplxnsms01/1 (2 total)
Oct 08 20:07:10 pplxnsms02 pacemaker-controld [2398] (crm_get_peer) info: Node 1 is now known as pplxnsms01
Oct 08 20:07:10 pplxnsms02 pacemaker-controld [2398] (peer_update_callback) info: Cluster node pplxnsms01 is now in unknown state
Oct 08 20:07:10 pplxnsms02 pacemaker-controld [2398] (crm_get_peer) info: Node 1 has uuid 1
Oct 08 20:07:10 pplxnsms02 pacemaker-controld [2398] (do_ha_control) info: Connected to the cluster
Oct 08 20:07:10 pplxnsms02 pacemaker-controld [2398] (lrmd_ipc_connect) info: Connecting to executor
Oct 08 20:07:10 pplxnsms02 pacemaker-based [2393] (cib_process_request) info: Forwarding cib_modify operation for section nodes to all (origin=local/crmd/4)
Oct 08 20:07:10 pplxnsms02 pacemaker-based [2393] (cib_process_request) info: Completed cib_modify operation for section nodes: OK (rc=0, origin=pplxnsms02/crmd/4, version=0.524.0)
Oct 08 20:07:10 pplxnsms02 pacemaker-controld [2398] (try_local_executor_connect) info: Connection to the local executor established
Oct 08 20:07:10 pplxnsms02 pacemaker-controld [2398] (do_started) info: Delaying start, no membership data (0000000000100000)
Oct 08 20:07:10 pplxnsms02 pacemaker-controld [2398] (do_started) info: Delaying start, no membership data (0000000000100000)
Oct 08 20:07:10 pplxnsms02 pacemaker-controld [2398] (quorum_notification_cb) info: Quorum still lost | membership=1335 members=1
Oct 08 20:07:10 pplxnsms02 pacemaker-controld [2398] (update_peer_state_iter) notice: Node pplxnsms02 state is now member | nodeid=2 previous=unknown source=quorum_notification_cb
Oct 08 20:07:10 pplxnsms02 pacemaker-controld [2398] (peer_update_callback) info: Cluster node pplxnsms02 is now member (was in unknown state)
Oct 08 20:07:10 pplxnsms02 pacemaker-controld [2398] (pcmk__reap_unseen_nodes) info: State of node pplxnsms01[1] is still unknown
Oct 08 20:07:10 pplxnsms02 pacemaker-controld [2398] (do_started) info: Delaying start, Config not read (0000000000000040)
Oct 08 20:07:10 pplxnsms02 pacemaker-controld [2398] (pcmk_cpg_membership) info: Group crmd event 0: node 2 pid 2398 joined via cpg_join
Oct 08 20:07:10 pplxnsms02 pacemaker-controld [2398] (pcmk_cpg_membership) info: Group crmd event 0: pplxnsms02 (node 2 pid 2398) is member
Oct 08 20:07:10 pplxnsms02 pacemaker-controld [2398] (do_started) info: Delaying start, Config not read (0000000000000040)
Oct 08 20:07:10 pplxnsms02 pacemaker-controld [2398] (qb_ipcs_us_publish) info: server name: crmd
Oct 08 20:07:10 pplxnsms02 pacemaker-controld [2398] (do_started) notice: Pacemaker controller successfully started and accepting connections
Oct 08 20:07:10 pplxnsms02 pacemaker-controld [2398] (do_log) info: Input I_PENDING received in state S_STARTING from do_started
Oct 08 20:07:10 pplxnsms02 pacemaker-controld [2398] (do_state_transition) notice: State transition S_STARTING -> S_PENDING | input=I_PENDING cause=C_FSA_INTERNAL origin=do_started
Oct 08 20:07:10 pplxnsms02 pacemaker-fenced [2394] (wait_for_sync_result) info: fence_sbd_metadata_1[2483] exited with status 0
Oct 08 20:07:10 pplxnsms02 pacemaker-fenced [2394] (stonith_device_register) notice: Added 'fence-sbd' to device list (1 active device)
Oct 08 20:07:11 pplxnsms02 pacemaker-controld [2398] (te_trigger_stonith_history_sync) info: Fence history will be synchronized cluster-wide within 30 seconds
Oct 08 20:07:11 pplxnsms02 pacemaker-controld [2398] (te_connect_stonith) notice: Fencer successfully connected
Oct 08 20:07:31 pplxnsms02 pacemaker-controld [2398] (crm_timer_popped) info: Election Trigger just popped | input=I_DC_TIMEOUT time=20000ms
Oct 08 20:07:31 pplxnsms02 pacemaker-controld [2398] (do_log) warning: Input I_DC_TIMEOUT received in state S_PENDING from crm_timer_popped
Oct 08 20:07:31 pplxnsms02 pacemaker-controld [2398] (do_state_transition) info: State transition S_PENDING -> S_ELECTION | input=I_DC_TIMEOUT cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 08 20:07:31 pplxnsms02 pacemaker-controld [2398] (election_check) info: election-DC won by local node
Oct 08 20:07:31 pplxnsms02 pacemaker-controld [2398] (do_log) info: Input I_ELECTION_DC received in state S_ELECTION from election_win_cb
Oct 08 20:07:31 pplxnsms02 pacemaker-controld [2398] (do_state_transition) notice: State transition S_ELECTION -> S_INTEGRATION | input=I_ELECTION_DC cause=C_FSA_INTERNAL origin=election_win_cb
Oct 08 20:07:31 pplxnsms02 pacemaker-controld [2398] (do_te_control) info: Registering TE UUID: 644ce76d-aa78-4872-a7a0-7a85d6e6a5d3
Oct 08 20:07:31 pplxnsms02 pacemaker-controld [2398] (pcmk__pid_active) info: Could not read from /proc/1636/exe: Permission denied | errno=13
Oct 08 20:07:31 pplxnsms02 pacemaker-controld [2398] (do_dc_takeover) info: Taking over DC status for this partition
Oct 08 20:07:31 pplxnsms02 pacemaker-based [2393] (cib_process_readwrite) info: We are now in R/W mode
Oct 08 20:07:31 pplxnsms02 pacemaker-based [2393] (cib_process_request) info: Completed cib_master operation for section 'all': OK (rc=0, origin=local/crmd/7, version=0.524.0)
Oct 08 20:07:31 pplxnsms02 pacemaker-based [2393] (cib_process_request) info: Forwarding cib_modify operation for section cib to all (origin=local/crmd/8)
Oct 08 20:07:31 pplxnsms02 pacemaker-based [2393] (cib_process_request) info: Completed cib_modify operation for section cib: OK (rc=0, origin=pplxnsms02/crmd/8, version=0.524.0)
Oct 08 20:07:31 pplxnsms02 pacemaker-based [2393] (cib_process_request) info: Forwarding cib_modify operation for section crm_config to all (origin=local/crmd/10)
Oct 08 20:07:31 pplxnsms02 pacemaker-based [2393] (cib_process_request) info: Completed cib_modify operation for section crm_config: OK (rc=0, origin=pplxnsms02/crmd/10, version=0.524.0)
Oct 08 20:07:31 pplxnsms02 pacemaker-based [2393] (cib_process_request) info: Forwarding cib_modify operation for section crm_config to all (origin=local/crmd/12)
Oct 08 20:07:31 pplxnsms02 pacemaker-controld [2398] (join_make_offer) info: Not making join-1 offer to inactive node pplxnsms01
Oct 08 20:07:31 pplxnsms02 pacemaker-controld [2398] (join_make_offer) info: Making join-1 offers based on membership event 1335
Oct 08 20:07:31 pplxnsms02 pacemaker-controld [2398] (join_make_offer) info: Sending join-1 offer to pplxnsms02
Oct 08 20:07:31 pplxnsms02 pacemaker-controld [2398] (do_dc_join_offer_all) info: Waiting on join-1 requests from 1 outstanding node
Oct 08 20:07:31 pplxnsms02 pacemaker-controld [2398] (update_dc) info: Set DC to pplxnsms02 (3.13.0)
Oct 08 20:07:31 pplxnsms02 pacemaker-controld [2398] (pcmk__update_peer_expected) info: update_dc: Node pplxnsms02[2] - expected state is now member (was (null))
Oct 08 20:07:31 pplxnsms02 pacemaker-based [2393] (cib_process_request) info: Completed cib_modify operation for section crm_config: OK (rc=0, origin=pplxnsms02/crmd/12, version=0.524.0)
Oct 08 20:07:31 pplxnsms02 pacemaker-based [2393] (cib_process_request) info: Forwarding cib_modify operation for section crm_config to all (origin=local/crmd/14)
Oct 08 20:07:31 pplxnsms02 pacemaker-controld [2398] (stonith__watchdog_fencing_enabled_for_node_api) notice: Cluster does not have watchdog fencing device
Oct 08 20:07:31 pplxnsms02 pacemaker-based [2393] (cib_process_request) info: Completed cib_modify operation for section crm_config: OK (rc=0, origin=pplxnsms02/crmd/14, version=0.524.0)
Oct 08 20:07:31 pplxnsms02 pacemaker-controld [2398] (do_state_transition) info: State transition S_INTEGRATION -> S_FINALIZE_JOIN | input=I_INTEGRATED cause=C_FSA_INTERNAL origin=check_join_state
Oct 08 20:07:31 pplxnsms02 pacemaker-controld [2398] (controld_delete_node_state) info: Deleting resource history for node pplxnsms02 (via CIB call 19) | xpath=//node_state[@uname='pplxnsms02']/lrm
Oct 08 20:07:31 pplxnsms02 pacemaker-based [2393] (cib_process_replace) info: Digest matched on replace from pplxnsms02: 3ee2a3044e50b4f9747d375984348bab
Oct 08 20:07:31 pplxnsms02 pacemaker-based [2393] (cib_process_replace) info: Replaced 0.524.0 with 0.524.0 from pplxnsms02
Oct 08 20:07:31 pplxnsms02 pacemaker-based [2393] (cib_process_request) info: Completed cib_replace operation for section 'all': OK (rc=0, origin=pplxnsms02/crmd/17, version=0.524.0)
Oct 08 20:07:31 pplxnsms02 pacemaker-based [2393] (cib_process_request) info: Forwarding cib_modify operation for section nodes to all (origin=local/crmd/18)
Oct 08 20:07:31 pplxnsms02 pacemaker-based [2393] (cib_process_request) info: Forwarding cib_delete operation for section //node_state[@uname='pplxnsms02']/lrm to all (origin=local/crmd/19)
Oct 08 20:07:31 pplxnsms02 pacemaker-based [2393] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/20)
Oct 08 20:07:31 pplxnsms02 pacemaker-based [2393] (cib_process_request) info: Completed cib_modify operation for section nodes: OK (rc=0, origin=pplxnsms02/crmd/18, version=0.524.0)
Oct 08 20:07:31 pplxnsms02 pacemaker-based [2393] (cib_process_request) info: Completed cib_delete operation for section //node_state[@uname='pplxnsms02']/lrm: OK (rc=0, origin=pplxnsms02/crmd/19, version=0.524.0)
Oct 08 20:07:31 pplxnsms02 pacemaker-based [2393] (cib_perform_op) info: Diff: --- 0.524.0 2
Oct 08 20:07:31 pplxnsms02 pacemaker-based [2393] (cib_perform_op) info: Diff: +++ 0.524.1 (null)
Oct 08 20:07:31 pplxnsms02 pacemaker-based [2393] (cib_perform_op) info: + /cib: @num_updates=1
Oct 08 20:07:31 pplxnsms02 pacemaker-based [2393] (cib_perform_op) info: ++ /cib/status:
Oct 08 20:07:31 pplxnsms02 pacemaker-based [2393] (cib_perform_op) info: ++
Oct 08 20:07:31 pplxnsms02 pacemaker-based [2393] (cib_perform_op) info: ++
Oct 08 20:07:31 pplxnsms02 pacemaker-based [2393] (cib_perform_op) info: ++
Oct 08 20:07:31 pplxnsms02 pacemaker-based [2393] (cib_perform_op) info: ++
Oct 08 20:07:31 pplxnsms02 pacemaker-based [2393] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/20, version=0.524.1)
Oct 08 20:07:31 pplxnsms02 pacemaker-controld [2398] (do_state_transition) info: State transition S_FINALIZE_JOIN -> S_POLICY_ENGINE | input=I_FINALIZED cause=C_FSA_INTERNAL origin=check_join_state
Oct 08 20:07:31 pplxnsms02 pacemaker-controld [2398] (create_node_state_update) info: Node update for pplxnsms01 cancelled: no state, not seen yet
Oct 08 20:07:31 pplxnsms02 pacemaker-controld [2398] (abort_transition_graph) info: Transition -1 aborted: Quorum lost | source=crm_update_quorum:435 complete=true
Oct 08 20:07:31 pplxnsms02 pacemaker-controld [2398] (abort_transition_graph) info: Transition -1 aborted: Peer Cancelled | source=do_te_invoke:129 complete=true
Oct 08 20:07:31 pplxnsms02 pacemaker-based [2393] (cib_process_request) info: Forwarding cib_modify operation for section nodes to all (origin=local/crmd/23)
Oct 08 20:07:31 pplxnsms02 pacemaker-based [2393] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/24)
Oct 08 20:07:31 pplxnsms02 pacemaker-based [2393] (cib_process_request) info: Forwarding cib_modify operation for section cib to all (origin=local/crmd/25)
Oct 08 20:07:31 pplxnsms02 pacemaker-based [2393] (cib_process_request) info: Completed cib_modify operation for section nodes: OK (rc=0, origin=pplxnsms02/crmd/23, version=0.524.1)
Oct 08 20:07:31 pplxnsms02 pacemaker-based [2393] (cib_perform_op) info: Diff: --- 0.524.1 2
Oct 08 20:07:31 pplxnsms02 pacemaker-based [2393] (cib_perform_op) info: Diff: +++ 0.524.2 (null)
Oct 08 20:07:31 pplxnsms02 pacemaker-based [2393] (cib_perform_op) info: + /cib: @num_updates=2
Oct 08 20:07:31 pplxnsms02 pacemaker-based [2393] (cib_perform_op) info: + /cib/status/node_state[@id='2']: @crm-debug-origin=do_state_transition, @join=member, @expected=member
Oct 08 20:07:31 pplxnsms02 pacemaker-based [2393] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/24, version=0.524.2)
Oct 08 20:07:31 pplxnsms02 pacemaker-based [2393] (cib_perform_op) info: Diff: --- 0.524.2 2
Oct 08 20:07:31 pplxnsms02 pacemaker-based [2393] (cib_perform_op) info: Diff: +++ 0.524.3 (null)
Oct 08 20:07:31 pplxnsms02 pacemaker-based [2393] (cib_perform_op) info: + /cib: @num_updates=3, @have-quorum=0, @dc-uuid=2
Oct 08 20:07:31 pplxnsms02 pacemaker-based [2393] (cib_process_request) info: Completed cib_modify operation for section cib: OK (rc=0, origin=pplxnsms02/crmd/25, version=0.524.3)
Oct 08 20:07:31 pplxnsms02 pacemaker-schedulerd[2397] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 08 20:07:31 pplxnsms02 pacemaker-schedulerd[2397] (unpack_config) notice: On loss of quorum: Ignore
Oct 08 20:07:31 pplxnsms02 pacemaker-schedulerd[2397] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 08 20:07:31 pplxnsms02 pacemaker-schedulerd[2397] (determine_online_status) info: Node pplxnsms02 is online
Oct 08 20:07:31 pplxnsms02 pacemaker-schedulerd[2397] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 08 20:07:31 pplxnsms02 pacemaker-schedulerd[2397] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 08 20:07:31 pplxnsms02 pacemaker-schedulerd[2397] (RecurringOp) info: Start recurring monitor (10s) for itm_vip on pplxnsms02
Oct 08 20:07:31 pplxnsms02 pacemaker-schedulerd[2397] (RecurringOp) info: Start recurring monitor (30s) for itm_lvm on pplxnsms02
Oct 08 20:07:31 pplxnsms02 pacemaker-schedulerd[2397] (RecurringOp) info: Start recurring monitor (20s) for itm_fs on pplxnsms02
Oct 08 20:07:31 pplxnsms02 pacemaker-schedulerd[2397] (RecurringOp) info: Start recurring monitor (20s) for itm_fs2 on pplxnsms02
Oct 08 20:07:31 pplxnsms02 pacemaker-schedulerd[2397] (RecurringOp) info: Start recurring monitor (20s) for itm_fs3 on pplxnsms02
Oct 08 20:07:31 pplxnsms02 pacemaker-schedulerd[2397] (RecurringOp) info: Start recurring monitor (20s) for nco_db2 on pplxnsms02
Oct 08 20:07:31 pplxnsms02 pacemaker-schedulerd[2397] (RecurringOp) info: Start recurring monitor (60s) for nco_omni on pplxnsms02
Oct 08 20:07:31 pplxnsms02 pacemaker-schedulerd[2397] (RecurringOp) info: Start recurring monitor (300s) for nco_itnm on pplxnsms02
Oct 08 20:07:31 pplxnsms02 pacemaker-schedulerd[2397] (RecurringOp) info: Start recurring monitor (10s) for nco_cognos on pplxnsms02
Oct 08 20:07:31 pplxnsms02 pacemaker-schedulerd[2397] (RecurringOp) info: Start recurring monitor (10s) for siem_vip on pplxnsms02
Oct 08 20:07:31 pplxnsms02 pacemaker-schedulerd[2397] (RecurringOp) info: Start recurring monitor (30s) for siem_lvm on pplxnsms02
Oct 08 20:07:31 pplxnsms02 pacemaker-schedulerd[2397] (RecurringOp) info: Start recurring monitor (20s) for siem_fs on pplxnsms02
Oct 08 20:07:31 pplxnsms02 pacemaker-schedulerd[2397] (RecurringOp) info: Start recurring monitor (10s) for siem_rsyslog on pplxnsms02
Oct 08 20:07:31 pplxnsms02 pacemaker-schedulerd[2397] (RecurringOp) info: Start recurring monitor (60s) for fence-sbd on pplxnsms02
Oct 08 20:07:31 pplxnsms02 pacemaker-schedulerd[2397] (stage6) warning: Scheduling Node pplxnsms01 for STONITH
Oct 08 20:07:31 pplxnsms02 pacemaker-schedulerd[2397] (log_list_item) notice: Actions: Fence (reboot) pplxnsms01 'node is unclean'
Oct 08 20:07:31 pplxnsms02 pacemaker-schedulerd[2397] (log_list_item) notice: Actions: Start itm_vip ( pplxnsms02 )
Oct 08 20:07:31 pplxnsms02 pacemaker-schedulerd[2397] (log_list_item) notice: Actions: Start itm_lvm ( pplxnsms02 )
Oct 08 20:07:31 pplxnsms02 pacemaker-schedulerd[2397] (log_list_item) notice: Actions: Start itm_fs ( pplxnsms02 )
Oct 08 20:07:31 pplxnsms02 pacemaker-schedulerd[2397] (log_list_item) notice: Actions: Start itm_fs2 ( pplxnsms02 )
Oct 08 20:07:31 pplxnsms02 pacemaker-schedulerd[2397] (log_list_item) notice: Actions: Start itm_fs3 ( pplxnsms02 )
Oct 08 20:07:31 pplxnsms02 pacemaker-schedulerd[2397] (log_list_item) notice: Actions: Start nco_db2 ( pplxnsms02 )
Oct 08 20:07:31 pplxnsms02 pacemaker-schedulerd[2397] (log_list_item) notice: Actions: Start nco_omni ( pplxnsms02 )
Oct 08 20:07:31 pplxnsms02 pacemaker-schedulerd[2397] (log_list_item) notice: Actions: Start nco_itnm ( pplxnsms02 )
Oct 08 20:07:31 pplxnsms02 pacemaker-schedulerd[2397] (log_list_item) notice: Actions: Start nco_cognos ( pplxnsms02 )
Oct 08 20:07:31 pplxnsms02 pacemaker-schedulerd[2397] (log_list_item) notice: Actions: Start siem_vip ( pplxnsms02 )
Oct 08 20:07:31 pplxnsms02 pacemaker-schedulerd[2397] (log_list_item) notice: Actions: Start siem_lvm ( pplxnsms02 )
Oct 08 20:07:31 pplxnsms02 pacemaker-schedulerd[2397] (log_list_item) notice: Actions: Start siem_fs ( pplxnsms02 )
Oct 08 20:07:31 pplxnsms02 pacemaker-schedulerd[2397] (log_list_item) notice: Actions: Start siem_rsyslog ( pplxnsms02 )
Oct 08 20:07:31 pplxnsms02 pacemaker-schedulerd[2397] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 08 20:07:31 pplxnsms02 pacemaker-schedulerd[2397] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 08 20:07:31 pplxnsms02 pacemaker-schedulerd[2397] (log_list_item) notice: Actions: Start fence-sbd ( pplxnsms02 )
Oct 08 20:07:31 pplxnsms02 pacemaker-based [2393] (cib_file_backup) info: Archived previous version as /var/lib/pacemaker/cib/cib-46.raw
Oct 08 20:07:31 pplxnsms02 pacemaker-based [2393] (cib_file_write_with_digest) info: Wrote version 0.524.0 of the CIB to disk (digest: 49d51591b31544fd49bca1f3b8aa24df)
Oct 08 20:07:31 pplxnsms02 pacemaker-schedulerd[2397] (pcmk__log_transition_summary) warning: Calculated transition 0 (with warnings), saving inputs in /var/lib/pacemaker/pengine/pe-warn-99.bz2
Oct 08 20:07:31 pplxnsms02 pacemaker-controld [2398] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 08 20:07:31 pplxnsms02 pacemaker-controld [2398] (do_te_invoke) info: Processing graph 0 (ref=pe_calc-dc-1728389251-8) derived from /var/lib/pacemaker/pengine/pe-warn-99.bz2
Oct 08 20:07:31 pplxnsms02 pacemaker-controld [2398] (te_rsc_command) notice: Initiating monitor operation itm_vip_monitor_0 locally on pplxnsms02 | action 1
Oct 08 20:07:31 pplxnsms02 pacemaker-execd [2395] (process_lrmd_get_rsc_info) info: Agent information for 'itm_vip' not in cache
Oct 08 20:07:31 pplxnsms02 pacemaker-based [2393] (cib_file_write_with_digest) info: Reading cluster configuration file /var/lib/pacemaker/cib/cib.hzQnsx (digest: /var/lib/pacemaker/cib/cib.8PZVqu)
Oct 08 20:07:31 pplxnsms02 pacemaker-execd [2395] (process_lrmd_rsc_register) info: Cached agent information for 'itm_vip'
Oct 08 20:07:31 pplxnsms02 pacemaker-controld [2398] (do_lrm_rsc_op) notice: Requesting local execution of probe operation for itm_vip on pplxnsms02 | transition_key=1:0:7:644ce76d-aa78-4872-a7a0-7a85d6e6a5d3 op_key=itm_vip_monitor_0
Oct 08 20:07:31 pplxnsms02 pacemaker-controld [2398] (wait_for_sync_result) info: IPaddr2_meta-data_0[4679] exited with status 0
Oct 08 20:07:31 pplxnsms02 pacemaker-based [2393] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/28)
Oct 08 20:07:31 pplxnsms02 pacemaker-based [2393] (cib_perform_op) info: Diff: --- 0.524.3 2
Oct 08 20:07:31 pplxnsms02 pacemaker-based [2393] (cib_perform_op) info: Diff: +++ 0.524.4 (null)
Oct 08 20:07:31 pplxnsms02 pacemaker-based [2393] (cib_perform_op) info: + /cib: @num_updates=4
Oct 08 20:07:31 pplxnsms02 pacemaker-based [2393] (cib_perform_op) info: + /cib/status/node_state[@id='2']: @crm-debug-origin=do_update_resource
Oct 08 20:07:31 pplxnsms02 pacemaker-based [2393] (cib_perform_op) info: ++ /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources:
Oct 08 20:07:31 pplxnsms02 pacemaker-based [2393] (cib_perform_op) info: ++
Oct 08 20:07:31 pplxnsms02 pacemaker-based [2393] (cib_perform_op) info: ++
Oct 08 20:07:31 pplxnsms02 pacemaker-based [2393] (cib_perform_op) info: ++
Oct 08 20:07:31 pplxnsms02 pacemaker-based [2393] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/30, version=0.524.6)
Oct 08 20:07:31 pplxnsms02 pacemaker-controld [2398] (te_rsc_command) notice: Initiating monitor operation itm_fs2_monitor_0 locally on pplxnsms02 | action 4
Oct 08 20:07:31 pplxnsms02 pacemaker-execd [2395] (process_lrmd_get_rsc_info) info: Agent information for 'itm_fs2' not in cache
Oct 08 20:07:31 pplxnsms02 pacemaker-execd [2395] (process_lrmd_rsc_register) info: Cached agent information for 'itm_fs2'
Oct 08 20:07:31 pplxnsms02 pacemaker-controld [2398] (do_lrm_rsc_op) notice: Requesting local execution of probe operation for itm_fs2 on pplxnsms02 | transition_key=4:0:7:644ce76d-aa78-4872-a7a0-7a85d6e6a5d3 op_key=itm_fs2_monitor_0
Oct 08 20:07:31 pplxnsms02 pacemaker-based [2393] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/31)
Oct 08 20:07:31 pplxnsms02 pacemaker-controld [2398] (te_fence_node) notice: Requesting fencing (reboot) of node pplxnsms01 | action=53 timeout=60000
Oct 08 20:07:31 pplxnsms02 pacemaker-controld [2398] (log_executor_event) notice: Result of probe operation for itm_lvm on pplxnsms02: not running | CIB update 32, graph action confirmed; call=9 key=itm_lvm_monitor_0 rc=7
Oct 08 20:07:31 pplxnsms02 pacemaker-controld [2398] (log_executor_event) notice: Result of probe operation for itm_vip on pplxnsms02: not running | CIB update 33, graph action confirmed; call=5 key=itm_vip_monitor_0 rc=7
Oct 08 20:07:31 pplxnsms02 pacemaker-fenced [2394] (handle_request) notice: Client pacemaker-controld.2398 wants to fence (reboot) pplxnsms01 using any device
Oct 08 20:07:31 pplxnsms02 pacemaker-fenced [2394] (initiate_remote_stonith_op) notice: Requesting peer fencing (reboot) targeting pplxnsms01 | id=ee1a80b4 state=querying base_timeout=60
Oct 08 20:07:31 pplxnsms02 pacemaker-based [2393] (cib_perform_op) info: Diff: --- 0.524.6 2
Oct 08 20:07:31 pplxnsms02 pacemaker-based [2393] (cib_perform_op) info: Diff: +++ 0.524.7 (null)
Oct 08 20:07:31 pplxnsms02 pacemaker-based [2393] (cib_perform_op) info: + /cib: @num_updates=7
Oct 08 20:07:31 pplxnsms02 pacemaker-based [2393] (cib_perform_op) info: ++ /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources:
Oct 08 20:07:31 pplxnsms02 pacemaker-based [2393] (cib_perform_op) info: ++
Oct 08 20:07:31 pplxnsms02 pacemaker-based [2393] (cib_perform_op) info: ++
Oct 08 20:07:31 pplxnsms02 pacemaker-based [2393] (cib_perform_op) info: ++
Oct 08 20:07:32 pplxnsms02 pacemaker-based [2393] (cib_perform_op) info: ++
Oct 08 20:07:32 pplxnsms02 pacemaker-based [2393] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/37, version=0.524.13)
Oct 08 20:07:32 pplxnsms02 pacemaker-controld [2398] (log_executor_event) notice: Result of probe operation for itm_fs2 on pplxnsms02: not running | CIB update 38, graph action confirmed; call=17 key=itm_fs2_monitor_0 rc=7
Oct 08 20:07:32 pplxnsms02 pacemaker-based [2393] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/38)
Oct 08 20:07:32 pplxnsms02 pacemaker-based [2393] (cib_perform_op) info: Diff: --- 0.524.13 2
Oct 08 20:07:32 pplxnsms02 pacemaker-based [2393] (cib_perform_op) info: Diff: +++ 0.524.14 (null)
Oct 08 20:07:32 pplxnsms02 pacemaker-based [2393] (cib_perform_op) info: + /cib: @num_updates=14
Oct 08 20:07:32 pplxnsms02 pacemaker-based [2393] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='itm_fs2']/lrm_rsc_op[@id='itm_fs2_last_0']: @transition-magic=0:7;4:0:7:644ce76d-aa78-4872-a7a0-7a85d6e6a5d3, @call-id=17, @rc-code=7, @op-status=0, @exec-time=308
Oct 08 20:07:32 pplxnsms02 pacemaker-based [2393] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/38, version=0.524.14)
Oct 08 20:07:32 pplxnsms02 pacemaker-controld [2398] (process_graph_event) info: Transition 0 action 4 (itm_fs2_monitor_0 on pplxnsms02) confirmed: not running | rc=7 call-id=17
Oct 08 20:07:32 pplxnsms02 pacemaker-controld [2398] (te_rsc_command) notice: Initiating monitor operation nco_itnm_monitor_0 locally on pplxnsms02 | action 8
Oct 08 20:07:32 pplxnsms02 pacemaker-execd [2395] (process_lrmd_get_rsc_info) info: Agent information for 'nco_itnm' not in cache
Oct 08 20:07:32 pplxnsms02 pacemaker-execd [2395] (process_lrmd_rsc_register) info: Cached agent information for 'nco_itnm'
Oct 08 20:07:32 pplxnsms02 pacemaker-controld [2398] (do_lrm_rsc_op) notice: Requesting local execution of probe operation for nco_itnm on pplxnsms02 | transition_key=8:0:7:644ce76d-aa78-4872-a7a0-7a85d6e6a5d3 op_key=nco_itnm_monitor_0
Oct 08 20:07:32 pplxnsms02 pacemaker-controld [2398] (wait_for_sync_result) info: itnm_meta-data_0[5259] exited with status 0
Oct 08 20:07:32 pplxnsms02 pacemaker-based [2393] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/39)
Oct 08 20:07:32 pplxnsms02 pacemaker-based [2393] (cib_perform_op) info: Diff: --- 0.524.14 2
Oct 08 20:07:32 pplxnsms02 pacemaker-based [2393] (cib_perform_op) info: Diff: +++ 0.524.15 (null)
Oct 08 20:07:32 pplxnsms02 pacemaker-based [2393] (cib_perform_op) info: + /cib: @num_updates=15
Oct 08 20:07:32 pplxnsms02 pacemaker-based [2393] (cib_perform_op) info: ++ /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources:
Oct 08 20:07:32 pplxnsms02 pacemaker-based [2393] (cib_perform_op) info: ++
Oct 08 20:07:32 pplxnsms02 pacemaker-based [2393] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/39, version=0.524.15)
Oct 08 20:07:32 itnm(nco_itnm)[5283]: ERROR: Cannot find the directory /san/tivoli/netcool!
Oct 08 20:07:32 omnibus(nco_omni)[5253]: ERROR: Cannot find the directory /san/tivoli/netcool!
Oct 08 20:07:32 pplxnsms02 pacemaker-controld [2398] (log_executor_event) notice: Result of probe operation for itm_fs3 on pplxnsms02: not running | CIB update 40, graph action confirmed; call=21 key=itm_fs3_monitor_0 rc=7
Oct 08 20:07:32 pplxnsms02 pacemaker-controld [2398] (log_executor_event) notice: Result of probe operation for nco_itnm on pplxnsms02: not running | CIB update 41, graph action confirmed; call=33 key=nco_itnm_monitor_0 rc=7
Oct 08 20:07:32 pplxnsms02 pacemaker-based [2393] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/40)
Oct 08 20:07:32 pplxnsms02 pacemaker-based [2393] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/41)
Oct 08 20:07:32 pplxnsms02 pacemaker-based [2393] (cib_perform_op) info: Diff: --- 0.524.15 2
Oct 08 20:07:32 pplxnsms02 pacemaker-based [2393] (cib_perform_op) info: Diff: +++ 0.524.16 (null)
Oct 08 20:07:32 pplxnsms02 pacemaker-based [2393] (cib_perform_op) info: + /cib: @num_updates=16
Oct 08 20:07:32 pplxnsms02 pacemaker-based [2393] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='itm_fs3']/lrm_rsc_op[@id='itm_fs3_last_0']: @transition-magic=0:7;5:0:7:644ce76d-aa78-4872-a7a0-7a85d6e6a5d3, @call-id=21, @rc-code=7, @op-status=0, @exec-time=395
Oct 08 20:07:32 pplxnsms02 pacemaker-based [2393] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/40, version=0.524.16)
Oct 08 20:07:32 pplxnsms02 pacemaker-based [2393] (cib_perform_op) info: Diff: --- 0.524.16 2
Oct 08 20:07:32 pplxnsms02 pacemaker-based [2393] (cib_perform_op) info: Diff: +++ 0.524.17 (null)
Oct 08 20:07:32 pplxnsms02 pacemaker-based [2393] (cib_perform_op) info: + /cib: @num_updates=17
Oct 08 20:07:32 pplxnsms02 pacemaker-based [2393] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='nco_itnm']/lrm_rsc_op[@id='nco_itnm_last_0']: @transition-magic=0:7;8:0:7:644ce76d-aa78-4872-a7a0-7a85d6e6a5d3, @call-id=33, @rc-code=7, @op-status=0, @exec-time=46
Oct 08 20:07:32 pplxnsms02 pacemaker-based [2393] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/41, version=0.524.17)
Oct 08 20:07:32 pplxnsms02 pacemaker-controld [2398] (process_graph_event) info: Transition 0 action 5 (itm_fs3_monitor_0 on pplxnsms02) confirmed: not running | rc=7 call-id=21
Oct 08 20:07:32 pplxnsms02 pacemaker-controld [2398] (process_graph_event) info: Transition 0 action 8 (nco_itnm_monitor_0 on pplxnsms02) confirmed: not running | rc=7 call-id=33
Oct 08 20:07:32 pplxnsms02 pacemaker-controld [2398] (te_rsc_command) notice: Initiating monitor operation nco_cognos_monitor_0 locally on pplxnsms02 | action 9
Oct 08 20:07:32 pplxnsms02 pacemaker-execd [2395] (process_lrmd_get_rsc_info) info: Agent information for 'nco_cognos' not in cache
Oct 08 20:07:32 pplxnsms02 pacemaker-execd [2395] (process_lrmd_rsc_register) info: Cached agent information for 'nco_cognos'
Oct 08 20:07:32 pplxnsms02 pacemaker-controld [2398] (do_lrm_rsc_op) notice: Requesting local execution of probe operation for nco_cognos on pplxnsms02 | transition_key=9:0:7:644ce76d-aa78-4872-a7a0-7a85d6e6a5d3 op_key=nco_cognos_monitor_0
Oct 08 20:07:32 pplxnsms02 pacemaker-controld [2398] (wait_for_sync_result) info: Cognos_meta-data_0[5323] exited with status 0
Oct 08 20:07:32 pplxnsms02 pacemaker-based [2393] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/42)
Oct 08 20:07:32 pplxnsms02 pacemaker-based [2393] (cib_perform_op) info: Diff: --- 0.524.17 2
Oct 08 20:07:32 pplxnsms02 pacemaker-based [2393] (cib_perform_op) info: Diff: +++ 0.524.18 (null)
Oct 08 20:07:32 pplxnsms02 pacemaker-based [2393] (cib_perform_op) info: + /cib: @num_updates=18
Oct 08 20:07:32 pplxnsms02 pacemaker-based [2393] (cib_perform_op) info: ++ /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources:
Oct 08 20:07:32 pplxnsms02 pacemaker-based [2393] (cib_perform_op) info: ++
Oct 08 20:07:32 pplxnsms02 pacemaker-based [2393] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/42, version=0.524.18)
Oct 08 20:07:32 pplxnsms02 pacemaker-controld [2398] (te_rsc_command) notice: Initiating monitor operation siem_vip_monitor_0 locally on pplxnsms02 | action 10
Oct 08 20:07:32 pplxnsms02 pacemaker-execd [2395] (process_lrmd_get_rsc_info) info: Agent information for 'siem_vip' not in cache
Oct 08 20:07:32 pplxnsms02 pacemaker-execd [2395] (process_lrmd_rsc_register) info: Cached agent information for 'siem_vip'
Oct 08 20:07:32 pplxnsms02 pacemaker-controld [2398] (do_lrm_rsc_op) notice: Requesting local execution of probe operation for siem_vip on pplxnsms02 | transition_key=10:0:7:644ce76d-aa78-4872-a7a0-7a85d6e6a5d3 op_key=siem_vip_monitor_0
Oct 08 20:07:32 pplxnsms02 pacemaker-based [2393] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/43)
Oct 08 20:07:32 pplxnsms02 pacemaker-controld [2398] (log_executor_event) notice: Result of probe operation for nco_omni on pplxnsms02: not running | CIB update 44, graph action confirmed; call=29 key=nco_omni_monitor_0 rc=7
Oct 08 20:07:32 pplxnsms02 pacemaker-based [2393] (cib_perform_op) info: Diff: --- 0.524.18 2
Oct 08 20:07:32 pplxnsms02 pacemaker-based [2393] (cib_perform_op) info: Diff: +++ 0.524.19 (null)
Oct 08 20:07:32 pplxnsms02 pacemaker-based [2393] (cib_perform_op) info: + /cib: @num_updates=19
Oct 08 20:07:32 pplxnsms02 pacemaker-based [2393] (cib_perform_op) info: ++ /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources:
Oct 08 20:07:32 pplxnsms02 pacemaker-based [2393] (cib_perform_op) info: ++
Oct 08 20:07:32 pplxnsms02 pacemaker-based [2393] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/43, version=0.524.19)
Oct 08 20:07:32 pplxnsms02 pacemaker-based [2393] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/44)
Oct 08 20:07:32 pplxnsms02 pacemaker-based [2393] (cib_perform_op) info: Diff: --- 0.524.19 2
Oct 08 20:07:32 pplxnsms02 pacemaker-based [2393] (cib_perform_op) info: Diff: +++ 0.524.20 (null)
Oct 08 20:07:32 pplxnsms02 pacemaker-based [2393] (cib_perform_op) info: + /cib: @num_updates=20
Oct 08 20:07:32 pplxnsms02 pacemaker-based [2393] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='nco_omni']/lrm_rsc_op[@id='nco_omni_last_0']: @transition-magic=0:7;7:0:7:644ce76d-aa78-4872-a7a0-7a85d6e6a5d3, @call-id=29, @rc-code=7, @op-status=0, @exec-time=96
Oct 08 20:07:32 pplxnsms02 pacemaker-based [2393] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/44, version=0.524.20)
Oct 08 20:07:32 pplxnsms02 pacemaker-controld [2398] (process_graph_event) info: Transition 0 action 7 (nco_omni_monitor_0 on pplxnsms02) confirmed: not running | rc=7 call-id=29
Oct 08 20:07:32 pplxnsms02 pacemaker-controld [2398] (te_rsc_command) notice: Initiating monitor operation siem_lvm_monitor_0 locally on pplxnsms02 | action 11
Oct 08 20:07:32 pplxnsms02 pacemaker-execd [2395] (process_lrmd_get_rsc_info) info: Agent information for 'siem_lvm' not in cache
Oct 08 20:07:32 pplxnsms02 pacemaker-execd [2395] (process_lrmd_rsc_register) info: Cached agent information for 'siem_lvm'
Oct 08 20:07:32 pplxnsms02 pacemaker-controld [2398] (do_lrm_rsc_op) notice: Requesting local execution of probe operation for siem_lvm on pplxnsms02 | transition_key=11:0:7:644ce76d-aa78-4872-a7a0-7a85d6e6a5d3 op_key=siem_lvm_monitor_0
Oct 08 20:07:32 pplxnsms02 pacemaker-based [2393] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/45)
Oct 08 20:07:32 pplxnsms02 pacemaker-based [2393] (cib_perform_op) info: Diff: --- 0.524.20 2
Oct 08 20:07:32 pplxnsms02 pacemaker-based [2393] (cib_perform_op) info: Diff: +++ 0.524.21 (null)
Oct 08 20:07:32 pplxnsms02 pacemaker-based [2393] (cib_perform_op) info: + /cib: @num_updates=21
Oct 08 20:07:32 pplxnsms02 pacemaker-based [2393] (cib_perform_op) info: ++ /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources:
Oct 08 20:07:32 pplxnsms02 pacemaker-based [2393] (cib_perform_op) info: ++
Oct 08 20:07:32 pplxnsms02 pacemaker-based [2393] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/45, version=0.524.21)
Oct 08 20:07:32 Cognos(nco_cognos)[5342]: ERROR: Cannot find the directory /san/tivoli/IBM/WebSphere!
Oct 08 20:07:32 pplxnsms02 pacemaker-controld [2398] (log_executor_event) notice: Result of probe operation for siem_lvm on pplxnsms02: not running | CIB update 46, graph action confirmed; call=45 key=siem_lvm_monitor_0 rc=7
Oct 08 20:07:32 pplxnsms02 pacemaker-based [2393] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/46)
Oct 08 20:07:32 pplxnsms02 pacemaker-based [2393] (cib_perform_op) info: Diff: --- 0.524.21 2
Oct 08 20:07:32 pplxnsms02 pacemaker-based [2393] (cib_perform_op) info: Diff: +++ 0.524.22 (null)
Oct 08 20:07:32 pplxnsms02 pacemaker-based [2393] (cib_perform_op) info: + /cib: @num_updates=22
Oct 08 20:07:32 pplxnsms02 pacemaker-based [2393] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='siem_lvm']/lrm_rsc_op[@id='siem_lvm_last_0']: @transition-magic=0:7;11:0:7:644ce76d-aa78-4872-a7a0-7a85d6e6a5d3, @call-id=45, @rc-code=7, @op-status=0, @exec-time=33
Oct 08 20:07:32 pplxnsms02 pacemaker-based [2393] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/46, version=0.524.22)
Oct 08 20:07:32 pplxnsms02 pacemaker-controld [2398] (process_graph_event) info: Transition 0 action 11 (siem_lvm_monitor_0 on pplxnsms02) confirmed: not running | rc=7 call-id=45
Oct 08 20:07:32 pplxnsms02 pacemaker-controld [2398] (te_rsc_command) notice: Initiating monitor operation siem_fs_monitor_0 locally on pplxnsms02 | action 12
Oct 08 20:07:32 pplxnsms02 pacemaker-execd [2395] (process_lrmd_get_rsc_info) info: Agent information for 'siem_fs' not in cache
Oct 08 20:07:32 pplxnsms02 pacemaker-execd [2395] (process_lrmd_rsc_register) info: Cached agent information for 'siem_fs'
Oct 08 20:07:32 pplxnsms02 pacemaker-controld [2398] (do_lrm_rsc_op) notice: Requesting local execution of probe operation for siem_fs on pplxnsms02 | transition_key=12:0:7:644ce76d-aa78-4872-a7a0-7a85d6e6a5d3 op_key=siem_fs_monitor_0
Oct 08 20:07:32 pplxnsms02 pacemaker-based [2393] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/47)
Oct 08 20:07:32 pplxnsms02 pacemaker-based [2393] (cib_perform_op) info: Diff: --- 0.524.22 2
Oct 08 20:07:32 pplxnsms02 pacemaker-based [2393] (cib_perform_op) info: Diff: +++ 0.524.23 (null)
Oct 08 20:07:32 pplxnsms02 pacemaker-based [2393] (cib_perform_op) info: + /cib: @num_updates=23
Oct 08 20:07:32 pplxnsms02 pacemaker-based [2393] (cib_perform_op) info: ++ /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources:
Oct 08 20:07:32 pplxnsms02 pacemaker-based [2393] (cib_perform_op) info: ++
Oct 08 20:07:32 pplxnsms02 pacemaker-based [2393] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/47, version=0.524.23)
Oct 08 20:07:32 pplxnsms02 pacemaker-controld [2398] (log_executor_event) notice: Result of probe operation for nco_cognos on pplxnsms02: not running | CIB update 48, graph action confirmed; call=37 key=nco_cognos_monitor_0 rc=7
Oct 08 20:07:32 pplxnsms02 pacemaker-based [2393] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/48)
Oct 08 20:07:32 pplxnsms02 pacemaker-based [2393] (cib_perform_op) info: Diff: --- 0.524.23 2
Oct 08 20:07:32 pplxnsms02 pacemaker-based [2393] (cib_perform_op) info: Diff: +++ 0.524.24 (null)
Oct 08 20:07:32 pplxnsms02 pacemaker-based [2393] (cib_perform_op) info: + /cib: @num_updates=24
Oct 08 20:07:32 pplxnsms02 pacemaker-based [2393] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='nco_cognos']/lrm_rsc_op[@id='nco_cognos_last_0']: @transition-magic=0:7;9:0:7:644ce76d-aa78-4872-a7a0-7a85d6e6a5d3, @call-id=37, @rc-code=7, @op-status=0, @exec-time=62
Oct 08 20:07:32 pplxnsms02 pacemaker-based [2393] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/48, version=0.524.24)
Oct 08 20:07:32 pplxnsms02 pacemaker-controld [2398] (process_graph_event) info: Transition 0 action 9 (nco_cognos_monitor_0 on pplxnsms02) confirmed: not running | rc=7 call-id=37
Oct 08 20:07:32 pplxnsms02 pacemaker-controld [2398] (te_rsc_command) notice: Initiating monitor operation siem_rsyslog_monitor_0 locally on pplxnsms02 | action 13
Oct 08 20:07:32 pplxnsms02 pacemaker-execd [2395] (process_lrmd_get_rsc_info) info: Agent information for 'siem_rsyslog' not in cache
Oct 08 20:07:32 pplxnsms02 pacemaker-execd [2395] (process_lrmd_rsc_register) info: Cached agent information for 'siem_rsyslog'
Oct 08 20:07:32 pplxnsms02 pacemaker-controld [2398] (do_lrm_rsc_op) notice: Requesting local execution of probe operation for siem_rsyslog on pplxnsms02 | transition_key=13:0:7:644ce76d-aa78-4872-a7a0-7a85d6e6a5d3 op_key=siem_rsyslog_monitor_0
Oct 08 20:07:32 pplxnsms02 pacemaker-controld [2398] (wait_for_sync_result) info: siemsyslog_meta-data_0[5394] exited with status 0
Oct 08 20:07:32 pplxnsms02 pacemaker-based [2393] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/49)
Oct 08 20:07:32 pplxnsms02 pacemaker-based [2393] (cib_perform_op) info: Diff: --- 0.524.24 2
Oct 08 20:07:32 pplxnsms02 pacemaker-based [2393] (cib_perform_op) info: Diff: +++ 0.524.25 (null)
Oct 08 20:07:32 pplxnsms02 pacemaker-based [2393] (cib_perform_op) info: + /cib: @num_updates=25
Oct 08 20:07:32 pplxnsms02 pacemaker-based [2393] (cib_perform_op) info: ++ /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources:
Oct 08 20:07:32 pplxnsms02 pacemaker-based [2393] (cib_perform_op) info: ++
Oct 08 20:07:32 pplxnsms02 pacemaker-based [2393] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/49, version=0.524.25)
Oct 08 20:07:32 pplxnsms02 pacemaker-controld [2398] (log_executor_event) notice: Result of probe operation for siem_vip on pplxnsms02: not running | CIB update 50, graph action confirmed; call=41 key=siem_vip_monitor_0 rc=7
Oct 08 20:07:32 pplxnsms02 pacemaker-based [2393] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/50)
Oct 08 20:07:32 pplxnsms02 pacemaker-based [2393] (cib_perform_op) info: Diff: --- 0.524.25 2
Oct 08 20:07:32 pplxnsms02 pacemaker-based [2393] (cib_perform_op) info: Diff: +++ 0.524.26 (null)
Oct 08 20:07:32 pplxnsms02 pacemaker-based [2393] (cib_perform_op) info: + /cib: @num_updates=26
Oct 08 20:07:32 pplxnsms02 pacemaker-based [2393] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='siem_vip']/lrm_rsc_op[@id='siem_vip_last_0']: @transition-magic=0:7;10:0:7:644ce76d-aa78-4872-a7a0-7a85d6e6a5d3, @call-id=41, @rc-code=7, @op-status=0, @exec-time=148, @queue-time=2
Oct 08 20:07:32 pplxnsms02 pacemaker-based [2393] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/50, version=0.524.26)
Oct 08 20:07:32 pplxnsms02 pacemaker-controld [2398] (process_graph_event) info: Transition 0 action 10 (siem_vip_monitor_0 on pplxnsms02) confirmed: not running | rc=7 call-id=41
Oct 08 20:07:32 pplxnsms02 pacemaker-controld [2398] (te_rsc_command) notice: Initiating monitor operation web_mariadb_monitor_0 locally on pplxnsms02 | action 14
Oct 08 20:07:32 pplxnsms02 pacemaker-execd [2395] (process_lrmd_get_rsc_info) info: Agent information for 'web_mariadb' not in cache
Oct 08 20:07:32 pplxnsms02 pacemaker-execd [2395] (process_lrmd_rsc_register) info: Cached agent information for 'web_mariadb'
Oct 08 20:07:32 pplxnsms02 pacemaker-controld [2398] (do_lrm_rsc_op) notice: Requesting local execution of probe operation for web_mariadb on pplxnsms02 | transition_key=14:0:7:644ce76d-aa78-4872-a7a0-7a85d6e6a5d3 op_key=web_mariadb_monitor_0
Oct 08 20:07:32 pplxnsms02 pacemaker-execd [2395] (log_op_output) info: siem_rsyslog_monitor_0[5447] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 3430 1 0 20:07 ? 00:00:00 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:07:32 Filesystem(siem_fs)[5381]: WARNING: Couldn't find device [/dev/vgslog/lv_log01]. Expected /dev/??? to exist
Oct 08 20:07:32 pplxnsms02 pacemaker-controld [2398] (wait_for_sync_result) info: mysql_meta-data_0[5466] exited with status 0
Oct 08 20:07:32 pplxnsms02 pacemaker-based [2393] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/51)
Oct 08 20:07:32 pplxnsms02 pacemaker-based [2393] (cib_perform_op) info: Diff: --- 0.524.26 2
Oct 08 20:07:32 pplxnsms02 pacemaker-based [2393] (cib_perform_op) info: Diff: +++ 0.524.27 (null)
Oct 08 20:07:32 pplxnsms02 pacemaker-based [2393] (cib_perform_op) info: + /cib: @num_updates=27
Oct 08 20:07:32 pplxnsms02 pacemaker-based [2393] (cib_perform_op) info: ++ /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources:
Oct 08 20:07:32 pplxnsms02 pacemaker-based [2393] (cib_perform_op) info: ++
Oct 08 20:07:32 pplxnsms02 pacemaker-based [2393] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/51, version=0.524.27)
Oct 08 20:07:32 pplxnsms02 pacemaker-controld [2398] (log_executor_event) notice: Result of probe operation for siem_rsyslog on pplxnsms02: not running | CIB update 52, graph action confirmed; call=53 key=siem_rsyslog_monitor_0 rc=7
Oct 08 20:07:32 pplxnsms02 pacemaker-controld [2398] (log_executor_event) notice: siem_rsyslog_monitor_0@pplxnsms02 output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 3430 1 0 20:07 ? 00:00:00 /usr/sbin/rsyslogd -n: integer expression expected\n ]
Oct 08 20:07:32 pplxnsms02 pacemaker-based [2393] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/52)
Oct 08 20:07:32 pplxnsms02 pacemaker-based [2393] (cib_perform_op) info: Diff: --- 0.524.27 2
Oct 08 20:07:32 pplxnsms02 pacemaker-based [2393] (cib_perform_op) info: Diff: +++ 0.524.28 (null)
Oct 08 20:07:32 pplxnsms02 pacemaker-based [2393] (cib_perform_op) info: + /cib: @num_updates=28
Oct 08 20:07:32 pplxnsms02 pacemaker-based [2393] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='siem_rsyslog']/lrm_rsc_op[@id='siem_rsyslog_last_0']: @transition-magic=0:7;13:0:7:644ce76d-aa78-4872-a7a0-7a85d6e6a5d3, @call-id=53, @rc-code=7, @op-status=0, @exec-time=76
Oct 08 20:07:32 pplxnsms02 pacemaker-based [2393] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/52, version=0.524.28)
Oct 08 20:07:32 pplxnsms02 pacemaker-controld [2398] (process_graph_event) info: Transition 0 action 13 (siem_rsyslog_monitor_0 on pplxnsms02) confirmed: not running | rc=7 call-id=53
Oct 08 20:07:32 pplxnsms02 pacemaker-controld [2398] (te_rsc_command) notice: Initiating monitor operation web_matomo_monitor_0 locally on pplxnsms02 | action 15
Oct 08 20:07:32 pplxnsms02 pacemaker-execd [2395] (process_lrmd_get_rsc_info) info: Agent information for 'web_matomo' not in cache
Oct 08 20:07:32 pplxnsms02 pacemaker-execd [2395] (process_lrmd_rsc_register) info: Cached agent information for 'web_matomo'
Oct 08 20:07:32 pplxnsms02 pacemaker-controld [2398] (do_lrm_rsc_op) notice: Requesting local execution of probe operation for web_matomo on pplxnsms02 | transition_key=15:0:7:644ce76d-aa78-4872-a7a0-7a85d6e6a5d3 op_key=web_matomo_monitor_0
Oct 08 20:07:32 pplxnsms02 pacemaker-fenced [2394] (dynamic_list_search_cb) info: Refreshing target list for fence-sbd
Oct 08 20:07:32 pplxnsms02 pacemaker-controld [2398] (wait_for_sync_result) info: apache_meta-data_0[5646] exited with status 0
Oct 08 20:07:32 pplxnsms02 pacemaker-based [2393] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/53)
Oct 08 20:07:32 pplxnsms02 pacemaker-controld [2398] (log_executor_event) notice: Result of probe operation for siem_fs on pplxnsms02: not running | CIB update 54, graph action confirmed; call=49 key=siem_fs_monitor_0 rc=7
Oct 08 20:07:32 pplxnsms02 pacemaker-based [2393] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/54)
Oct 08 20:07:32 pplxnsms02 pacemaker-based [2393] (cib_perform_op) info: Diff: --- 0.524.28 2
Oct 08 20:07:32 pplxnsms02 pacemaker-based [2393] (cib_perform_op) info: Diff: +++ 0.524.29 (null)
Oct 08 20:07:32 pplxnsms02 pacemaker-based [2393] (cib_perform_op) info: + /cib: @num_updates=29
Oct 08 20:07:32 pplxnsms02 pacemaker-based [2393] (cib_perform_op) info: ++ /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources:
Oct 08 20:07:32 pplxnsms02 pacemaker-based [2393] (cib_perform_op) info: ++
Oct 08 20:07:32 pplxnsms02 pacemaker-based [2393] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/53, version=0.524.29)
Oct 08 20:07:32 pplxnsms02 pacemaker-based [2393] (cib_perform_op) info: Diff: --- 0.524.29 2
Oct 08 20:07:32 pplxnsms02 pacemaker-based [2393] (cib_perform_op) info: Diff: +++ 0.524.30 (null)
Oct 08 20:07:32 pplxnsms02 pacemaker-based [2393] (cib_perform_op) info: + /cib: @num_updates=30
Oct 08 20:07:32 pplxnsms02 pacemaker-based [2393] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='siem_fs']/lrm_rsc_op[@id='siem_fs_last_0']: @transition-magic=0:7;12:0:7:644ce76d-aa78-4872-a7a0-7a85d6e6a5d3, @call-id=49, @rc-code=7, @op-status=0, @exec-time=355
Oct 08 20:07:32 pplxnsms02 pacemaker-fenced [2394] (process_remote_stonith_query) info: Query result 1 of 1 from pplxnsms02 for pplxnsms01/reboot (1 device) ee1a80b4-d54a-442f-9aa7-32ec58571f25
Oct 08 20:07:32 pplxnsms02 pacemaker-fenced [2394] (process_remote_stonith_query) info: All query replies have arrived, continuing (1 expected/1 received)
Oct 08 20:07:32 pplxnsms02 pacemaker-fenced [2394] (request_peer_fencing) info: Total timeout set to 60 for peer's fencing targeting pplxnsms01 for pacemaker-controld.2398|id=ee1a80b4
Oct 08 20:07:32 pplxnsms02 pacemaker-fenced [2394] (request_peer_fencing) notice: Requesting that pplxnsms02 perform 'reboot' action targeting pplxnsms01 | for client pacemaker-controld.2398 (72s, 0s)
Oct 08 20:07:32 pplxnsms02 pacemaker-based [2393] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/54, version=0.524.30)
Oct 08 20:07:32 pplxnsms02 pacemaker-controld [2398] (process_graph_event) info: Transition 0 action 12 (siem_fs_monitor_0 on pplxnsms02) confirmed: not running | rc=7 call-id=49
Oct 08 20:07:32 pplxnsms02 pacemaker-controld [2398] (te_rsc_command) notice: Initiating monitor operation fence-sbd_monitor_0 locally on pplxnsms02 | action 16
Oct 08 20:07:32 pplxnsms02 pacemaker-fenced [2394] (can_fence_host_with_device) notice: fence-sbd is eligible to fence (reboot) pplxnsms01: dynamic-list
Oct 08 20:07:32 pplxnsms02 pacemaker-fenced [2394] (stonith_fence_get_devices_cb) info: Found 1 matching device for target 'pplxnsms01'
Oct 08 20:07:32 pplxnsms02 pacemaker-execd [2395] (process_lrmd_get_rsc_info) info: Agent information for 'fence-sbd' not in cache
Oct 08 20:07:32 pplxnsms02 pacemaker-execd [2395] (process_lrmd_rsc_register) info: Cached agent information for 'fence-sbd'
Oct 08 20:07:32 pplxnsms02 pacemaker-controld [2398] (do_lrm_rsc_op) notice: Requesting local execution of probe operation for fence-sbd on pplxnsms02 | transition_key=16:0:7:644ce76d-aa78-4872-a7a0-7a85d6e6a5d3 op_key=fence-sbd_monitor_0
Oct 08 20:07:32 pplxnsms02 pacemaker-controld [2398] (wait_for_sync_result) info: fence_sbd_metadata_1[5711] exited with status 0
Oct 08 20:07:32 pplxnsms02 pacemaker-based [2393] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/55)
Oct 08 20:07:32 pplxnsms02 pacemaker-based [2393] (cib_perform_op) info: Diff: --- 0.524.30 2
Oct 08 20:07:32 pplxnsms02 pacemaker-based [2393] (cib_perform_op) info: Diff: +++ 0.524.31 (null)
Oct 08 20:07:32 pplxnsms02 pacemaker-based [2393] (cib_perform_op) info: + /cib: @num_updates=31
Oct 08 20:07:32 pplxnsms02 pacemaker-based [2393] (cib_perform_op) info: ++ /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources:
Oct 08 20:07:32 pplxnsms02 pacemaker-based [2393] (cib_perform_op) info: ++
Oct 08 20:07:32 pplxnsms02 pacemaker-based [2393] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/55, version=0.524.31)
Oct 08 20:07:32 pplxnsms02 pacemaker-controld [2398] (log_executor_event) notice: Result of probe operation for fence-sbd on pplxnsms02: not running | CIB update 56, graph action confirmed; call=65 key=fence-sbd_monitor_0 rc=7
Oct 08 20:07:32 pplxnsms02 pacemaker-based [2393] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/56)
Oct 08 20:07:32 pplxnsms02 pacemaker-based [2393] (cib_perform_op) info: Diff: --- 0.524.31 2
Oct 08 20:07:32 pplxnsms02 pacemaker-based [2393] (cib_perform_op) info: Diff: +++ 0.524.32 (null)
Oct 08 20:07:32 pplxnsms02 pacemaker-based [2393] (cib_perform_op) info: + /cib: @num_updates=32
Oct 08 20:07:32 pplxnsms02 pacemaker-based [2393] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='fence-sbd']/lrm_rsc_op[@id='fence-sbd_last_0']: @transition-magic=0:7;16:0:7:644ce76d-aa78-4872-a7a0-7a85d6e6a5d3, @call-id=65, @rc-code=7, @op-status=0, @exec-time=1
Oct 08 20:07:32 pplxnsms02 pacemaker-based [2393] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/56, version=0.524.32)
Oct 08 20:07:32 pplxnsms02 pacemaker-controld [2398] (process_graph_event) info: Transition 0 action 16 (fence-sbd_monitor_0 on pplxnsms02) confirmed: not running | rc=7 call-id=65
Oct 08 20:07:32 mysql(web_mariadb)[5631]: ERROR: Datadir /siemlog/mysql doesn't exist
Oct 08 20:07:32 mysql(web_mariadb)[5631]: INFO: MySQL is not running
Oct 08 20:07:32 pplxnsms02 pacemaker-execd [2395] (log_op_output) info: web_mariadb_monitor_0[5631] error output [ ocf-exit-reason:Datadir /siemlog/mysql doesn't exist ]
Oct 08 20:07:32 pplxnsms02 pacemaker-controld [2398] (log_executor_event) notice: Result of probe operation for web_mariadb on pplxnsms02: not running (Datadir /siemlog/mysql doesn't exist) | CIB update 57, graph action confirmed; call=57 key=web_mariadb_monitor_0 rc=7
Oct 08 20:07:32 pplxnsms02 pacemaker-controld [2398] (log_executor_event) notice: web_mariadb_monitor_0@pplxnsms02 output [ ocf-exit-reason:Datadir /siemlog/mysql doesn't exist\n ]
Oct 08 20:07:32 pplxnsms02 pacemaker-based [2393] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/57)
Oct 08 20:07:32 pplxnsms02 pacemaker-based [2393] (cib_perform_op) info: Diff: --- 0.524.32 2
Oct 08 20:07:32 pplxnsms02 pacemaker-based [2393] (cib_perform_op) info: Diff: +++ 0.524.33 (null)
Oct 08 20:07:32 pplxnsms02 pacemaker-based [2393] (cib_perform_op) info: + /cib: @num_updates=33
Oct 08 20:07:32 pplxnsms02 pacemaker-based [2393] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='web_mariadb']/lrm_rsc_op[@id='web_mariadb_last_0']: @transition-magic=0:7;14:0:7:644ce76d-aa78-4872-a7a0-7a85d6e6a5d3, @call-id=57, @rc-code=7, @op-status=0, @exec-time=263
Oct 08 20:07:32 pplxnsms02 pacemaker-based [2393] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/57, version=0.524.33)
Oct 08 20:07:32 pplxnsms02 pacemaker-controld [2398] (process_graph_event) info: Transition 0 action 14 (web_mariadb_monitor_0 on pplxnsms02) confirmed: not running | rc=7 call-id=57
Oct 08 20:07:32 apache(web_matomo)[5702]: INFO: apache not running
Oct 08 20:07:32 pplxnsms02 pacemaker-controld [2398] (log_executor_event) notice: Result of probe operation for web_matomo on pplxnsms02: not running | CIB update 58, graph action confirmed; call=61 key=web_matomo_monitor_0 rc=7
Oct 08 20:07:32 pplxnsms02 pacemaker-based [2393] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/58)
Oct 08 20:07:32 pplxnsms02 pacemaker-based [2393] (cib_perform_op) info: Diff: --- 0.524.33 2
Oct 08 20:07:32 pplxnsms02 pacemaker-based [2393] (cib_perform_op) info: Diff: +++ 0.524.34 (null)
Oct 08 20:07:32 pplxnsms02 pacemaker-based [2393] (cib_perform_op) info: + /cib: @num_updates=34
Oct 08 20:07:32 pplxnsms02 pacemaker-based [2393] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='web_matomo']/lrm_rsc_op[@id='web_matomo_last_0']: @transition-magic=0:7;15:0:7:644ce76d-aa78-4872-a7a0-7a85d6e6a5d3, @call-id=61, @rc-code=7, @op-status=0, @exec-time=225
Oct 08 20:07:32 pplxnsms02 pacemaker-based [2393] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/58, version=0.524.34)
Oct 08 20:07:32 pplxnsms02 pacemaker-controld [2398] (process_graph_event) info: Transition 0 action 15 (web_matomo_monitor_0 on pplxnsms02) confirmed: not running | rc=7 call-id=61
Oct 08 20:07:34 pplxnsms02 pacemaker-controld [2398] (log_executor_event) notice: Result of probe operation for nco_db2 on pplxnsms02: not running | CIB update 59, graph action confirmed; call=25 key=nco_db2_monitor_0 rc=7
Oct 08 20:07:34 pplxnsms02 pacemaker-based [2393] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/59)
Oct 08 20:07:34 pplxnsms02 pacemaker-based [2393] (cib_perform_op) info: Diff: --- 0.524.34 2
Oct 08 20:07:34 pplxnsms02 pacemaker-based [2393] (cib_perform_op) info: Diff: +++ 0.524.35 (null)
Oct 08 20:07:34 pplxnsms02 pacemaker-based [2393] (cib_perform_op) info: + /cib: @num_updates=35
Oct 08 20:07:34 pplxnsms02 pacemaker-based [2393] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='nco_db2']/lrm_rsc_op[@id='nco_db2_last_0']: @transition-magic=0:7;6:0:7:644ce76d-aa78-4872-a7a0-7a85d6e6a5d3, @call-id=25, @rc-code=7, @op-status=0, @exec-time=2582
Oct 08 20:07:34 pplxnsms02 pacemaker-based [2393] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/59, version=0.524.35)
Oct 08 20:07:34 pplxnsms02 pacemaker-controld [2398] (process_graph_event) info: Transition 0 action 6 (nco_db2_monitor_0 on pplxnsms02) confirmed: not running | rc=7 call-id=25
Oct 08 20:07:39 pplxnsms02 pacemaker-based [2393] (cib_process_ping) info: Reporting our current digest to pplxnsms02: d481bdeb3e2d8f3b669ef60687995639 for 0.524.35 (0x55ced4e387e0 0)
Oct 08 20:07:40 pplxnsms02 pacemaker-controld [2398] (pcmk__procfs_pid_of) info: Found pacemaker-based active as process 2393
Oct 08 20:07:40 pplxnsms02 pacemaker-controld [2398] (throttle_check_thresholds) info: Moderate CPU load detected: 5.650000
Oct 08 20:07:40 pplxnsms02 pacemaker-controld [2398] (throttle_send_command) info: New throttle mode: medium load (was undetermined)
Oct 08 20:07:52 pplxnsms02 pacemaker-fenced [2394] (log_async_result) notice: Operation 'reboot' [5707] targeting pplxnsms01 using fence-sbd returned 0 | call 4 from pacemaker-controld.2398
Oct 08 20:07:52 pplxnsms02 pacemaker-fenced [2394] (finalize_op) notice: Operation 'reboot' targeting pplxnsms01 by pplxnsms02 for pacemaker-controld.2398@pplxnsms02: OK (complete) | id=ee1a80b4
Oct 08 20:07:52 pplxnsms02 pacemaker-controld [2398] (tengine_stonith_callback) notice: Fence operation 4 for pplxnsms01 passed
Oct 08 20:07:52 pplxnsms02 pacemaker-controld [2398] (update_peer_state_iter) notice: Node pplxnsms01 state is now lost | nodeid=1 previous=unknown source=crmd_peer_down
Oct 08 20:07:52 pplxnsms02 pacemaker-controld [2398] (peer_update_callback) info: Cluster node pplxnsms01 is now lost (was in unknown state)
Oct 08 20:07:52 pplxnsms02 pacemaker-controld [2398] (crm_update_peer_proc) info: crmd_peer_down: Node pplxnsms01[1] - all processes are now offline
Oct 08 20:07:52 pplxnsms02 pacemaker-controld [2398] (peer_update_callback) info: Node pplxnsms01 is no longer a peer | DC=true old=0x0000000 new=0x0000001
Oct 08 20:07:52 pplxnsms02 pacemaker-controld [2398] (pcmk__update_peer_expected) info: crmd_peer_down: Node pplxnsms01[1] - expected state is now down (was (null))
Oct 08 20:07:52 pplxnsms02 pacemaker-controld [2398] (controld_delete_node_state) info: Deleting all state for node pplxnsms01 (via CIB call 62) | xpath=//node_state[@uname='pplxnsms01']/*
Oct 08 20:07:52 pplxnsms02 pacemaker-controld [2398] (handle_fence_notification) notice: Peer pplxnsms01 was terminated (reboot) by pplxnsms02 on behalf of pacemaker-controld.2398@pplxnsms02: OK | event=ee1a80b4-d54a-442f-9aa7-32ec58571f25
Oct 08 20:07:52 pplxnsms02 pacemaker-controld [2398] (controld_delete_node_state) info: Deleting all state for node pplxnsms01 (via CIB call 64) | xpath=//node_state[@uname='pplxnsms01']/*
Oct 08 20:07:52 pplxnsms02 pacemaker-based [2393] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/60)
Oct 08 20:07:52 pplxnsms02 pacemaker-controld [2398] (te_rsc_command) notice: Initiating start operation itm_vip_start_0 locally on pplxnsms02 | action 17
Oct 08 20:07:52 pplxnsms02 pacemaker-controld [2398] (do_lrm_rsc_op) notice: Requesting local execution of start operation for itm_vip on pplxnsms02 | transition_key=17:0:0:644ce76d-aa78-4872-a7a0-7a85d6e6a5d3 op_key=itm_vip_start_0
Oct 08 20:07:52 pplxnsms02 pacemaker-based [2393] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/61)
Oct 08 20:07:52 pplxnsms02 pacemaker-based [2393] (cib_process_request) info: Forwarding cib_delete operation for section //node_state[@uname='pplxnsms01']/* to all (origin=local/crmd/62)
Oct 08 20:07:52 pplxnsms02 pacemaker-execd [2395] (log_execute) info: executing - rsc:itm_vip action:start call_id:66
Oct 08 20:07:52 pplxnsms02 pacemaker-based [2393] (cib_perform_op) info: Diff: --- 0.524.35 2
Oct 08 20:07:52 pplxnsms02 pacemaker-based [2393] (cib_perform_op) info: Diff: +++ 0.524.36 (null)
Oct 08 20:07:52 pplxnsms02 pacemaker-based [2393] (cib_perform_op) info: + /cib: @num_updates=36
Oct 08 20:07:52 pplxnsms02 pacemaker-based [2393] (cib_perform_op) info: ++ /cib/status:
Oct 08 20:07:52 pplxnsms02 pacemaker-controld [2398] (te_rsc_command) notice: Initiating start operation siem_vip_start_0 locally on pplxnsms02 | action 39
Oct 08 20:07:52 pplxnsms02 pacemaker-controld [2398] (do_lrm_rsc_op) notice: Requesting local execution of start operation for siem_vip on pplxnsms02 | transition_key=39:0:0:644ce76d-aa78-4872-a7a0-7a85d6e6a5d3 op_key=siem_vip_start_0
Oct 08 20:07:52 pplxnsms02 pacemaker-based [2393] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/60, version=0.524.36)
Oct 08 20:07:52 pplxnsms02 pacemaker-execd [2395] (log_execute) info: executing - rsc:siem_vip action:start call_id:67
Oct 08 20:07:52 pplxnsms02 pacemaker-based [2393] (cib_perform_op) info: Diff: --- 0.524.36 2
Oct 08 20:07:52 pplxnsms02 pacemaker-based [2393] (cib_perform_op) info: Diff: +++ 0.524.37 (null)
Oct 08 20:07:52 pplxnsms02 pacemaker-based [2393] (cib_perform_op) info: + /cib: @num_updates=37
Oct 08 20:07:52 pplxnsms02 pacemaker-based [2393] (cib_perform_op) info: + /cib/status/node_state[@id='1']: @crm-debug-origin=send_stonith_update, @in_ccm=false, @join=down, @expected=down
Oct 08 20:07:52 pplxnsms02 pacemaker-based [2393] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/61, version=0.524.37)
Oct 08 20:07:52 pplxnsms02 pacemaker-controld [2398] (cib_fencing_updated) info: Fencing update 61 for pplxnsms01: complete
Oct 08 20:07:52 pplxnsms02 pacemaker-based [2393] (cib_process_request) info: Completed cib_delete operation for section //node_state[@uname='pplxnsms01']/*: OK (rc=0, origin=pplxnsms02/crmd/62, version=0.524.37)
Oct 08 20:07:52 pplxnsms02 pacemaker-based [2393] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/63)
Oct 08 20:07:52 pplxnsms02 pacemaker-based [2393] (cib_process_request) info: Forwarding cib_delete operation for section //node_state[@uname='pplxnsms01']/* to all (origin=local/crmd/64)
Oct 08 20:07:52 pplxnsms02 pacemaker-based [2393] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/65)
Oct 08 20:07:52 pplxnsms02 pacemaker-based [2393] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/66)
Oct 08 20:07:52 pplxnsms02 pacemaker-based [2393] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/63, version=0.524.37)
Oct 08 20:07:52 pplxnsms02 pacemaker-controld [2398] (cib_fencing_updated) info: Fencing update 63 for pplxnsms01: complete
Oct 08 20:07:52 pplxnsms02 pacemaker-based [2393] (cib_process_request) info: Completed cib_delete operation for section //node_state[@uname='pplxnsms01']/*: OK (rc=0, origin=pplxnsms02/crmd/64, version=0.524.37)
Oct 08 20:07:52 pplxnsms02 pacemaker-based [2393] (cib_perform_op) info: Diff: --- 0.524.37 2
Oct 08 20:07:52 pplxnsms02 pacemaker-based [2393] (cib_perform_op) info: Diff: +++ 0.524.38 (null)
Oct 08 20:07:52 pplxnsms02 pacemaker-based [2393] (cib_perform_op) info: + /cib: @num_updates=38
Oct 08 20:07:52 pplxnsms02 pacemaker-based [2393] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='itm_vip']/lrm_rsc_op[@id='itm_vip_last_0']: @operation_key=itm_vip_start_0, @operation=start, @transition-key=17:0:0:644ce76d-aa78-4872-a7a0-7a85d6e6a5d3, @transition-magic=-1:193;17:0:0:644ce76d-aa78-4872-a7a0-7a85d6e6a5d3, @call-id=-1, @rc-code=193, @op-status=-1, @last-rc-change=1728389272, @exec-time=0
Oct 08 20:07:52 pplxnsms02 pacemaker-based [2393] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/65, version=0.524.38)
Oct 08 20:07:52 pplxnsms02 pacemaker-based [2393] (cib_perform_op) info: Diff: --- 0.524.38 2
Oct 08 20:07:52 pplxnsms02 pacemaker-based [2393] (cib_perform_op) info: Diff: +++ 0.524.39 (null)
Oct 08 20:07:52 pplxnsms02 pacemaker-based [2393] (cib_perform_op) info: + /cib: @num_updates=39
Oct 08 20:07:52 pplxnsms02 pacemaker-based [2393] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='siem_vip']/lrm_rsc_op[@id='siem_vip_last_0']: @operation_key=siem_vip_start_0, @operation=start, @transition-key=39:0:0:644ce76d-aa78-4872-a7a0-7a85d6e6a5d3, @transition-magic=-1:193;39:0:0:644ce76d-aa78-4872-a7a0-7a85d6e6a5d3, @call-id=-1, @rc-code=193, @op-status=-1, @last-rc-change=1728389272, @exec-time=0, @queue-time=0
Oct 08 20:07:52 pplxnsms02 pacemaker-based [2393] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/66, version=0.524.39)
Oct 08 20:07:53 IPaddr2(itm_vip)[6420]: INFO: Adding inet address 192.168.133.136/24 with broadcast address 192.168.133.255 to device ens224
Oct 08 20:07:53 IPaddr2(siem_vip)[6421]: INFO: Adding inet address 192.168.133.40/24 with broadcast address 192.168.133.255 to device ens224
Oct 08 20:07:53 IPaddr2(itm_vip)[6420]: INFO: Bringing device ens224 up
Oct 08 20:07:53 IPaddr2(itm_vip)[6420]: INFO: /usr/libexec/heartbeat/send_arp -i 200 -r 5 -p /run/resource-agents/send_arp-192.168.133.136 ens224 192.168.133.136 auto not_used not_used
Oct 08 20:07:53 IPaddr2(siem_vip)[6421]: INFO: Bringing device ens224 up
Oct 08 20:07:53 pplxnsms02 pacemaker-execd [2395] (log_finished) info: itm_vip start (call 66, PID 6420) exited with status 0 (execution time 87ms)
Oct 08 20:07:53 IPaddr2(siem_vip)[6421]: INFO: /usr/libexec/heartbeat/send_arp -i 200 -r 5 -p /run/resource-agents/send_arp-192.168.133.40 ens224 192.168.133.40 auto not_used not_used
Oct 08 20:07:53 pplxnsms02 pacemaker-controld [2398] (wait_for_sync_result) info: IPaddr2_meta-data_0[6559] exited with status 0
Oct 08 20:07:53 pplxnsms02 pacemaker-controld [2398] (log_executor_event) notice: Result of start operation for itm_vip on pplxnsms02: ok | CIB update 67, graph action confirmed; call=66 key=itm_vip_start_0 rc=0
Oct 08 20:07:53 pplxnsms02 pacemaker-execd [2395] (log_finished) info: siem_vip start (call 67, PID 6421) exited with status 0 (execution time 109ms)
Oct 08 20:07:53 pplxnsms02 pacemaker-based [2393] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/67)
Oct 08 20:07:53 pplxnsms02 pacemaker-based [2393] (cib_perform_op) info: Diff: --- 0.524.39 2
Oct 08 20:07:53 pplxnsms02 pacemaker-based [2393] (cib_perform_op) info: Diff: +++ 0.524.40 (null)
Oct 08 20:07:53 pplxnsms02 pacemaker-based [2393] (cib_perform_op) info: + /cib: @num_updates=40
Oct 08 20:07:53 pplxnsms02 pacemaker-based [2393] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='itm_vip']/lrm_rsc_op[@id='itm_vip_last_0']: @transition-magic=0:0;17:0:0:644ce76d-aa78-4872-a7a0-7a85d6e6a5d3, @call-id=66, @rc-code=0, @op-status=0, @exec-time=87
Oct 08 20:07:53 pplxnsms02 pacemaker-based [2393] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/67, version=0.524.40)
Oct 08 20:07:53 pplxnsms02 pacemaker-controld [2398] (wait_for_sync_result) info: IPaddr2_meta-data_0[6575] exited with status 0
Oct 08 20:07:53 pplxnsms02 pacemaker-controld [2398] (log_executor_event) notice: Result of start operation for siem_vip on pplxnsms02: ok | CIB update 68, graph action confirmed; call=67 key=siem_vip_start_0 rc=0
Oct 08 20:07:53 pplxnsms02 pacemaker-controld [2398] (process_graph_event) info: Transition 0 action 17 (itm_vip_start_0 on pplxnsms02) confirmed: ok | rc=0 call-id=66
Oct 08 20:07:53 pplxnsms02 pacemaker-controld [2398] (te_rsc_command) notice: Initiating monitor operation itm_vip_monitor_10000 locally on pplxnsms02 | action 18
Oct 08 20:07:53 pplxnsms02 pacemaker-based [2393] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/68)
Oct 08 20:07:53 pplxnsms02 pacemaker-controld [2398] (do_lrm_rsc_op) notice: Requesting local execution of monitor operation for itm_vip on pplxnsms02 | transition_key=18:0:0:644ce76d-aa78-4872-a7a0-7a85d6e6a5d3 op_key=itm_vip_monitor_10000
Oct 08 20:07:53 pplxnsms02 pacemaker-based [2393] (cib_perform_op) info: Diff: --- 0.524.40 2
Oct 08 20:07:53 pplxnsms02 pacemaker-based [2393] (cib_perform_op) info: Diff: +++ 0.524.41 (null)
Oct 08 20:07:53 pplxnsms02 pacemaker-based [2393] (cib_perform_op) info: + /cib: @num_updates=41
Oct 08 20:07:53 pplxnsms02 pacemaker-based [2393] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='siem_vip']/lrm_rsc_op[@id='siem_vip_last_0']: @transition-magic=0:0;39:0:0:644ce76d-aa78-4872-a7a0-7a85d6e6a5d3, @call-id=67, @rc-code=0, @op-status=0, @exec-time=109
Oct 08 20:07:53 pplxnsms02 pacemaker-based [2393] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/68, version=0.524.41)
Oct 08 20:07:53 pplxnsms02 pacemaker-based [2393] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/69)
Oct 08 20:07:53 pplxnsms02 pacemaker-controld [2398] (process_graph_event) info: Transition 0 action 39 (siem_vip_start_0 on pplxnsms02) confirmed: ok | rc=0 call-id=67
Oct 08 20:07:53 pplxnsms02 pacemaker-controld [2398] (te_rsc_command) notice: Initiating start operation itm_lvm_start_0 locally on pplxnsms02 | action 19
Oct 08 20:07:53 pplxnsms02 pacemaker-controld [2398] (do_lrm_rsc_op) notice: Requesting local execution of start operation for itm_lvm on pplxnsms02 | transition_key=19:0:0:644ce76d-aa78-4872-a7a0-7a85d6e6a5d3 op_key=itm_lvm_start_0
Oct 08 20:07:53 pplxnsms02 pacemaker-based [2393] (cib_perform_op) info: Diff: --- 0.524.41 2
Oct 08 20:07:53 pplxnsms02 pacemaker-based [2393] (cib_perform_op) info: Diff: +++ 0.524.42 (null)
Oct 08 20:07:53 pplxnsms02 pacemaker-based [2393] (cib_perform_op) info: + /cib: @num_updates=42
Oct 08 20:07:53 pplxnsms02 pacemaker-based [2393] (cib_perform_op) info: ++ /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='itm_vip']: old=0x0000000 new=0x4000000
Oct 08 20:08:36 pplxnsms02 pacemaker-controld [2416] (te_trigger_stonith_history_sync) info: Fence history will be synchronized cluster-wide within 5 seconds
Oct 08 20:08:36 pplxnsms02 pacemaker-controld [2416] (pcmk__corosync_connect) info: Connection to corosync established
Oct 08 20:08:36 pplxnsms02 pacemaker-attrd [2414] (crm_get_peer) info: Created entry f5871279-ca05-40c8-a07f-c6aaec5f18ab/0x5609530b4bd0 for node pplxnsms02/2 (1 total)
Oct 08 20:08:36 pplxnsms02 pacemaker-attrd [2414] (crm_get_peer) info: Node 2 is now known as pplxnsms02
Oct 08 20:08:36 pplxnsms02 pacemaker-controld [2416] (pcmk__corosync_quorum_connect) warning: No quorum
Oct 08 20:08:36 pplxnsms02 pacemaker-attrd [2414] (crm_get_peer) info: Node 2 has uuid 2
Oct 08 20:08:36 pplxnsms02 pacemaker-attrd [2414] (crm_update_peer_proc) info: cluster_connect_cpg: Node pplxnsms02[2] - corosync-cpg is now online
Oct 08 20:08:36 pplxnsms02 pacemaker-attrd [2414] (update_peer_state_iter) notice: Node pplxnsms02 state is now member | nodeid=2 previous=unknown source=crm_update_peer_proc
Oct 08 20:08:36 pplxnsms02 pacemaker-attrd [2414] (pcmk__corosync_connect) info: Connection to corosync established
Oct 08 20:08:36 pplxnsms02 pacemaker-fenced [2412] (init_cib_cache_cb) info: Updating device list from CIB
Oct 08 20:08:36 pplxnsms02 pacemaker-fenced [2412] (cib_devices_update) info: Updating devices to version 0.524.0
Oct 08 20:08:36 pplxnsms02 pacemaker-fenced [2412] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 08 20:08:36 pplxnsms02 pacemaker-fenced [2412] (unpack_config) notice: On loss of quorum: Ignore
Oct 08 20:08:36 pplxnsms02 pacemaker-controld [2416] (crm_get_peer) info: Created entry 27a7135b-e1f1-4e2d-9275-874c5a5e91d5/0x5621f070a7e0 for node pplxnsms01/1 (2 total)
Oct 08 20:08:36 pplxnsms02 pacemaker-controld [2416] (crm_get_peer) info: Node 1 is now known as pplxnsms01
Oct 08 20:08:36 pplxnsms02 pacemaker-controld [2416] (peer_update_callback) info: Cluster node pplxnsms01 is now in unknown state
Oct 08 20:08:36 pplxnsms02 pacemaker-controld [2416] (crm_get_peer) info: Node 1 has uuid 1
Oct 08 20:08:36 pplxnsms02 pacemaker-attrd [2414] (main) info: Cluster connection active
Oct 08 20:08:36 pplxnsms02 pacemaker-attrd [2414] (attrd_erase_attrs) info: Clearing transient attributes from CIB | xpath=//node_state[@uname='pplxnsms02']/transient_attributes
Oct 08 20:08:36 pplxnsms02 pacemaker-attrd [2414] (qb_ipcs_us_publish) info: server name: attrd
Oct 08 20:08:36 pplxnsms02 pacemaker-attrd [2414] (main) notice: Pacemaker node attribute manager successfully started and accepting connections
Oct 08 20:08:36 pplxnsms02 pacemaker-attrd [2414] (pcmk_cpg_membership) info: Group attrd event 0: node 2 pid 2414 joined via cpg_join
Oct 08 20:08:36 pplxnsms02 pacemaker-attrd [2414] (pcmk_cpg_membership) info: Group attrd event 0: pplxnsms02 (node 2 pid 2414) is member
Oct 08 20:08:36 pplxnsms02 pacemaker-attrd [2414] (attrd_peer_update) notice: Setting #attrd-protocol[pplxnsms02]: (unset) -> 3 | from pplxnsms02
Oct 08 20:08:36 pplxnsms02 pacemaker-attrd [2414] (attrd_start_election_if_needed) info: Starting an election to determine the writer
Oct 08 20:08:36 pplxnsms02 pacemaker-attrd [2414] (election_check) info: election-attrd won by local node
Oct 08 20:08:36 pplxnsms02 pacemaker-attrd [2414] (attrd_declare_winner) notice: Recorded local node as attribute writer (was unset)
Oct 08 20:08:36 pplxnsms02 pacemaker-attrd [2414] (write_attribute) info: Processed 1 private change for #attrd-protocol, id=n/a, set=n/a
Oct 08 20:08:36 pplxnsms02 pacemaker-based [2411] (cib_process_request) info: Forwarding cib_delete operation for section //node_state[@uname='pplxnsms02']/transient_attributes to all (origin=local/attrd/2)
Oct 08 20:08:36 pplxnsms02 pacemaker-controld [2416] (do_ha_control) info: Connected to the cluster
Oct 08 20:08:36 pplxnsms02 pacemaker-controld [2416] (lrmd_ipc_connect) info: Connecting to executor
Oct 08 20:08:36 pplxnsms02 pacemaker-controld [2416] (try_local_executor_connect) info: Connection to the local executor established
Oct 08 20:08:36 pplxnsms02 pacemaker-controld [2416] (do_started) info: Delaying start, no membership data (0000000000100000)
Oct 08 20:08:36 pplxnsms02 pacemaker-controld [2416] (do_started) info: Delaying start, no membership data (0000000000100000)
Oct 08 20:08:36 pplxnsms02 pacemaker-controld [2416] (quorum_notification_cb) info: Quorum still lost | membership=1340 members=1
Oct 08 20:08:36 pplxnsms02 pacemaker-controld [2416] (update_peer_state_iter) notice: Node pplxnsms02 state is now member | nodeid=2 previous=unknown source=quorum_notification_cb
Oct 08 20:08:36 pplxnsms02 pacemaker-controld [2416] (peer_update_callback) info: Cluster node pplxnsms02 is now member (was in unknown state)
Oct 08 20:08:36 pplxnsms02 pacemaker-controld [2416] (pcmk__reap_unseen_nodes) info: State of node pplxnsms01[1] is still unknown
Oct 08 20:08:36 pplxnsms02 pacemaker-based [2411] (cib_process_request) info: Completed cib_delete operation for section //node_state[@uname='pplxnsms02']/transient_attributes: OK (rc=0, origin=pplxnsms02/attrd/2, version=0.524.0)
Oct 08 20:08:36 pplxnsms02 pacemaker-based [2411] (cib_process_request) info: Forwarding cib_modify operation for section nodes to all (origin=local/crmd/4)
Oct 08 20:08:36 pplxnsms02 pacemaker-controld [2416] (do_started) info: Delaying start, Config not read (0000000000000040)
Oct 08 20:08:36 pplxnsms02 pacemaker-controld [2416] (pcmk_cpg_membership) info: Group crmd event 0: node 2 pid 2416 joined via cpg_join
Oct 08 20:08:36 pplxnsms02 pacemaker-controld [2416] (pcmk_cpg_membership) info: Group crmd event 0: pplxnsms02 (node 2 pid 2416) is member
Oct 08 20:08:36 pplxnsms02 pacemaker-controld [2416] (do_started) info: Delaying start, Config not read (0000000000000040)
Oct 08 20:08:36 pplxnsms02 pacemaker-controld [2416] (do_started) info: Delaying start, Config not read (0000000000000040)
Oct 08 20:08:36 pplxnsms02 pacemaker-based [2411] (cib_process_request) info: Completed cib_modify operation for section nodes: OK (rc=0, origin=pplxnsms02/crmd/4, version=0.524.0)
Oct 08 20:08:36 pplxnsms02 pacemaker-controld [2416] (qb_ipcs_us_publish) info: server name: crmd
Oct 08 20:08:36 pplxnsms02 pacemaker-controld [2416] (do_started) notice: Pacemaker controller successfully started and accepting connections
Oct 08 20:08:36 pplxnsms02 pacemaker-controld [2416] (do_log) info: Input I_PENDING received in state S_STARTING from do_started
Oct 08 20:08:36 pplxnsms02 pacemaker-controld [2416] (do_state_transition) notice: State transition S_STARTING -> S_PENDING | input=I_PENDING cause=C_FSA_INTERNAL origin=do_started
Oct 08 20:08:37 pplxnsms02 pacemaker-fenced [2412] (wait_for_sync_result) info: fence_sbd_metadata_1[2488] exited with status 0
Oct 08 20:08:37 pplxnsms02 pacemaker-fenced [2412] (stonith_device_register) notice: Added 'fence-sbd' to device list (1 active device)
Oct 08 20:08:37 pplxnsms02 pacemaker-controld [2416] (te_trigger_stonith_history_sync) info: Fence history will be synchronized cluster-wide within 30 seconds
Oct 08 20:08:37 pplxnsms02 pacemaker-controld [2416] (te_connect_stonith) notice: Fencer successfully connected
Oct 08 20:08:57 pplxnsms02 pacemaker-controld [2416] (crm_timer_popped) info: Election Trigger just popped | input=I_DC_TIMEOUT time=20000ms
Oct 08 20:08:57 pplxnsms02 pacemaker-controld [2416] (do_log) warning: Input I_DC_TIMEOUT received in state S_PENDING from crm_timer_popped
Oct 08 20:08:57 pplxnsms02 pacemaker-controld [2416] (do_state_transition) info: State transition S_PENDING -> S_ELECTION | input=I_DC_TIMEOUT cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 08 20:08:57 pplxnsms02 pacemaker-controld [2416] (election_check) info: election-DC won by local node
Oct 08 20:08:57 pplxnsms02 pacemaker-controld [2416] (do_log) info: Input I_ELECTION_DC received in state S_ELECTION from election_win_cb
Oct 08 20:08:57 pplxnsms02 pacemaker-controld [2416] (do_state_transition) notice: State transition S_ELECTION -> S_INTEGRATION | input=I_ELECTION_DC cause=C_FSA_INTERNAL origin=election_win_cb
Oct 08 20:08:57 pplxnsms02 pacemaker-controld [2416] (do_te_control) info: Registering TE UUID: 9732fbc5-6a0d-41b0-be4c-f2fb77dd49d7
Oct 08 20:08:57 pplxnsms02 pacemaker-controld [2416] (pcmk__pid_active) info: Could not read from /proc/1673/exe: Permission denied | errno=13
Oct 08 20:08:57 pplxnsms02 pacemaker-controld [2416] (do_dc_takeover) info: Taking over DC status for this partition
Oct 08 20:08:57 pplxnsms02 pacemaker-based [2411] (cib_process_readwrite) info: We are now in R/W mode
Oct 08 20:08:57 pplxnsms02 pacemaker-based [2411] (cib_process_request) info: Completed cib_master operation for section 'all': OK (rc=0, origin=local/crmd/7, version=0.524.0)
Oct 08 20:08:57 pplxnsms02 pacemaker-based [2411] (cib_process_request) info: Forwarding cib_modify operation for section cib to all (origin=local/crmd/8)
Oct 08 20:08:57 pplxnsms02 pacemaker-based [2411] (cib_process_request) info: Completed cib_modify operation for section cib: OK (rc=0, origin=pplxnsms02/crmd/8, version=0.524.0)
Oct 08 20:08:57 pplxnsms02 pacemaker-based [2411] (cib_process_request) info: Forwarding cib_modify operation for section crm_config to all (origin=local/crmd/10)
Oct 08 20:08:57 pplxnsms02 pacemaker-based [2411] (cib_process_request) info: Completed cib_modify operation for section crm_config: OK (rc=0, origin=pplxnsms02/crmd/10, version=0.524.0)
Oct 08 20:08:57 pplxnsms02 pacemaker-based [2411] (cib_process_request) info: Forwarding cib_modify operation for section crm_config to all (origin=local/crmd/12)
Oct 08 20:08:57 pplxnsms02 pacemaker-controld [2416] (join_make_offer) info: Making join-1 offers based on membership event 1340
Oct 08 20:08:57 pplxnsms02 pacemaker-controld [2416] (join_make_offer) info: Sending join-1 offer to pplxnsms02
Oct 08 20:08:57 pplxnsms02 pacemaker-controld [2416] (join_make_offer) info: Not making join-1 offer to inactive node pplxnsms01
Oct 08 20:08:57 pplxnsms02 pacemaker-controld [2416] (do_dc_join_offer_all) info: Waiting on join-1 requests from 1 outstanding node
Oct 08 20:08:57 pplxnsms02 pacemaker-based [2411] (cib_process_request) info: Completed cib_modify operation for section crm_config: OK (rc=0, origin=pplxnsms02/crmd/12, version=0.524.0)
Oct 08 20:08:57 pplxnsms02 pacemaker-based [2411] (cib_process_request) info: Forwarding cib_modify operation for section crm_config to all (origin=local/crmd/14)
Oct 08 20:08:57 pplxnsms02 pacemaker-controld [2416] (update_dc) info: Set DC to pplxnsms02 (3.13.0)
Oct 08 20:08:57 pplxnsms02 pacemaker-controld [2416] (pcmk__update_peer_expected) info: update_dc: Node pplxnsms02[2] - expected state is now member (was (null))
Oct 08 20:08:57 pplxnsms02 pacemaker-based [2411] (cib_process_request) info: Completed cib_modify operation for section crm_config: OK (rc=0, origin=pplxnsms02/crmd/14, version=0.524.0)
Oct 08 20:08:57 pplxnsms02 pacemaker-controld [2416] (stonith__watchdog_fencing_enabled_for_node_api) notice: Cluster does not have watchdog fencing device
Oct 08 20:08:57 pplxnsms02 pacemaker-controld [2416] (do_state_transition) info: State transition S_INTEGRATION -> S_FINALIZE_JOIN | input=I_INTEGRATED cause=C_FSA_INTERNAL origin=check_join_state
Oct 08 20:08:57 pplxnsms02 pacemaker-based [2411] (cib_process_replace) info: Digest matched on replace from pplxnsms02: 3ee2a3044e50b4f9747d375984348bab
Oct 08 20:08:57 pplxnsms02 pacemaker-based [2411] (cib_process_replace) info: Replaced 0.524.0 with 0.524.0 from pplxnsms02
Oct 08 20:08:57 pplxnsms02 pacemaker-based [2411] (cib_process_request) info: Completed cib_replace operation for section 'all': OK (rc=0, origin=pplxnsms02/crmd/17, version=0.524.0)
Oct 08 20:08:57 pplxnsms02 pacemaker-based [2411] (cib_process_request) info: Forwarding cib_modify operation for section nodes to all (origin=local/crmd/18)
Oct 08 20:08:57 pplxnsms02 pacemaker-based [2411] (cib_process_request) info: Completed cib_modify operation for section nodes: OK (rc=0, origin=pplxnsms02/crmd/18, version=0.524.0)
Oct 08 20:08:57 pplxnsms02 pacemaker-controld [2416] (controld_delete_node_state) info: Deleting resource history for node pplxnsms02 (via CIB call 19) | xpath=//node_state[@uname='pplxnsms02']/lrm
Oct 08 20:08:57 pplxnsms02 pacemaker-based [2411] (cib_process_request) info: Forwarding cib_delete operation for section //node_state[@uname='pplxnsms02']/lrm to all (origin=local/crmd/19)
Oct 08 20:08:57 pplxnsms02 pacemaker-based [2411] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/20)
Oct 08 20:08:57 pplxnsms02 pacemaker-based [2411] (cib_process_request) info: Completed cib_delete operation for section //node_state[@uname='pplxnsms02']/lrm: OK (rc=0, origin=pplxnsms02/crmd/19, version=0.524.0)
Oct 08 20:08:57 pplxnsms02 pacemaker-based [2411] (cib_perform_op) info: Diff: --- 0.524.0 2
Oct 08 20:08:57 pplxnsms02 pacemaker-based [2411] (cib_perform_op) info: Diff: +++ 0.524.1 (null)
Oct 08 20:08:57 pplxnsms02 pacemaker-based [2411] (cib_perform_op) info: + /cib: @num_updates=1
Oct 08 20:08:57 pplxnsms02 pacemaker-based [2411] (cib_perform_op) info: ++ /cib/status:
Oct 08 20:08:57 pplxnsms02 pacemaker-based [2411] (cib_perform_op) info: ++
Oct 08 20:08:57 pplxnsms02 pacemaker-based [2411] (cib_perform_op) info: ++
Oct 08 20:08:57 pplxnsms02 pacemaker-based [2411] (cib_perform_op) info: ++
Oct 08 20:08:57 pplxnsms02 pacemaker-based [2411] (cib_perform_op) info: ++
Oct 08 20:08:57 pplxnsms02 pacemaker-based [2411] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/20, version=0.524.1)
Oct 08 20:08:57 pplxnsms02 pacemaker-controld [2416] (do_state_transition) info: State transition S_FINALIZE_JOIN -> S_POLICY_ENGINE | input=I_FINALIZED cause=C_FSA_INTERNAL origin=check_join_state
Oct 08 20:08:57 pplxnsms02 pacemaker-controld [2416] (create_node_state_update) info: Node update for pplxnsms01 cancelled: no state, not seen yet
Oct 08 20:08:57 pplxnsms02 pacemaker-controld [2416] (abort_transition_graph) info: Transition -1 aborted: Quorum lost | source=crm_update_quorum:435 complete=true
Oct 08 20:08:57 pplxnsms02 pacemaker-controld [2416] (abort_transition_graph) info: Transition -1 aborted: Peer Cancelled | source=do_te_invoke:129 complete=true
Oct 08 20:08:57 pplxnsms02 pacemaker-based [2411] (cib_process_request) info: Forwarding cib_modify operation for section nodes to all (origin=local/crmd/23)
Oct 08 20:08:57 pplxnsms02 pacemaker-based [2411] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/24)
Oct 08 20:08:57 pplxnsms02 pacemaker-based [2411] (cib_process_request) info: Forwarding cib_modify operation for section cib to all (origin=local/crmd/25)
Oct 08 20:08:57 pplxnsms02 pacemaker-based [2411] (cib_process_request) info: Completed cib_modify operation for section nodes: OK (rc=0, origin=pplxnsms02/crmd/23, version=0.524.1)
Oct 08 20:08:57 pplxnsms02 pacemaker-based [2411] (cib_perform_op) info: Diff: --- 0.524.1 2
Oct 08 20:08:57 pplxnsms02 pacemaker-based [2411] (cib_perform_op) info: Diff: +++ 0.524.2 (null)
Oct 08 20:08:57 pplxnsms02 pacemaker-based [2411] (cib_perform_op) info: + /cib: @num_updates=2
Oct 08 20:08:57 pplxnsms02 pacemaker-based [2411] (cib_perform_op) info: + /cib/status/node_state[@id='2']: @crm-debug-origin=do_state_transition, @join=member, @expected=member
Oct 08 20:08:57 pplxnsms02 pacemaker-based [2411] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/24, version=0.524.2)
Oct 08 20:08:57 pplxnsms02 pacemaker-based [2411] (cib_perform_op) info: Diff: --- 0.524.2 2
Oct 08 20:08:57 pplxnsms02 pacemaker-based [2411] (cib_perform_op) info: Diff: +++ 0.524.3 (null)
Oct 08 20:08:57 pplxnsms02 pacemaker-based [2411] (cib_perform_op) info: + /cib: @num_updates=3, @have-quorum=0, @dc-uuid=2
Oct 08 20:08:57 pplxnsms02 pacemaker-based [2411] (cib_process_request) info: Completed cib_modify operation for section cib: OK (rc=0, origin=pplxnsms02/crmd/25, version=0.524.3)
Oct 08 20:08:57 pplxnsms02 pacemaker-based [2411] (cib_file_backup) info: Archived previous version as /var/lib/pacemaker/cib/cib-48.raw
Oct 08 20:08:57 pplxnsms02 pacemaker-based [2411] (cib_file_write_with_digest) info: Wrote version 0.524.0 of the CIB to disk (digest: bd619fe63dbb58848af2e44b9c928031)
Oct 08 20:08:57 pplxnsms02 pacemaker-based [2411] (cib_file_write_with_digest) info: Reading cluster configuration file /var/lib/pacemaker/cib/cib.rfUJIH (digest: /var/lib/pacemaker/cib/cib.9mOHxc)
Oct 08 20:08:58 pplxnsms02 pacemaker-schedulerd[2415] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 08 20:08:58 pplxnsms02 pacemaker-schedulerd[2415] (unpack_config) notice: On loss of quorum: Ignore
Oct 08 20:08:58 pplxnsms02 pacemaker-schedulerd[2415] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 08 20:08:58 pplxnsms02 pacemaker-schedulerd[2415] (determine_online_status) info: Node pplxnsms02 is online
Oct 08 20:08:58 pplxnsms02 pacemaker-schedulerd[2415] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 08 20:08:58 pplxnsms02 pacemaker-schedulerd[2415] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 08 20:08:58 pplxnsms02 pacemaker-schedulerd[2415] (RecurringOp) info: Start recurring monitor (10s) for itm_vip on pplxnsms02
Oct 08 20:08:58 pplxnsms02 pacemaker-schedulerd[2415] (RecurringOp) info: Start recurring monitor (30s) for itm_lvm on pplxnsms02
Oct 08 20:08:58 pplxnsms02 pacemaker-schedulerd[2415] (RecurringOp) info: Start recurring monitor (20s) for itm_fs on pplxnsms02
Oct 08 20:08:58 pplxnsms02 pacemaker-schedulerd[2415] (RecurringOp) info: Start recurring monitor (20s) for itm_fs2 on pplxnsms02
Oct 08 20:08:58 pplxnsms02 pacemaker-schedulerd[2415] (RecurringOp) info: Start recurring monitor (20s) for itm_fs3 on pplxnsms02
Oct 08 20:08:58 pplxnsms02 pacemaker-schedulerd[2415] (RecurringOp) info: Start recurring monitor (20s) for nco_db2 on pplxnsms02
Oct 08 20:08:58 pplxnsms02 pacemaker-schedulerd[2415] (RecurringOp) info: Start recurring monitor (60s) for nco_omni on pplxnsms02
Oct 08 20:08:58 pplxnsms02 pacemaker-schedulerd[2415] (RecurringOp) info: Start recurring monitor (300s) for nco_itnm on pplxnsms02
Oct 08 20:08:58 pplxnsms02 pacemaker-schedulerd[2415] (RecurringOp) info: Start recurring monitor (10s) for nco_cognos on pplxnsms02
Oct 08 20:08:58 pplxnsms02 pacemaker-schedulerd[2415] (RecurringOp) info: Start recurring monitor (10s) for siem_vip on pplxnsms02
Oct 08 20:08:58 pplxnsms02 pacemaker-schedulerd[2415] (RecurringOp) info: Start recurring monitor (30s) for siem_lvm on pplxnsms02
Oct 08 20:08:58 pplxnsms02 pacemaker-schedulerd[2415] (RecurringOp) info: Start recurring monitor (20s) for siem_fs on pplxnsms02
Oct 08 20:08:58 pplxnsms02 pacemaker-schedulerd[2415] (RecurringOp) info: Start recurring monitor (10s) for siem_rsyslog on pplxnsms02
Oct 08 20:08:58 pplxnsms02 pacemaker-schedulerd[2415] (RecurringOp) info: Start recurring monitor (60s) for fence-sbd on pplxnsms02
Oct 08 20:08:58 pplxnsms02 pacemaker-schedulerd[2415] (stage6) warning: Scheduling Node pplxnsms01 for STONITH
Oct 08 20:08:58 pplxnsms02 pacemaker-schedulerd[2415] (log_list_item) notice: Actions: Fence (reboot) pplxnsms01 'node is unclean'
Oct 08 20:08:58 pplxnsms02 pacemaker-schedulerd[2415] (log_list_item) notice: Actions: Start itm_vip ( pplxnsms02 )
Oct 08 20:08:58 pplxnsms02 pacemaker-schedulerd[2415] (log_list_item) notice: Actions: Start itm_lvm ( pplxnsms02 )
Oct 08 20:08:58 pplxnsms02 pacemaker-schedulerd[2415] (log_list_item) notice: Actions: Start itm_fs ( pplxnsms02 )
Oct 08 20:08:58 pplxnsms02 pacemaker-schedulerd[2415] (log_list_item) notice: Actions: Start itm_fs2 ( pplxnsms02 )
Oct 08 20:08:58 pplxnsms02 pacemaker-schedulerd[2415] (log_list_item) notice: Actions: Start itm_fs3 ( pplxnsms02 )
Oct 08 20:08:58 pplxnsms02 pacemaker-schedulerd[2415] (log_list_item) notice: Actions: Start nco_db2 ( pplxnsms02 )
Oct 08 20:08:58 pplxnsms02 pacemaker-schedulerd[2415] (log_list_item) notice: Actions: Start nco_omni ( pplxnsms02 )
Oct 08 20:08:58 pplxnsms02 pacemaker-schedulerd[2415] (log_list_item) notice: Actions: Start nco_itnm ( pplxnsms02 )
Oct 08 20:08:58 pplxnsms02 pacemaker-schedulerd[2415] (log_list_item) notice: Actions: Start nco_cognos ( pplxnsms02 )
Oct 08 20:08:58 pplxnsms02 pacemaker-schedulerd[2415] (log_list_item) notice: Actions: Start siem_vip ( pplxnsms02 )
Oct 08 20:08:58 pplxnsms02 pacemaker-schedulerd[2415] (log_list_item) notice: Actions: Start siem_lvm ( pplxnsms02 )
Oct 08 20:08:58 pplxnsms02 pacemaker-schedulerd[2415] (log_list_item) notice: Actions: Start siem_fs ( pplxnsms02 )
Oct 08 20:08:58 pplxnsms02 pacemaker-schedulerd[2415] (log_list_item) notice: Actions: Start siem_rsyslog ( pplxnsms02 )
Oct 08 20:08:58 pplxnsms02 pacemaker-schedulerd[2415] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 08 20:08:58 pplxnsms02 pacemaker-schedulerd[2415] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 08 20:08:58 pplxnsms02 pacemaker-schedulerd[2415] (log_list_item) notice: Actions: Start fence-sbd ( pplxnsms02 )
Oct 08 20:08:58 pplxnsms02 pacemaker-schedulerd[2415] (pcmk__log_transition_summary) warning: Calculated transition 0 (with warnings), saving inputs in /var/lib/pacemaker/pengine/pe-warn-100.bz2
Oct 08 20:08:58 pplxnsms02 pacemaker-controld [2416] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 08 20:08:58 pplxnsms02 pacemaker-controld [2416] (do_te_invoke) info: Processing graph 0 (ref=pe_calc-dc-1728389338-8) derived from /var/lib/pacemaker/pengine/pe-warn-100.bz2
Oct 08 20:08:58 pplxnsms02 pacemaker-controld [2416] (te_rsc_command) notice: Initiating monitor operation itm_vip_monitor_0 locally on pplxnsms02 | action 1
Oct 08 20:08:58 pplxnsms02 pacemaker-execd [2413] (process_lrmd_get_rsc_info) info: Agent information for 'itm_vip' not in cache
Oct 08 20:08:58 pplxnsms02 pacemaker-execd [2413] (process_lrmd_rsc_register) info: Cached agent information for 'itm_vip'
Oct 08 20:08:58 pplxnsms02 pacemaker-controld [2416] (do_lrm_rsc_op) notice: Requesting local execution of probe operation for itm_vip on pplxnsms02 | transition_key=1:0:7:9732fbc5-6a0d-41b0-be4c-f2fb77dd49d7 op_key=itm_vip_monitor_0
Oct 08 20:08:59 pplxnsms02 pacemaker-controld [2416] (wait_for_sync_result) info: IPaddr2_meta-data_0[4928] exited with status 0
Oct 08 20:08:59 pplxnsms02 pacemaker-based [2411] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/29)
Oct 08 20:08:59 pplxnsms02 pacemaker-based [2411] (cib_perform_op) info: Diff: --- 0.524.3 2
Oct 08 20:08:59 pplxnsms02 pacemaker-controld [2416] (te_rsc_command) notice: Initiating monitor operation itm_lvm_monitor_0 locally on pplxnsms02 | action 2
Oct 08 20:08:59 pplxnsms02 pacemaker-based [2411] (cib_perform_op) info: Diff: +++ 0.524.4 (null)
Oct 08 20:08:59 pplxnsms02 pacemaker-based [2411] (cib_perform_op) info: + /cib: @num_updates=4
Oct 08 20:08:59 pplxnsms02 pacemaker-based [2411] (cib_perform_op) info: + /cib/status/node_state[@id='2']: @crm-debug-origin=do_update_resource
Oct 08 20:08:59 pplxnsms02 pacemaker-based [2411] (cib_perform_op) info: ++ /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources:
Oct 08 20:08:59 pplxnsms02 pacemaker-based [2411] (cib_perform_op) info: ++
Oct 08 20:08:59 pplxnsms02 pacemaker-based [2411] (cib_perform_op) info: ++
Oct 08 20:08:59 pplxnsms02 pacemaker-based [2411] (cib_perform_op) info: ++
Oct 08 20:08:59 pplxnsms02 pacemaker-based [2411] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/31, version=0.524.6)
Oct 08 20:08:59 pplxnsms02 pacemaker-controld [2416] (te_rsc_command) notice: Initiating monitor operation itm_fs2_monitor_0 locally on pplxnsms02 | action 4
Oct 08 20:08:59 pplxnsms02 pacemaker-execd [2413] (process_lrmd_get_rsc_info) info: Agent information for 'itm_fs2' not in cache
Oct 08 20:08:59 pplxnsms02 pacemaker-execd [2413] (process_lrmd_rsc_register) info: Cached agent information for 'itm_fs2'
Oct 08 20:08:59 pplxnsms02 pacemaker-controld [2416] (do_lrm_rsc_op) notice: Requesting local execution of probe operation for itm_fs2 on pplxnsms02 | transition_key=4:0:7:9732fbc5-6a0d-41b0-be4c-f2fb77dd49d7 op_key=itm_fs2_monitor_0
Oct 08 20:08:59 pplxnsms02 pacemaker-controld [2416] (te_fence_node) notice: Requesting fencing (reboot) of node pplxnsms01 | action=53 timeout=60000
Oct 08 20:08:59 pplxnsms02 pacemaker-controld [2416] (log_executor_event) notice: Result of probe operation for itm_lvm on pplxnsms02: not running | CIB update 33, graph action confirmed; call=9 key=itm_lvm_monitor_0 rc=7
Oct 08 20:08:59 pplxnsms02 pacemaker-controld [2416] (log_executor_event) notice: Result of probe operation for itm_vip on pplxnsms02: not running | CIB update 34, graph action confirmed; call=5 key=itm_vip_monitor_0 rc=7
Oct 08 20:08:59 pplxnsms02 pacemaker-fenced [2412] (handle_request) notice: Client pacemaker-controld.2416 wants to fence (reboot) pplxnsms01 using any device
Oct 08 20:08:59 pplxnsms02 pacemaker-fenced [2412] (initiate_remote_stonith_op) notice: Requesting peer fencing (reboot) targeting pplxnsms01 | id=d90cf1d8 state=querying base_timeout=60
Oct 08 20:08:59 pplxnsms02 pacemaker-based [2411] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/32)
Oct 08 20:08:59 pplxnsms02 pacemaker-based [2411] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/33)
Oct 08 20:08:59 pplxnsms02 pacemaker-based [2411] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/34)
Oct 08 20:08:59 pplxnsms02 pacemaker-based [2411] (cib_perform_op) info: Diff: --- 0.524.6 2
Oct 08 20:08:59 pplxnsms02 pacemaker-based [2411] (cib_perform_op) info: Diff: +++ 0.524.7 (null)
Oct 08 20:08:59 pplxnsms02 pacemaker-based [2411] (cib_perform_op) info: + /cib: @num_updates=7
Oct 08 20:08:59 pplxnsms02 pacemaker-based [2411] (cib_perform_op) info: ++ /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources:
Oct 08 20:08:59 pplxnsms02 pacemaker-based [2411] (cib_perform_op) info: ++
Oct 08 20:08:59 pplxnsms02 pacemaker-based [2411] (cib_perform_op) info: ++
Oct 08 20:08:59 pplxnsms02 pacemaker-based [2411] (cib_perform_op) info: ++
Oct 08 20:08:59 pplxnsms02 pacemaker-based [2411] (cib_perform_op) info: ++
Oct 08 20:08:59 pplxnsms02 pacemaker-controld [2416] (log_executor_event) notice: Result of probe operation for itm_fs2 on pplxnsms02: not running | CIB update 39, graph action confirmed; call=17 key=itm_fs2_monitor_0 rc=7
Oct 08 20:08:59 pplxnsms02 pacemaker-controld [2416] (log_executor_event) notice: Result of probe operation for itm_fs on pplxnsms02: not running | CIB update 40, graph action confirmed; call=13 key=itm_fs_monitor_0 rc=7
Oct 08 20:08:59 pplxnsms02 pacemaker-based [2411] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/38, version=0.524.13)
Oct 08 20:08:59 pplxnsms02 pacemaker-based [2411] (cib_perform_op) info: Diff: --- 0.524.13 2
Oct 08 20:08:59 pplxnsms02 pacemaker-based [2411] (cib_perform_op) info: Diff: +++ 0.524.14 (null)
Oct 08 20:08:59 pplxnsms02 pacemaker-based [2411] (cib_perform_op) info: + /cib: @num_updates=14
Oct 08 20:08:59 pplxnsms02 pacemaker-based [2411] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='itm_fs2']/lrm_rsc_op[@id='itm_fs2_last_0']: @transition-magic=0:7;4:0:7:9732fbc5-6a0d-41b0-be4c-f2fb77dd49d7, @call-id=17, @rc-code=7, @op-status=0, @exec-time=231
Oct 08 20:08:59 pplxnsms02 pacemaker-based [2411] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/39, version=0.524.14)
Oct 08 20:08:59 pplxnsms02 pacemaker-based [2411] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/40)
Oct 08 20:08:59 pplxnsms02 pacemaker-based [2411] (cib_perform_op) info: Diff: --- 0.524.14 2
Oct 08 20:08:59 pplxnsms02 pacemaker-based [2411] (cib_perform_op) info: Diff: +++ 0.524.15 (null)
Oct 08 20:08:59 pplxnsms02 pacemaker-based [2411] (cib_perform_op) info: + /cib: @num_updates=15
Oct 08 20:08:59 pplxnsms02 pacemaker-based [2411] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='itm_fs']/lrm_rsc_op[@id='itm_fs_last_0']: @transition-magic=0:7;3:0:7:9732fbc5-6a0d-41b0-be4c-f2fb77dd49d7, @call-id=13, @rc-code=7, @op-status=0, @exec-time=235
Oct 08 20:08:59 pplxnsms02 pacemaker-based [2411] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/40, version=0.524.15)
Oct 08 20:08:59 pplxnsms02 pacemaker-controld [2416] (process_graph_event) info: Transition 0 action 4 (itm_fs2_monitor_0 on pplxnsms02) confirmed: not running | rc=7 call-id=17
Oct 08 20:08:59 pplxnsms02 pacemaker-controld [2416] (process_graph_event) info: Transition 0 action 3 (itm_fs_monitor_0 on pplxnsms02) confirmed: not running | rc=7 call-id=13
Oct 08 20:08:59 pplxnsms02 pacemaker-controld [2416] (te_rsc_command) notice: Initiating monitor operation nco_itnm_monitor_0 locally on pplxnsms02 | action 8
Oct 08 20:08:59 pplxnsms02 pacemaker-execd [2413] (process_lrmd_get_rsc_info) info: Agent information for 'nco_itnm' not in cache
Oct 08 20:08:59 pplxnsms02 pacemaker-execd [2413] (process_lrmd_rsc_register) info: Cached agent information for 'nco_itnm'
Oct 08 20:08:59 pplxnsms02 pacemaker-controld [2416] (do_lrm_rsc_op) notice: Requesting local execution of probe operation for nco_itnm on pplxnsms02 | transition_key=8:0:7:9732fbc5-6a0d-41b0-be4c-f2fb77dd49d7 op_key=nco_itnm_monitor_0
Oct 08 20:08:59 pplxnsms02 pacemaker-controld [2416] (wait_for_sync_result) info: itnm_meta-data_0[5360] exited with status 0
Oct 08 20:08:59 pplxnsms02 pacemaker-based [2411] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/41)
Oct 08 20:08:59 pplxnsms02 pacemaker-controld [2416] (te_rsc_command) notice: Initiating monitor operation nco_cognos_monitor_0 locally on pplxnsms02 | action 9
Oct 08 20:08:59 omnibus(nco_omni)[5357]: ERROR: Cannot find the directory /san/tivoli/netcool!
Oct 08 20:08:59 pplxnsms02 pacemaker-based [2411] (cib_perform_op) info: Diff: --- 0.524.15 2
Oct 08 20:08:59 pplxnsms02 pacemaker-based [2411] (cib_perform_op) info: Diff: +++ 0.524.16 (null)
Oct 08 20:08:59 pplxnsms02 pacemaker-based [2411] (cib_perform_op) info: + /cib: @num_updates=16
Oct 08 20:08:59 pplxnsms02 pacemaker-based [2411] (cib_perform_op) info: ++ /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources:
Oct 08 20:08:59 pplxnsms02 pacemaker-based [2411] (cib_perform_op) info: ++
Oct 08 20:08:59 pplxnsms02 pacemaker-based [2411] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/41, version=0.524.16)
Oct 08 20:08:59 pplxnsms02 pacemaker-execd [2413] (process_lrmd_get_rsc_info) info: Agent information for 'nco_cognos' not in cache
Oct 08 20:08:59 pplxnsms02 pacemaker-execd [2413] (process_lrmd_rsc_register) info: Cached agent information for 'nco_cognos'
Oct 08 20:08:59 pplxnsms02 pacemaker-controld [2416] (do_lrm_rsc_op) notice: Requesting local execution of probe operation for nco_cognos on pplxnsms02 | transition_key=9:0:7:9732fbc5-6a0d-41b0-be4c-f2fb77dd49d7 op_key=nco_cognos_monitor_0
Oct 08 20:08:59 itnm(nco_itnm)[5371]: ERROR: Cannot find the directory /san/tivoli/netcool!
Oct 08 20:08:59 pplxnsms02 pacemaker-controld [2416] (wait_for_sync_result) info: Cognos_meta-data_0[5382] exited with status 0
Oct 08 20:08:59 pplxnsms02 pacemaker-controld [2416] (log_executor_event) notice: Result of probe operation for nco_omni on pplxnsms02: not running | CIB update 43, graph action confirmed; call=29 key=nco_omni_monitor_0 rc=7
Oct 08 20:08:59 pplxnsms02 pacemaker-controld [2416] (log_executor_event) notice: Result of probe operation for nco_itnm on pplxnsms02: not running | CIB update 44, graph action confirmed; call=33 key=nco_itnm_monitor_0 rc=7
Oct 08 20:08:59 pplxnsms02 pacemaker-based [2411] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/42)
Oct 08 20:08:59 pplxnsms02 pacemaker-based [2411] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/43)
Oct 08 20:08:59 pplxnsms02 pacemaker-based [2411] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/44)
Oct 08 20:08:59 pplxnsms02 pacemaker-based [2411] (cib_perform_op) info: Diff: --- 0.524.16 2
Oct 08 20:08:59 pplxnsms02 pacemaker-based [2411] (cib_perform_op) info: Diff: +++ 0.524.17 (null)
Oct 08 20:08:59 pplxnsms02 pacemaker-based [2411] (cib_perform_op) info: + /cib: @num_updates=17
Oct 08 20:08:59 pplxnsms02 pacemaker-based [2411] (cib_perform_op) info: ++ /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources:
Oct 08 20:08:59 pplxnsms02 pacemaker-based [2411] (cib_perform_op) info: ++
Oct 08 20:08:59 pplxnsms02 pacemaker-based [2411] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/42, version=0.524.17)
Oct 08 20:08:59 pplxnsms02 pacemaker-based [2411] (cib_perform_op) info: Diff: --- 0.524.17 2
Oct 08 20:08:59 pplxnsms02 pacemaker-based [2411] (cib_perform_op) info: Diff: +++ 0.524.18 (null)
Oct 08 20:08:59 pplxnsms02 pacemaker-based [2411] (cib_perform_op) info: + /cib: @num_updates=18
Oct 08 20:08:59 pplxnsms02 pacemaker-based [2411] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='nco_omni']/lrm_rsc_op[@id='nco_omni_last_0']: @transition-magic=0:7;7:0:7:9732fbc5-6a0d-41b0-be4c-f2fb77dd49d7, @call-id=29, @rc-code=7, @op-status=0, @exec-time=78
Oct 08 20:08:59 pplxnsms02 pacemaker-based [2411] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/43, version=0.524.18)
Oct 08 20:08:59 pplxnsms02 pacemaker-based [2411] (cib_perform_op) info: Diff: --- 0.524.18 2
Oct 08 20:08:59 pplxnsms02 pacemaker-based [2411] (cib_perform_op) info: Diff: +++ 0.524.19 (null)
Oct 08 20:08:59 pplxnsms02 pacemaker-based [2411] (cib_perform_op) info: + /cib: @num_updates=19
Oct 08 20:08:59 pplxnsms02 pacemaker-based [2411] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='nco_itnm']/lrm_rsc_op[@id='nco_itnm_last_0']: @transition-magic=0:7;8:0:7:9732fbc5-6a0d-41b0-be4c-f2fb77dd49d7, @call-id=33, @rc-code=7, @op-status=0, @exec-time=50
Oct 08 20:08:59 pplxnsms02 pacemaker-based [2411] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/44, version=0.524.19)
Oct 08 20:08:59 pplxnsms02 pacemaker-controld [2416] (process_graph_event) info: Transition 0 action 7 (nco_omni_monitor_0 on pplxnsms02) confirmed: not running | rc=7 call-id=29
Oct 08 20:08:59 pplxnsms02 pacemaker-controld [2416] (process_graph_event) info: Transition 0 action 8 (nco_itnm_monitor_0 on pplxnsms02) confirmed: not running | rc=7 call-id=33
Oct 08 20:08:59 pplxnsms02 pacemaker-controld [2416] (te_rsc_command) notice: Initiating monitor operation siem_vip_monitor_0 locally on pplxnsms02 | action 10
Oct 08 20:08:59 pplxnsms02 pacemaker-execd [2413] (process_lrmd_get_rsc_info) info: Agent information for 'siem_vip' not in cache
Oct 08 20:08:59 pplxnsms02 pacemaker-execd [2413] (process_lrmd_rsc_register) info: Cached agent information for 'siem_vip'
Oct 08 20:08:59 pplxnsms02 pacemaker-controld [2416] (do_lrm_rsc_op) notice: Requesting local execution of probe operation for siem_vip on pplxnsms02 | transition_key=10:0:7:9732fbc5-6a0d-41b0-be4c-f2fb77dd49d7 op_key=siem_vip_monitor_0
Oct 08 20:08:59 pplxnsms02 pacemaker-controld [2416] (te_rsc_command) notice: Initiating monitor operation siem_lvm_monitor_0 locally on pplxnsms02 | action 11
Oct 08 20:08:59 pplxnsms02 pacemaker-execd [2413] (process_lrmd_get_rsc_info) info: Agent information for 'siem_lvm' not in cache
Oct 08 20:08:59 pplxnsms02 pacemaker-based [2411] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/45)
Oct 08 20:08:59 pplxnsms02 pacemaker-based [2411] (cib_perform_op) info: Diff: --- 0.524.19 2
Oct 08 20:08:59 pplxnsms02 pacemaker-based [2411] (cib_perform_op) info: Diff: +++ 0.524.20 (null)
Oct 08 20:08:59 pplxnsms02 pacemaker-based [2411] (cib_perform_op) info: + /cib: @num_updates=20
Oct 08 20:08:59 pplxnsms02 pacemaker-based [2411] (cib_perform_op) info: ++ /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources:
Oct 08 20:08:59 pplxnsms02 pacemaker-based [2411] (cib_perform_op) info: ++
Oct 08 20:08:59 pplxnsms02 pacemaker-execd [2413] (process_lrmd_rsc_register) info: Cached agent information for 'siem_lvm'
Oct 08 20:08:59 pplxnsms02 pacemaker-based [2411] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/45, version=0.524.20)
Oct 08 20:08:59 pplxnsms02 pacemaker-controld [2416] (do_lrm_rsc_op) notice: Requesting local execution of probe operation for siem_lvm on pplxnsms02 | transition_key=11:0:7:9732fbc5-6a0d-41b0-be4c-f2fb77dd49d7 op_key=siem_lvm_monitor_0
Oct 08 20:08:59 pplxnsms02 pacemaker-based [2411] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/46)
Oct 08 20:08:59 pplxnsms02 pacemaker-based [2411] (cib_perform_op) info: Diff: --- 0.524.20 2
Oct 08 20:08:59 pplxnsms02 pacemaker-based [2411] (cib_perform_op) info: Diff: +++ 0.524.21 (null)
Oct 08 20:08:59 pplxnsms02 pacemaker-based [2411] (cib_perform_op) info: + /cib: @num_updates=21
Oct 08 20:08:59 pplxnsms02 pacemaker-based [2411] (cib_perform_op) info: ++ /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources:
Oct 08 20:08:59 pplxnsms02 pacemaker-based [2411] (cib_perform_op) info: ++
Oct 08 20:08:59 pplxnsms02 pacemaker-based [2411] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/46, version=0.524.21)
Oct 08 20:08:59 Cognos(nco_cognos)[5391]: ERROR: Cannot find the directory /san/tivoli/IBM/WebSphere!
Oct 08 20:08:59 pplxnsms02 pacemaker-controld [2416] (log_executor_event) notice: Result of probe operation for siem_lvm on pplxnsms02: not running | CIB update 47, graph action confirmed; call=45 key=siem_lvm_monitor_0 rc=7
Oct 08 20:08:59 pplxnsms02 pacemaker-based [2411] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/47)
Oct 08 20:08:59 pplxnsms02 pacemaker-based [2411] (cib_perform_op) info: Diff: --- 0.524.21 2
Oct 08 20:08:59 pplxnsms02 pacemaker-based [2411] (cib_perform_op) info: Diff: +++ 0.524.22 (null)
Oct 08 20:08:59 pplxnsms02 pacemaker-based [2411] (cib_perform_op) info: + /cib: @num_updates=22
Oct 08 20:08:59 pplxnsms02 pacemaker-based [2411] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='siem_lvm']/lrm_rsc_op[@id='siem_lvm_last_0']: @transition-magic=0:7;11:0:7:9732fbc5-6a0d-41b0-be4c-f2fb77dd49d7, @call-id=45, @rc-code=7, @op-status=0, @exec-time=58
Oct 08 20:08:59 pplxnsms02 pacemaker-based [2411] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/47, version=0.524.22)
Oct 08 20:08:59 pplxnsms02 pacemaker-controld [2416] (process_graph_event) info: Transition 0 action 11 (siem_lvm_monitor_0 on pplxnsms02) confirmed: not running | rc=7 call-id=45
Oct 08 20:08:59 pplxnsms02 pacemaker-controld [2416] (te_rsc_command) notice: Initiating monitor operation siem_fs_monitor_0 locally on pplxnsms02 | action 12
Oct 08 20:08:59 pplxnsms02 pacemaker-execd [2413] (process_lrmd_get_rsc_info) info: Agent information for 'siem_fs' not in cache
Oct 08 20:08:59 pplxnsms02 pacemaker-execd [2413] (process_lrmd_rsc_register) info: Cached agent information for 'siem_fs'
Oct 08 20:08:59 pplxnsms02 pacemaker-controld [2416] (do_lrm_rsc_op) notice: Requesting local execution of probe operation for siem_fs on pplxnsms02 | transition_key=12:0:7:9732fbc5-6a0d-41b0-be4c-f2fb77dd49d7 op_key=siem_fs_monitor_0
Oct 08 20:08:59 pplxnsms02 pacemaker-based [2411] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/48)
Oct 08 20:08:59 pplxnsms02 pacemaker-based [2411] (cib_perform_op) info: Diff: --- 0.524.22 2
Oct 08 20:08:59 pplxnsms02 pacemaker-based [2411] (cib_perform_op) info: Diff: +++ 0.524.23 (null)
Oct 08 20:08:59 pplxnsms02 pacemaker-based [2411] (cib_perform_op) info: + /cib: @num_updates=23
Oct 08 20:08:59 pplxnsms02 pacemaker-based [2411] (cib_perform_op) info: ++ /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources:
Oct 08 20:08:59 pplxnsms02 pacemaker-based [2411] (cib_perform_op) info: ++
Oct 08 20:08:59 pplxnsms02 pacemaker-controld [2416] (log_executor_event) notice: Result of probe operation for nco_cognos on pplxnsms02: not running | CIB update 49, graph action confirmed; call=37 key=nco_cognos_monitor_0 rc=7
Oct 08 20:08:59 pplxnsms02 pacemaker-based [2411] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/48, version=0.524.23)
Oct 08 20:08:59 pplxnsms02 pacemaker-based [2411] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/49)
Oct 08 20:08:59 pplxnsms02 pacemaker-based [2411] (cib_perform_op) info: Diff: --- 0.524.23 2
Oct 08 20:08:59 pplxnsms02 pacemaker-based [2411] (cib_perform_op) info: Diff: +++ 0.524.24 (null)
Oct 08 20:08:59 pplxnsms02 pacemaker-based [2411] (cib_perform_op) info: + /cib: @num_updates=24
Oct 08 20:08:59 pplxnsms02 pacemaker-based [2411] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='nco_cognos']/lrm_rsc_op[@id='nco_cognos_last_0']: @transition-magic=0:7;9:0:7:9732fbc5-6a0d-41b0-be4c-f2fb77dd49d7, @call-id=37, @rc-code=7, @op-status=0, @exec-time=77
Oct 08 20:08:59 pplxnsms02 pacemaker-based [2411] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/49, version=0.524.24)
Oct 08 20:08:59 pplxnsms02 pacemaker-controld [2416] (process_graph_event) info: Transition 0 action 9 (nco_cognos_monitor_0 on pplxnsms02) confirmed: not running | rc=7 call-id=37
Oct 08 20:08:59 pplxnsms02 pacemaker-controld [2416] (te_rsc_command) notice: Initiating monitor operation siem_rsyslog_monitor_0 locally on pplxnsms02 | action 13
Oct 08 20:08:59 pplxnsms02 pacemaker-execd [2413] (process_lrmd_get_rsc_info) info: Agent information for 'siem_rsyslog' not in cache
Oct 08 20:08:59 pplxnsms02 pacemaker-execd [2413] (process_lrmd_rsc_register) info: Cached agent information for 'siem_rsyslog'
Oct 08 20:08:59 pplxnsms02 pacemaker-controld [2416] (do_lrm_rsc_op) notice: Requesting local execution of probe operation for siem_rsyslog on pplxnsms02 | transition_key=13:0:7:9732fbc5-6a0d-41b0-be4c-f2fb77dd49d7 op_key=siem_rsyslog_monitor_0
Oct 08 20:08:59 pplxnsms02 pacemaker-controld [2416] (wait_for_sync_result) info: siemsyslog_meta-data_0[5443] exited with status 0
Oct 08 20:08:59 pplxnsms02 pacemaker-based [2411] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/50)
Oct 08 20:08:59 pplxnsms02 pacemaker-based [2411] (cib_perform_op) info: Diff: --- 0.524.24 2
Oct 08 20:08:59 pplxnsms02 pacemaker-based [2411] (cib_perform_op) info: Diff: +++ 0.524.25 (null)
Oct 08 20:08:59 pplxnsms02 pacemaker-based [2411] (cib_perform_op) info: + /cib: @num_updates=25
Oct 08 20:08:59 pplxnsms02 pacemaker-based [2411] (cib_perform_op) info: ++ /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources:
Oct 08 20:08:59 pplxnsms02 pacemaker-based [2411] (cib_perform_op) info: ++
Oct 08 20:08:59 pplxnsms02 pacemaker-controld [2416] (log_executor_event) notice: Result of probe operation for siem_vip on pplxnsms02: not running | CIB update 51, graph action confirmed; call=41 key=siem_vip_monitor_0 rc=7
Oct 08 20:08:59 pplxnsms02 pacemaker-based [2411] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/50, version=0.524.25)
Oct 08 20:08:59 pplxnsms02 pacemaker-based [2411] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/51)
Oct 08 20:08:59 pplxnsms02 pacemaker-based [2411] (cib_perform_op) info: Diff: --- 0.524.25 2
Oct 08 20:08:59 pplxnsms02 pacemaker-based [2411] (cib_perform_op) info: Diff: +++ 0.524.26 (null)
Oct 08 20:08:59 pplxnsms02 pacemaker-based [2411] (cib_perform_op) info: + /cib: @num_updates=26
Oct 08 20:08:59 pplxnsms02 pacemaker-based [2411] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='siem_vip']/lrm_rsc_op[@id='siem_vip_last_0']: @transition-magic=0:7;10:0:7:9732fbc5-6a0d-41b0-be4c-f2fb77dd49d7, @call-id=41, @rc-code=7, @op-status=0, @exec-time=124
Oct 08 20:08:59 pplxnsms02 pacemaker-based [2411] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/51, version=0.524.26)
Oct 08 20:08:59 pplxnsms02 pacemaker-controld [2416] (process_graph_event) info: Transition 0 action 10 (siem_vip_monitor_0 on pplxnsms02) confirmed: not running | rc=7 call-id=41
Oct 08 20:08:59 pplxnsms02 pacemaker-controld [2416] (te_rsc_command) notice: Initiating monitor operation web_mariadb_monitor_0 locally on pplxnsms02 | action 14
Oct 08 20:08:59 pplxnsms02 pacemaker-execd [2413] (process_lrmd_get_rsc_info) info: Agent information for 'web_mariadb' not in cache
Oct 08 20:08:59 pplxnsms02 pacemaker-execd [2413] (process_lrmd_rsc_register) info: Cached agent information for 'web_mariadb'
Oct 08 20:08:59 pplxnsms02 pacemaker-controld [2416] (do_lrm_rsc_op) notice: Requesting local execution of probe operation for web_mariadb on pplxnsms02 | transition_key=14:0:7:9732fbc5-6a0d-41b0-be4c-f2fb77dd49d7 op_key=web_mariadb_monitor_0
Oct 08 20:08:59 pplxnsms02 pacemaker-execd [2413] (log_op_output) info: siem_rsyslog_monitor_0[5471] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 3323 1 0 20:08 ? 00:00:00 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:08:59 Filesystem(siem_fs)[5437]: WARNING: Couldn't find device [/dev/vgslog/lv_log01]. Expected /dev/??? to exist
Oct 08 20:08:59 pplxnsms02 pacemaker-controld [2416] (wait_for_sync_result) info: mysql_meta-data_0[5479] exited with status 0
Oct 08 20:08:59 pplxnsms02 pacemaker-based [2411] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/52)
Oct 08 20:08:59 pplxnsms02 pacemaker-based [2411] (cib_perform_op) info: Diff: --- 0.524.26 2
Oct 08 20:08:59 pplxnsms02 pacemaker-based [2411] (cib_perform_op) info: Diff: +++ 0.524.27 (null)
Oct 08 20:08:59 pplxnsms02 pacemaker-based [2411] (cib_perform_op) info: + /cib: @num_updates=27
Oct 08 20:08:59 pplxnsms02 pacemaker-based [2411] (cib_perform_op) info: ++ /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources:
Oct 08 20:08:59 pplxnsms02 pacemaker-based [2411] (cib_perform_op) info: ++
Oct 08 20:08:59 pplxnsms02 pacemaker-based [2411] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/52, version=0.524.27)
Oct 08 20:08:59 pplxnsms02 pacemaker-controld [2416] (log_executor_event) notice: Result of probe operation for siem_rsyslog on pplxnsms02: not running | CIB update 53, graph action confirmed; call=53 key=siem_rsyslog_monitor_0 rc=7
Oct 08 20:08:59 pplxnsms02 pacemaker-controld [2416] (log_executor_event) notice: siem_rsyslog_monitor_0@pplxnsms02 output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 3323 1 0 20:08 ? 00:00:00 /usr/sbin/rsyslogd -n: integer expression expected\n ]
Oct 08 20:08:59 pplxnsms02 pacemaker-based [2411] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/53)
Oct 08 20:08:59 pplxnsms02 pacemaker-based [2411] (cib_perform_op) info: Diff: --- 0.524.27 2
Oct 08 20:08:59 pplxnsms02 pacemaker-based [2411] (cib_perform_op) info: Diff: +++ 0.524.28 (null)
Oct 08 20:08:59 pplxnsms02 pacemaker-based [2411] (cib_perform_op) info: + /cib: @num_updates=28
Oct 08 20:08:59 pplxnsms02 pacemaker-based [2411] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='siem_rsyslog']/lrm_rsc_op[@id='siem_rsyslog_last_0']: @transition-magic=0:7;13:0:7:9732fbc5-6a0d-41b0-be4c-f2fb77dd49d7, @call-id=53, @rc-code=7, @op-status=0, @exec-time=88
Oct 08 20:08:59 pplxnsms02 pacemaker-based [2411] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/53, version=0.524.28)
Oct 08 20:08:59 pplxnsms02 pacemaker-controld [2416] (process_graph_event) info: Transition 0 action 13 (siem_rsyslog_monitor_0 on pplxnsms02) confirmed: not running | rc=7 call-id=53
Oct 08 20:08:59 pplxnsms02 pacemaker-controld [2416] (te_rsc_command) notice: Initiating monitor operation web_matomo_monitor_0 locally on pplxnsms02 | action 15
Oct 08 20:08:59 pplxnsms02 pacemaker-execd [2413] (process_lrmd_get_rsc_info) info: Agent information for 'web_matomo' not in cache
Oct 08 20:08:59 pplxnsms02 pacemaker-execd [2413] (process_lrmd_rsc_register) info: Cached agent information for 'web_matomo'
Oct 08 20:08:59 pplxnsms02 pacemaker-controld [2416] (do_lrm_rsc_op) notice: Requesting local execution of probe operation for web_matomo on pplxnsms02 | transition_key=15:0:7:9732fbc5-6a0d-41b0-be4c-f2fb77dd49d7 op_key=web_matomo_monitor_0
Oct 08 20:08:59 pplxnsms02 pacemaker-controld [2416] (wait_for_sync_result) info: apache_meta-data_0[5654] exited with status 0
Oct 08 20:08:59 pplxnsms02 pacemaker-based [2411] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/54)
Oct 08 20:08:59 pplxnsms02 pacemaker-based [2411] (cib_perform_op) info: Diff: --- 0.524.28 2
Oct 08 20:08:59 pplxnsms02 pacemaker-based [2411] (cib_perform_op) info: Diff: +++ 0.524.29 (null)
Oct 08 20:08:59 pplxnsms02 pacemaker-based [2411] (cib_perform_op) info: + /cib: @num_updates=29
Oct 08 20:08:59 pplxnsms02 pacemaker-based [2411] (cib_perform_op) info: ++ /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources:
Oct 08 20:08:59 pplxnsms02 pacemaker-based [2411] (cib_perform_op) info: ++
Oct 08 20:08:59 pplxnsms02 pacemaker-controld [2416] (log_executor_event) notice: Result of probe operation for siem_fs on pplxnsms02: not running | CIB update 55, graph action confirmed; call=49 key=siem_fs_monitor_0 rc=7
Oct 08 20:08:59 pplxnsms02 pacemaker-based [2411] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/54, version=0.524.29)
Oct 08 20:08:59 pplxnsms02 pacemaker-based [2411] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/55)
Oct 08 20:08:59 pplxnsms02 pacemaker-based [2411] (cib_perform_op) info: Diff: --- 0.524.29 2
Oct 08 20:08:59 pplxnsms02 pacemaker-based [2411] (cib_perform_op) info: Diff: +++ 0.524.30 (null)
Oct 08 20:08:59 pplxnsms02 pacemaker-based [2411] (cib_perform_op) info: + /cib: @num_updates=30
Oct 08 20:08:59 pplxnsms02 pacemaker-based [2411] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='siem_fs']/lrm_rsc_op[@id='siem_fs_last_0']: @transition-magic=0:7;12:0:7:9732fbc5-6a0d-41b0-be4c-f2fb77dd49d7, @call-id=49, @rc-code=7, @op-status=0, @exec-time=352
Oct 08 20:08:59 pplxnsms02 pacemaker-based [2411] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/55, version=0.524.30)
Oct 08 20:08:59 pplxnsms02 pacemaker-controld [2416] (process_graph_event) info: Transition 0 action 12 (siem_fs_monitor_0 on pplxnsms02) confirmed: not running | rc=7 call-id=49
Oct 08 20:08:59 pplxnsms02 pacemaker-controld [2416] (te_rsc_command) notice: Initiating monitor operation fence-sbd_monitor_0 locally on pplxnsms02 | action 16
Oct 08 20:08:59 pplxnsms02 pacemaker-execd [2413] (process_lrmd_get_rsc_info) info: Agent information for 'fence-sbd' not in cache
Oct 08 20:08:59 pplxnsms02 pacemaker-execd [2413] (process_lrmd_rsc_register) info: Cached agent information for 'fence-sbd'
Oct 08 20:08:59 pplxnsms02 pacemaker-controld [2416] (do_lrm_rsc_op) notice: Requesting local execution of probe operation for fence-sbd on pplxnsms02 | transition_key=16:0:7:9732fbc5-6a0d-41b0-be4c-f2fb77dd49d7 op_key=fence-sbd_monitor_0
Oct 08 20:09:00 pplxnsms02 pacemaker-controld [2416] (wait_for_sync_result) info: fence_sbd_metadata_1[5739] exited with status 0
Oct 08 20:09:00 pplxnsms02 pacemaker-based [2411] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/56)
Oct 08 20:09:00 pplxnsms02 pacemaker-based [2411] (cib_perform_op) info: Diff: --- 0.524.30 2
Oct 08 20:09:00 pplxnsms02 pacemaker-based [2411] (cib_perform_op) info: Diff: +++ 0.524.31 (null)
Oct 08 20:09:00 pplxnsms02 pacemaker-based [2411] (cib_perform_op) info: + /cib: @num_updates=31
Oct 08 20:09:00 pplxnsms02 pacemaker-based [2411] (cib_perform_op) info: ++ /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources:
Oct 08 20:09:00 pplxnsms02 pacemaker-based [2411] (cib_perform_op) info: ++
Oct 08 20:09:00 pplxnsms02 pacemaker-based [2411] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/56, version=0.524.31)
Oct 08 20:09:00 mysql(web_mariadb)[5626]: ERROR: Datadir /siemlog/mysql doesn't exist
Oct 08 20:09:00 pplxnsms02 pacemaker-fenced [2412] (dynamic_list_search_cb) info: Refreshing target list for fence-sbd
Oct 08 20:09:00 pplxnsms02 pacemaker-controld [2416] (log_executor_event) notice: Result of probe operation for fence-sbd on pplxnsms02: not running | CIB update 57, graph action confirmed; call=65 key=fence-sbd_monitor_0 rc=7
Oct 08 20:09:00 pplxnsms02 pacemaker-fenced [2412] (process_remote_stonith_query) info: Query result 1 of 1 from pplxnsms02 for pplxnsms01/reboot (1 device) d90cf1d8-f5fe-4c69-9a70-4cabba6d62d2
Oct 08 20:09:00 pplxnsms02 pacemaker-fenced [2412] (process_remote_stonith_query) info: All query replies have arrived, continuing (1 expected/1 received)
Oct 08 20:09:00 pplxnsms02 pacemaker-fenced [2412] (request_peer_fencing) info: Total timeout set to 60 for peer's fencing targeting pplxnsms01 for pacemaker-controld.2416|id=d90cf1d8
Oct 08 20:09:00 pplxnsms02 pacemaker-fenced [2412] (request_peer_fencing) notice: Requesting that pplxnsms02 perform 'reboot' action targeting pplxnsms01 | for client pacemaker-controld.2416 (72s, 0s)
Oct 08 20:09:00 pplxnsms02 pacemaker-fenced [2412] (can_fence_host_with_device) notice: fence-sbd is eligible to fence (reboot) pplxnsms01: dynamic-list
Oct 08 20:09:00 pplxnsms02 pacemaker-fenced [2412] (stonith_fence_get_devices_cb) info: Found 1 matching device for target 'pplxnsms01'
Oct 08 20:09:00 pplxnsms02 pacemaker-based [2411] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/57)
Oct 08 20:09:00 pplxnsms02 pacemaker-based [2411] (cib_perform_op) info: Diff: --- 0.524.31 2
Oct 08 20:09:00 pplxnsms02 pacemaker-based [2411] (cib_perform_op) info: Diff: +++ 0.524.32 (null)
Oct 08 20:09:00 pplxnsms02 pacemaker-based [2411] (cib_perform_op) info: + /cib: @num_updates=32
Oct 08 20:09:00 pplxnsms02 pacemaker-based [2411] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='fence-sbd']/lrm_rsc_op[@id='fence-sbd_last_0']: @transition-magic=0:7;16:0:7:9732fbc5-6a0d-41b0-be4c-f2fb77dd49d7, @call-id=65, @rc-code=7, @op-status=0, @last-rc-change=1728389340, @exec-time=14
Oct 08 20:09:00 pplxnsms02 pacemaker-based [2411] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/57, version=0.524.32)
Oct 08 20:09:00 pplxnsms02 pacemaker-controld [2416] (process_graph_event) info: Transition 0 action 16 (fence-sbd_monitor_0 on pplxnsms02) confirmed: not running | rc=7 call-id=65
Oct 08 20:09:00 mysql(web_mariadb)[5626]: INFO: MySQL is not running
Oct 08 20:09:00 pplxnsms02 pacemaker-execd [2413] (log_op_output) info: web_mariadb_monitor_0[5626] error output [ ocf-exit-reason:Datadir /siemlog/mysql doesn't exist ]
Oct 08 20:09:00 pplxnsms02 pacemaker-controld [2416] (log_executor_event) notice: Result of probe operation for web_mariadb on pplxnsms02: not running (Datadir /siemlog/mysql doesn't exist) | CIB update 58, graph action confirmed; call=57 key=web_mariadb_monitor_0 rc=7
Oct 08 20:09:00 pplxnsms02 pacemaker-controld [2416] (log_executor_event) notice: web_mariadb_monitor_0@pplxnsms02 output [ ocf-exit-reason:Datadir /siemlog/mysql doesn't exist\n ]
Oct 08 20:09:00 pplxnsms02 pacemaker-based [2411] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/58)
Oct 08 20:09:00 pplxnsms02 pacemaker-based [2411] (cib_perform_op) info: Diff: --- 0.524.32 2
Oct 08 20:09:00 pplxnsms02 pacemaker-based [2411] (cib_perform_op) info: Diff: +++ 0.524.33 (null)
Oct 08 20:09:00 pplxnsms02 pacemaker-based [2411] (cib_perform_op) info: + /cib: @num_updates=33
Oct 08 20:09:00 pplxnsms02 pacemaker-based [2411] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='web_mariadb']/lrm_rsc_op[@id='web_mariadb_last_0']: @transition-magic=0:7;14:0:7:9732fbc5-6a0d-41b0-be4c-f2fb77dd49d7, @call-id=57, @rc-code=7, @op-status=0, @exec-time=249
Oct 08 20:09:00 pplxnsms02 pacemaker-based [2411] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/58, version=0.524.33)
Oct 08 20:09:00 pplxnsms02 pacemaker-controld [2416] (process_graph_event) info: Transition 0 action 14 (web_mariadb_monitor_0 on pplxnsms02) confirmed: not running | rc=7 call-id=57
Oct 08 20:09:00 apache(web_matomo)[5735]: INFO: apache not running
Oct 08 20:09:00 pplxnsms02 pacemaker-controld [2416] (log_executor_event) notice: Result of probe operation for web_matomo on pplxnsms02: not running | CIB update 59, graph action confirmed; call=61 key=web_matomo_monitor_0 rc=7
Oct 08 20:09:00 pplxnsms02 pacemaker-based [2411] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/59)
Oct 08 20:09:00 pplxnsms02 pacemaker-based [2411] (cib_perform_op) info: Diff: --- 0.524.33 2
Oct 08 20:09:00 pplxnsms02 pacemaker-based [2411] (cib_perform_op) info: Diff: +++ 0.524.34 (null)
Oct 08 20:09:00 pplxnsms02 pacemaker-based [2411] (cib_perform_op) info: + /cib: @num_updates=34
Oct 08 20:09:00 pplxnsms02 pacemaker-based [2411] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='web_matomo']/lrm_rsc_op[@id='web_matomo_last_0']: @transition-magic=0:7;15:0:7:9732fbc5-6a0d-41b0-be4c-f2fb77dd49d7, @call-id=61, @rc-code=7, @op-status=0, @exec-time=210
Oct 08 20:09:00 pplxnsms02 pacemaker-based [2411] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/59, version=0.524.34)
Oct 08 20:09:00 pplxnsms02 pacemaker-controld [2416] (process_graph_event) info: Transition 0 action 15 (web_matomo_monitor_0 on pplxnsms02) confirmed: not running | rc=7 call-id=61
Oct 08 20:09:01 pplxnsms02 pacemaker-controld [2416] (log_executor_event) notice: Result of probe operation for nco_db2 on pplxnsms02: not running | CIB update 60, graph action confirmed; call=25 key=nco_db2_monitor_0 rc=7
Oct 08 20:09:01 pplxnsms02 pacemaker-based [2411] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/60)
Oct 08 20:09:01 pplxnsms02 pacemaker-based [2411] (cib_perform_op) info: Diff: --- 0.524.34 2
Oct 08 20:09:01 pplxnsms02 pacemaker-based [2411] (cib_perform_op) info: Diff: +++ 0.524.35 (null)
Oct 08 20:09:01 pplxnsms02 pacemaker-based [2411] (cib_perform_op) info: + /cib: @num_updates=35
Oct 08 20:09:01 pplxnsms02 pacemaker-based [2411] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='nco_db2']/lrm_rsc_op[@id='nco_db2_last_0']: @transition-magic=0:7;6:0:7:9732fbc5-6a0d-41b0-be4c-f2fb77dd49d7, @call-id=25, @rc-code=7, @op-status=0, @exec-time=2486
Oct 08 20:09:01 pplxnsms02 pacemaker-based [2411] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/60, version=0.524.35)
Oct 08 20:09:01 pplxnsms02 pacemaker-controld [2416] (process_graph_event) info: Transition 0 action 6 (nco_db2_monitor_0 on pplxnsms02) confirmed: not running | rc=7 call-id=25
Oct 08 20:09:06 pplxnsms02 pacemaker-based [2411] (cib_process_ping) info: Reporting our current digest to pplxnsms02: 62643478b22d89b4d5e88e2831f44107 for 0.524.35 (0x55da0ab82d00 0)
Oct 08 20:09:06 pplxnsms02 pacemaker-controld [2416] (pcmk__procfs_pid_of) info: Found pacemaker-based active as process 2411
Oct 08 20:09:06 pplxnsms02 pacemaker-controld [2416] (throttle_check_thresholds) info: Moderate CPU load detected: 5.800000
Oct 08 20:09:06 pplxnsms02 pacemaker-controld [2416] (throttle_send_command) info: New throttle mode: medium load (was undetermined)
Oct 08 20:09:20 pplxnsms02 pacemaker-fenced [2412] (log_async_result) notice: Operation 'reboot' [5820] targeting pplxnsms01 using fence-sbd returned 0 | call 4 from pacemaker-controld.2416
Oct 08 20:09:20 pplxnsms02 pacemaker-fenced [2412] (finalize_op) notice: Operation 'reboot' targeting pplxnsms01 by pplxnsms02 for pacemaker-controld.2416@pplxnsms02: OK (complete) | id=d90cf1d8
Oct 08 20:09:20 pplxnsms02 pacemaker-controld [2416] (tengine_stonith_callback) notice: Fence operation 4 for pplxnsms01 passed
Oct 08 20:09:20 pplxnsms02 pacemaker-controld [2416] (update_peer_state_iter) notice: Node pplxnsms01 state is now lost | nodeid=1 previous=unknown source=crmd_peer_down
Oct 08 20:09:20 pplxnsms02 pacemaker-controld [2416] (peer_update_callback) info: Cluster node pplxnsms01 is now lost (was in unknown state)
Oct 08 20:09:20 pplxnsms02 pacemaker-controld [2416] (crm_update_peer_proc) info: crmd_peer_down: Node pplxnsms01[1] - all processes are now offline
Oct 08 20:09:20 pplxnsms02 pacemaker-controld [2416] (peer_update_callback) info: Node pplxnsms01 is no longer a peer | DC=true old=0x0000000 new=0x0000001
Oct 08 20:09:20 pplxnsms02 pacemaker-controld [2416] (pcmk__update_peer_expected) info: crmd_peer_down: Node pplxnsms01[1] - expected state is now down (was (null))
Oct 08 20:09:20 pplxnsms02 pacemaker-controld [2416] (controld_delete_node_state) info: Deleting all state for node pplxnsms01 (via CIB call 63) | xpath=//node_state[@uname='pplxnsms01']/*
Oct 08 20:09:20 pplxnsms02 pacemaker-controld [2416] (te_rsc_command) notice: Initiating start operation itm_vip_start_0 locally on pplxnsms02 | action 17
Oct 08 20:09:20 pplxnsms02 pacemaker-controld [2416] (do_lrm_rsc_op) notice: Requesting local execution of start operation for itm_vip on pplxnsms02 | transition_key=17:0:0:9732fbc5-6a0d-41b0-be4c-f2fb77dd49d7 op_key=itm_vip_start_0
Oct 08 20:09:20 pplxnsms02 pacemaker-execd [2413] (log_execute) info: executing - rsc:itm_vip action:start call_id:66
Oct 08 20:09:20 pplxnsms02 pacemaker-based [2411] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/61)
Oct 08 20:09:20 pplxnsms02 pacemaker-based [2411] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/62)
Oct 08 20:09:20 pplxnsms02 pacemaker-based [2411] (cib_process_request) info: Forwarding cib_delete operation for section //node_state[@uname='pplxnsms01']/* to all (origin=local/crmd/63)
Oct 08 20:09:20 pplxnsms02 pacemaker-based [2411] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/64)
Oct 08 20:09:20 pplxnsms02 pacemaker-controld [2416] (te_rsc_command) notice: Initiating start operation siem_vip_start_0 locally on pplxnsms02 | action 39
Oct 08 20:09:20 pplxnsms02 pacemaker-controld [2416] (do_lrm_rsc_op) notice: Requesting local execution of start operation for siem_vip on pplxnsms02 | transition_key=39:0:0:9732fbc5-6a0d-41b0-be4c-f2fb77dd49d7 op_key=siem_vip_start_0
Oct 08 20:09:20 pplxnsms02 pacemaker-based [2411] (cib_perform_op) info: Diff: --- 0.524.35 2
Oct 08 20:09:20 pplxnsms02 pacemaker-based [2411] (cib_perform_op) info: Diff: +++ 0.524.36 (null)
Oct 08 20:09:20 pplxnsms02 pacemaker-based [2411] (cib_perform_op) info: + /cib: @num_updates=36
Oct 08 20:09:20 pplxnsms02 pacemaker-based [2411] (cib_perform_op) info: ++ /cib/status:
Oct 08 20:09:20 pplxnsms02 pacemaker-based [2411] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/61, version=0.524.36)
Oct 08 20:09:20 pplxnsms02 pacemaker-based [2411] (cib_perform_op) info: Diff: --- 0.524.36 2
Oct 08 20:09:20 pplxnsms02 pacemaker-based [2411] (cib_perform_op) info: Diff: +++ 0.524.37 (null)
Oct 08 20:09:20 pplxnsms02 pacemaker-based [2411] (cib_perform_op) info: + /cib: @num_updates=37
Oct 08 20:09:20 pplxnsms02 pacemaker-based [2411] (cib_perform_op) info: + /cib/status/node_state[@id='1']: @crm-debug-origin=send_stonith_update, @in_ccm=false, @join=down, @expected=down
Oct 08 20:09:20 pplxnsms02 pacemaker-based [2411] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/62, version=0.524.37)
Oct 08 20:09:20 pplxnsms02 pacemaker-execd [2413] (log_execute) info: executing - rsc:siem_vip action:start call_id:67
Oct 08 20:09:20 pplxnsms02 pacemaker-based [2411] (cib_process_request) info: Completed cib_delete operation for section //node_state[@uname='pplxnsms01']/*: OK (rc=0, origin=pplxnsms02/crmd/63, version=0.524.37)
Oct 08 20:09:20 pplxnsms02 pacemaker-based [2411] (cib_perform_op) info: Diff: --- 0.524.37 2
Oct 08 20:09:20 pplxnsms02 pacemaker-based [2411] (cib_perform_op) info: Diff: +++ 0.524.38 (null)
Oct 08 20:09:20 pplxnsms02 pacemaker-based [2411] (cib_perform_op) info: + /cib: @num_updates=38
Oct 08 20:09:20 pplxnsms02 pacemaker-based [2411] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='itm_vip']/lrm_rsc_op[@id='itm_vip_last_0']: @operation_key=itm_vip_start_0, @operation=start, @transition-key=17:0:0:9732fbc5-6a0d-41b0-be4c-f2fb77dd49d7, @transition-magic=-1:193;17:0:0:9732fbc5-6a0d-41b0-be4c-f2fb77dd49d7, @call-id=-1, @rc-code=193, @op-status=-1, @last-rc-change=1728389360, @exec-time=0
Oct 08 20:09:20 pplxnsms02 pacemaker-based [2411] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/64, version=0.524.38)
Oct 08 20:09:20 pplxnsms02 pacemaker-based [2411] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/65)
Oct 08 20:09:20 pplxnsms02 pacemaker-based [2411] (cib_perform_op) info: Diff: --- 0.524.38 2
Oct 08 20:09:20 pplxnsms02 pacemaker-based [2411] (cib_perform_op) info: Diff: +++ 0.524.39 (null)
Oct 08 20:09:20 pplxnsms02 pacemaker-based [2411] (cib_perform_op) info: + /cib: @num_updates=39
Oct 08 20:09:20 pplxnsms02 pacemaker-based [2411] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='siem_vip']/lrm_rsc_op[@id='siem_vip_last_0']: @operation_key=siem_vip_start_0, @operation=start, @transition-key=39:0:0:9732fbc5-6a0d-41b0-be4c-f2fb77dd49d7, @transition-magic=-1:193;39:0:0:9732fbc5-6a0d-41b0-be4c-f2fb77dd49d7, @call-id=-1, @rc-code=193, @op-status=-1, @last-rc-change=1728389360, @exec-time=0
Oct 08 20:09:20 pplxnsms02 pacemaker-based [2411] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/65, version=0.524.39)
Oct 08 20:09:20 pplxnsms02 pacemaker-controld [2416] (cib_fencing_updated) info: Fencing update 62 for pplxnsms01: complete
Oct 08 20:09:20 pplxnsms02 pacemaker-controld [2416] (handle_fence_notification) notice: Peer pplxnsms01 was terminated (reboot) by pplxnsms02 on behalf of pacemaker-controld.2416@pplxnsms02: OK | event=d90cf1d8-f5fe-4c69-9a70-4cabba6d62d2
Oct 08 20:09:20 pplxnsms02 pacemaker-controld [2416] (controld_delete_node_state) info: Deleting all state for node pplxnsms01 (via CIB call 67) | xpath=//node_state[@uname='pplxnsms01']/*
Oct 08 20:09:20 pplxnsms02 pacemaker-based [2411] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/66)
Oct 08 20:09:20 pplxnsms02 pacemaker-based [2411] (cib_process_request) info: Forwarding cib_delete operation for section //node_state[@uname='pplxnsms01']/* to all (origin=local/crmd/67)
Oct 08 20:09:20 pplxnsms02 pacemaker-based [2411] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/66, version=0.524.39)
Oct 08 20:09:20 pplxnsms02 pacemaker-controld [2416] (cib_fencing_updated) info: Fencing update 66 for pplxnsms01: complete
Oct 08 20:09:20 pplxnsms02 pacemaker-based [2411] (cib_process_request) info: Completed cib_delete operation for section //node_state[@uname='pplxnsms01']/*: OK (rc=0, origin=pplxnsms02/crmd/67, version=0.524.39)
Oct 08 20:09:20 IPaddr2(itm_vip)[6412]: INFO: Adding inet address 192.168.133.136/24 with broadcast address 192.168.133.255 to device ens224
Oct 08 20:09:20 IPaddr2(siem_vip)[6413]: INFO: Adding inet address 192.168.133.40/24 with broadcast address 192.168.133.255 to device ens224
Oct 08 20:09:20 IPaddr2(itm_vip)[6412]: INFO: Bringing device ens224 up
Oct 08 20:09:20 IPaddr2(siem_vip)[6413]: INFO: Bringing device ens224 up
Oct 08 20:09:20 IPaddr2(itm_vip)[6412]: INFO: /usr/libexec/heartbeat/send_arp -i 200 -r 5 -p /run/resource-agents/send_arp-192.168.133.136 ens224 192.168.133.136 auto not_used not_used
Oct 08 20:09:20 pplxnsms02 pacemaker-execd [2413] (log_finished) info: itm_vip start (call 66, PID 6412) exited with status 0 (execution time 92ms)
Oct 08 20:09:20 IPaddr2(siem_vip)[6413]: INFO: /usr/libexec/heartbeat/send_arp -i 200 -r 5 -p /run/resource-agents/send_arp-192.168.133.40 ens224 192.168.133.40 auto not_used not_used
Oct 08 20:09:20 pplxnsms02 pacemaker-execd [2413] (log_finished) info: siem_vip start (call 67, PID 6413) exited with status 0 (execution time 107ms)
Oct 08 20:09:20 pplxnsms02 pacemaker-controld [2416] (wait_for_sync_result) info: IPaddr2_meta-data_0[6554] exited with status 0
Oct 08 20:09:20 pplxnsms02 pacemaker-controld [2416] (log_executor_event) notice: Result of start operation for itm_vip on pplxnsms02: ok | CIB update 68, graph action confirmed; call=66 key=itm_vip_start_0 rc=0
Oct 08 20:09:20 pplxnsms02 pacemaker-based [2411] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/68)
Oct 08 20:09:20 pplxnsms02 pacemaker-based [2411] (cib_perform_op) info: Diff: --- 0.524.39 2
Oct 08 20:09:20 pplxnsms02 pacemaker-based [2411] (cib_perform_op) info: Diff: +++ 0.524.40 (null)
Oct 08 20:09:20 pplxnsms02 pacemaker-based [2411] (cib_perform_op) info: + /cib: @num_updates=40
Oct 08 20:09:20 pplxnsms02 pacemaker-based [2411] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='itm_vip']/lrm_rsc_op[@id='itm_vip_last_0']: @transition-magic=0:0;17:0:0:9732fbc5-6a0d-41b0-be4c-f2fb77dd49d7, @call-id=66, @rc-code=0, @op-status=0, @exec-time=92
Oct 08 20:09:20 pplxnsms02 pacemaker-based [2411] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/68, version=0.524.40)
Oct 08 20:09:20 pplxnsms02 pacemaker-controld [2416] (wait_for_sync_result) info: IPaddr2_meta-data_0[6566] exited with status 0
Oct 08 20:09:20 pplxnsms02 pacemaker-controld [2416] (log_executor_event) notice: Result of start operation for siem_vip on pplxnsms02: ok | CIB update 69, graph action confirmed; call=67 key=siem_vip_start_0 rc=0
Oct 08 20:09:20 pplxnsms02 pacemaker-controld [2416] (process_graph_event) info: Transition 0 action 17 (itm_vip_start_0 on pplxnsms02) confirmed: ok | rc=0 call-id=66
Oct 08 20:09:20 pplxnsms02 pacemaker-controld [2416] (te_rsc_command) notice: Initiating monitor operation itm_vip_monitor_10000 locally on pplxnsms02 | action 18
Oct 08 20:09:20 pplxnsms02 pacemaker-controld [2416] (do_lrm_rsc_op) notice: Requesting local execution of monitor operation for itm_vip on pplxnsms02 | transition_key=18:0:0:9732fbc5-6a0d-41b0-be4c-f2fb77dd49d7 op_key=itm_vip_monitor_10000
Oct 08 20:09:20 pplxnsms02 pacemaker-based [2411] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/69)
Oct 08 20:09:20 pplxnsms02 pacemaker-based [2411] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/70)
Oct 08 20:09:20 pplxnsms02 pacemaker-based [2411] (cib_perform_op) info: Diff: --- 0.524.40 2
Oct 08 20:09:20 pplxnsms02 pacemaker-based [2411] (cib_perform_op) info: Diff: +++ 0.524.41 (null)
Oct 08 20:09:20 pplxnsms02 pacemaker-based [2411] (cib_perform_op) info: + /cib: @num_updates=41
Oct 08 20:09:20 pplxnsms02 pacemaker-based [2411] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='siem_vip']/lrm_rsc_op[@id='siem_vip_last_0']: @transition-magic=0:0;39:0:0:9732fbc5-6a0d-41b0-be4c-f2fb77dd49d7, @call-id=67, @rc-code=0, @op-status=0, @exec-time=107
Oct 08 20:09:20 pplxnsms02 pacemaker-based [2411] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/69, version=0.524.41)
Oct 08 20:09:20 pplxnsms02 pacemaker-based [2411] (cib_perform_op) info: Diff: --- 0.524.41 2
Oct 08 20:09:20 pplxnsms02 pacemaker-based [2411] (cib_perform_op) info: Diff: +++ 0.524.42 (null)
Oct 08 20:09:20 pplxnsms02 pacemaker-based [2411] (cib_perform_op) info: + /cib: @num_updates=42
Oct 08 20:09:20 pplxnsms02 pacemaker-based [2411] (cib_perform_op) info: ++ /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='itm_vip']: old=0x0000000 new=0x4000000
Oct 08 20:10:01 pplxnsms02 pacemaker-controld [2411] (te_trigger_stonith_history_sync) info: Fence history will be synchronized cluster-wide within 5 seconds
Oct 08 20:10:01 pplxnsms02 pacemaker-controld [2411] (pcmk__corosync_connect) info: Connection to corosync established
Oct 08 20:10:01 pplxnsms02 pacemaker-attrd [2409] (cib_native_signon_raw) info: Successfully connected to CIB manager for attrd
Oct 08 20:10:01 pplxnsms02 pacemaker-fenced [2407] (cib_native_signon_raw) info: Successfully connected to CIB manager for stonithd
Oct 08 20:10:01 pplxnsms02 pacemaker-attrd [2409] (main) info: CIB connection active
Oct 08 20:10:01 pplxnsms02 pacemaker-attrd [2409] (get_cluster_type) info: Verifying cluster type: 'corosync'
Oct 08 20:10:01 pplxnsms02 pacemaker-attrd [2409] (get_cluster_type) info: Assuming an active 'corosync' cluster
Oct 08 20:10:01 pplxnsms02 pacemaker-attrd [2409] (crm_cluster_connect) notice: Connecting to corosync cluster infrastructure
Oct 08 20:10:01 pplxnsms02 pacemaker-controld [2411] (pcmk__corosync_quorum_connect) warning: No quorum
Oct 08 20:10:01 pplxnsms02 pacemaker-controld [2411] (crm_get_peer) info: Created entry ead361a3-2d2a-4be9-b6d4-24ae8e72ad17/0x55dd7ec4d7e0 for node pplxnsms01/1 (2 total)
Oct 08 20:10:01 pplxnsms02 pacemaker-controld [2411] (crm_get_peer) info: Node 1 is now known as pplxnsms01
Oct 08 20:10:01 pplxnsms02 pacemaker-controld [2411] (peer_update_callback) info: Cluster node pplxnsms01 is now in unknown state
Oct 08 20:10:01 pplxnsms02 pacemaker-controld [2411] (crm_get_peer) info: Node 1 has uuid 1
Oct 08 20:10:01 pplxnsms02 pacemaker-fenced [2407] (setup_cib) info: Watching for fencing topology changes
Oct 08 20:10:01 pplxnsms02 pacemaker-fenced [2407] (qb_ipcs_us_publish) info: server name: stonith-ng
Oct 08 20:10:01 pplxnsms02 pacemaker-fenced [2407] (main) notice: Pacemaker fencer successfully started and accepting connections
Oct 08 20:10:01 pplxnsms02 pacemaker-fenced [2407] (pcmk_cpg_membership) info: Group stonith-ng event 0: node 2 pid 2407 joined via cpg_join
Oct 08 20:10:01 pplxnsms02 pacemaker-fenced [2407] (pcmk_cpg_membership) info: Group stonith-ng event 0: pplxnsms02 (node 2 pid 2407) is member
Oct 08 20:10:01 pplxnsms02 pacemaker-attrd [2409] (crm_get_peer) info: Created entry c8cea0a3-c1b0-4db9-aeb2-207e12192b63/0x555c47b73bd0 for node pplxnsms02/2 (1 total)
Oct 08 20:10:01 pplxnsms02 pacemaker-attrd [2409] (crm_get_peer) info: Node 2 is now known as pplxnsms02
Oct 08 20:10:01 pplxnsms02 pacemaker-attrd [2409] (crm_get_peer) info: Node 2 has uuid 2
Oct 08 20:10:01 pplxnsms02 pacemaker-attrd [2409] (crm_update_peer_proc) info: cluster_connect_cpg: Node pplxnsms02[2] - corosync-cpg is now online
Oct 08 20:10:01 pplxnsms02 pacemaker-attrd [2409] (update_peer_state_iter) notice: Node pplxnsms02 state is now member | nodeid=2 previous=unknown source=crm_update_peer_proc
Oct 08 20:10:01 pplxnsms02 pacemaker-attrd [2409] (pcmk__corosync_connect) info: Connection to corosync established
Oct 08 20:10:01 pplxnsms02 pacemaker-fenced [2407] (init_cib_cache_cb) info: Updating device list from CIB
Oct 08 20:10:01 pplxnsms02 pacemaker-fenced [2407] (cib_devices_update) info: Updating devices to version 0.524.0
Oct 08 20:10:01 pplxnsms02 pacemaker-fenced [2407] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 08 20:10:01 pplxnsms02 pacemaker-fenced [2407] (unpack_config) notice: On loss of quorum: Ignore
Oct 08 20:10:01 pplxnsms02 pacemaker-attrd [2409] (main) info: Cluster connection active
Oct 08 20:10:01 pplxnsms02 pacemaker-attrd [2409] (attrd_erase_attrs) info: Clearing transient attributes from CIB | xpath=//node_state[@uname='pplxnsms02']/transient_attributes
Oct 08 20:10:01 pplxnsms02 pacemaker-based [2406] (cib_process_request) info: Forwarding cib_delete operation for section //node_state[@uname='pplxnsms02']/transient_attributes to all (origin=local/attrd/2)
Oct 08 20:10:01 pplxnsms02 pacemaker-attrd [2409] (qb_ipcs_us_publish) info: server name: attrd
Oct 08 20:10:01 pplxnsms02 pacemaker-attrd [2409] (main) notice: Pacemaker node attribute manager successfully started and accepting connections
Oct 08 20:10:01 pplxnsms02 pacemaker-based [2406] (cib_process_request) info: Completed cib_delete operation for section //node_state[@uname='pplxnsms02']/transient_attributes: OK (rc=0, origin=pplxnsms02/attrd/2, version=0.524.0)
Oct 08 20:10:01 pplxnsms02 pacemaker-attrd [2409] (pcmk_cpg_membership) info: Group attrd event 0: node 2 pid 2409 joined via cpg_join
Oct 08 20:10:01 pplxnsms02 pacemaker-attrd [2409] (pcmk_cpg_membership) info: Group attrd event 0: pplxnsms02 (node 2 pid 2409) is member
Oct 08 20:10:01 pplxnsms02 pacemaker-attrd [2409] (attrd_peer_update) notice: Setting #attrd-protocol[pplxnsms02]: (unset) -> 3 | from pplxnsms02
Oct 08 20:10:01 pplxnsms02 pacemaker-attrd [2409] (attrd_start_election_if_needed) info: Starting an election to determine the writer
Oct 08 20:10:01 pplxnsms02 pacemaker-attrd [2409] (election_check) info: election-attrd won by local node
Oct 08 20:10:01 pplxnsms02 pacemaker-attrd [2409] (attrd_declare_winner) notice: Recorded local node as attribute writer (was unset)
Oct 08 20:10:01 pplxnsms02 pacemaker-attrd [2409] (write_attribute) info: Processed 1 private change for #attrd-protocol, id=n/a, set=n/a
Oct 08 20:10:01 pplxnsms02 pacemaker-controld [2411] (do_ha_control) info: Connected to the cluster
Oct 08 20:10:01 pplxnsms02 pacemaker-controld [2411] (lrmd_ipc_connect) info: Connecting to executor
Oct 08 20:10:01 pplxnsms02 pacemaker-based [2406] (cib_process_request) info: Forwarding cib_modify operation for section nodes to all (origin=local/crmd/4)
Oct 08 20:10:01 pplxnsms02 pacemaker-based [2406] (cib_process_request) info: Completed cib_modify operation for section nodes: OK (rc=0, origin=pplxnsms02/crmd/4, version=0.524.0)
Oct 08 20:10:01 pplxnsms02 pacemaker-controld [2411] (try_local_executor_connect) info: Connection to the local executor established
Oct 08 20:10:01 pplxnsms02 pacemaker-controld [2411] (do_started) info: Delaying start, no membership data (0000000000100000)
Oct 08 20:10:01 pplxnsms02 pacemaker-controld [2411] (do_started) info: Delaying start, no membership data (0000000000100000)
Oct 08 20:10:01 pplxnsms02 pacemaker-controld [2411] (quorum_notification_cb) info: Quorum still lost | membership=1345 members=1
Oct 08 20:10:01 pplxnsms02 pacemaker-controld [2411] (update_peer_state_iter) notice: Node pplxnsms02 state is now member | nodeid=2 previous=unknown source=quorum_notification_cb
Oct 08 20:10:01 pplxnsms02 pacemaker-controld [2411] (peer_update_callback) info: Cluster node pplxnsms02 is now member (was in unknown state)
Oct 08 20:10:01 pplxnsms02 pacemaker-controld [2411] (pcmk__reap_unseen_nodes) info: State of node pplxnsms01[1] is still unknown
Oct 08 20:10:01 pplxnsms02 pacemaker-controld [2411] (do_started) info: Delaying start, Config not read (0000000000000040)
Oct 08 20:10:01 pplxnsms02 pacemaker-controld [2411] (qb_ipcs_us_publish) info: server name: crmd
Oct 08 20:10:01 pplxnsms02 pacemaker-controld [2411] (do_started) notice: Pacemaker controller successfully started and accepting connections
Oct 08 20:10:01 pplxnsms02 pacemaker-controld [2411] (do_log) info: Input I_PENDING received in state S_STARTING from do_started
Oct 08 20:10:01 pplxnsms02 pacemaker-controld [2411] (do_state_transition) notice: State transition S_STARTING -> S_PENDING | input=I_PENDING cause=C_FSA_INTERNAL origin=do_started
Oct 08 20:10:02 pplxnsms02 pacemaker-fenced [2407] (wait_for_sync_result) info: fence_sbd_metadata_1[2475] exited with status 0
Oct 08 20:10:02 pplxnsms02 pacemaker-fenced [2407] (stonith_device_register) notice: Added 'fence-sbd' to device list (1 active device)
Oct 08 20:10:02 pplxnsms02 pacemaker-controld [2411] (pcmk_cpg_membership) info: Group crmd event 0: node 2 pid 2411 joined via cpg_join
Oct 08 20:10:02 pplxnsms02 pacemaker-controld [2411] (pcmk_cpg_membership) info: Group crmd event 0: pplxnsms02 (node 2 pid 2411) is member
Oct 08 20:10:02 pplxnsms02 pacemaker-controld [2411] (te_trigger_stonith_history_sync) info: Fence history will be synchronized cluster-wide within 30 seconds
Oct 08 20:10:02 pplxnsms02 pacemaker-controld [2411] (te_connect_stonith) notice: Fencer successfully connected
Oct 08 20:10:22 pplxnsms02 pacemaker-controld [2411] (crm_timer_popped) info: Election Trigger just popped | input=I_DC_TIMEOUT time=20000ms
Oct 08 20:10:22 pplxnsms02 pacemaker-controld [2411] (do_log) warning: Input I_DC_TIMEOUT received in state S_PENDING from crm_timer_popped
Oct 08 20:10:22 pplxnsms02 pacemaker-controld [2411] (do_state_transition) info: State transition S_PENDING -> S_ELECTION | input=I_DC_TIMEOUT cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 08 20:10:22 pplxnsms02 pacemaker-controld [2411] (election_check) info: election-DC won by local node
Oct 08 20:10:22 pplxnsms02 pacemaker-controld [2411] (do_log) info: Input I_ELECTION_DC received in state S_ELECTION from election_win_cb
Oct 08 20:10:22 pplxnsms02 pacemaker-controld [2411] (do_state_transition) notice: State transition S_ELECTION -> S_INTEGRATION | input=I_ELECTION_DC cause=C_FSA_INTERNAL origin=election_win_cb
Oct 08 20:10:22 pplxnsms02 pacemaker-controld [2411] (do_te_control) info: Registering TE UUID: 3a484884-3c2f-4db5-824b-4329dc0f3cd6
Oct 08 20:10:22 pplxnsms02 pacemaker-controld [2411] (pcmk__pid_active) info: Could not read from /proc/1637/exe: Permission denied | errno=13
Oct 08 20:10:22 pplxnsms02 pacemaker-controld [2411] (do_dc_takeover) info: Taking over DC status for this partition
Oct 08 20:10:22 pplxnsms02 pacemaker-based [2406] (cib_process_readwrite) info: We are now in R/W mode
Oct 08 20:10:22 pplxnsms02 pacemaker-based [2406] (cib_process_request) info: Completed cib_master operation for section 'all': OK (rc=0, origin=local/crmd/7, version=0.524.0)
Oct 08 20:10:22 pplxnsms02 pacemaker-based [2406] (cib_process_request) info: Forwarding cib_modify operation for section cib to all (origin=local/crmd/8)
Oct 08 20:10:22 pplxnsms02 pacemaker-based [2406] (cib_process_request) info: Completed cib_modify operation for section cib: OK (rc=0, origin=pplxnsms02/crmd/8, version=0.524.0)
Oct 08 20:10:22 pplxnsms02 pacemaker-based [2406] (cib_process_request) info: Forwarding cib_modify operation for section crm_config to all (origin=local/crmd/10)
Oct 08 20:10:22 pplxnsms02 pacemaker-based [2406] (cib_process_request) info: Completed cib_modify operation for section crm_config: OK (rc=0, origin=pplxnsms02/crmd/10, version=0.524.0)
Oct 08 20:10:22 pplxnsms02 pacemaker-based [2406] (cib_process_request) info: Forwarding cib_modify operation for section crm_config to all (origin=local/crmd/12)
Oct 08 20:10:22 pplxnsms02 pacemaker-based [2406] (cib_process_request) info: Completed cib_modify operation for section crm_config: OK (rc=0, origin=pplxnsms02/crmd/12, version=0.524.0)
Oct 08 20:10:22 pplxnsms02 pacemaker-controld [2411] (join_make_offer) info: Not making join-1 offer to inactive node pplxnsms01
Oct 08 20:10:22 pplxnsms02 pacemaker-controld [2411] (join_make_offer) info: Making join-1 offers based on membership event 1345
Oct 08 20:10:22 pplxnsms02 pacemaker-controld [2411] (join_make_offer) info: Sending join-1 offer to pplxnsms02
Oct 08 20:10:22 pplxnsms02 pacemaker-controld [2411] (do_dc_join_offer_all) info: Waiting on join-1 requests from 1 outstanding node
Oct 08 20:10:22 pplxnsms02 pacemaker-controld [2411] (update_dc) info: Set DC to pplxnsms02 (3.13.0)
Oct 08 20:10:22 pplxnsms02 pacemaker-controld [2411] (pcmk__update_peer_expected) info: update_dc: Node pplxnsms02[2] - expected state is now member (was (null))
Oct 08 20:10:22 pplxnsms02 pacemaker-based [2406] (cib_process_request) info: Forwarding cib_modify operation for section crm_config to all (origin=local/crmd/14)
Oct 08 20:10:22 pplxnsms02 pacemaker-based [2406] (cib_process_request) info: Completed cib_modify operation for section crm_config: OK (rc=0, origin=pplxnsms02/crmd/14, version=0.524.0)
Oct 08 20:10:22 pplxnsms02 pacemaker-controld [2411] (stonith__watchdog_fencing_enabled_for_node_api) notice: Cluster does not have watchdog fencing device
Oct 08 20:10:22 pplxnsms02 pacemaker-controld [2411] (do_state_transition) info: State transition S_INTEGRATION -> S_FINALIZE_JOIN | input=I_INTEGRATED cause=C_FSA_INTERNAL origin=check_join_state
Oct 08 20:10:22 pplxnsms02 pacemaker-controld [2411] (controld_delete_node_state) info: Deleting resource history for node pplxnsms02 (via CIB call 19) | xpath=//node_state[@uname='pplxnsms02']/lrm
Oct 08 20:10:22 pplxnsms02 pacemaker-based [2406] (cib_process_replace) info: Digest matched on replace from pplxnsms02: 3ee2a3044e50b4f9747d375984348bab
Oct 08 20:10:22 pplxnsms02 pacemaker-based [2406] (cib_process_replace) info: Replaced 0.524.0 with 0.524.0 from pplxnsms02
Oct 08 20:10:22 pplxnsms02 pacemaker-based [2406] (cib_process_request) info: Completed cib_replace operation for section 'all': OK (rc=0, origin=pplxnsms02/crmd/17, version=0.524.0)
Oct 08 20:10:22 pplxnsms02 pacemaker-based [2406] (cib_process_request) info: Forwarding cib_modify operation for section nodes to all (origin=local/crmd/18)
Oct 08 20:10:22 pplxnsms02 pacemaker-based [2406] (cib_process_request) info: Forwarding cib_delete operation for section //node_state[@uname='pplxnsms02']/lrm to all (origin=local/crmd/19)
Oct 08 20:10:22 pplxnsms02 pacemaker-based [2406] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/20)
Oct 08 20:10:22 pplxnsms02 pacemaker-based [2406] (cib_process_request) info: Completed cib_modify operation for section nodes: OK (rc=0, origin=pplxnsms02/crmd/18, version=0.524.0)
Oct 08 20:10:22 pplxnsms02 pacemaker-based [2406] (cib_process_request) info: Completed cib_delete operation for section //node_state[@uname='pplxnsms02']/lrm: OK (rc=0, origin=pplxnsms02/crmd/19, version=0.524.0)
Oct 08 20:10:22 pplxnsms02 pacemaker-based [2406] (cib_perform_op) info: Diff: --- 0.524.0 2
Oct 08 20:10:22 pplxnsms02 pacemaker-based [2406] (cib_perform_op) info: Diff: +++ 0.524.1 (null)
Oct 08 20:10:22 pplxnsms02 pacemaker-based [2406] (cib_perform_op) info: + /cib: @num_updates=1
Oct 08 20:10:22 pplxnsms02 pacemaker-based [2406] (cib_perform_op) info: ++ /cib/status:
Oct 08 20:10:22 pplxnsms02 pacemaker-based [2406] (cib_perform_op) info: ++
Oct 08 20:10:22 pplxnsms02 pacemaker-based [2406] (cib_perform_op) info: ++
Oct 08 20:10:22 pplxnsms02 pacemaker-based [2406] (cib_perform_op) info: ++
Oct 08 20:10:22 pplxnsms02 pacemaker-based [2406] (cib_perform_op) info: ++
Oct 08 20:10:22 pplxnsms02 pacemaker-based [2406] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/20, version=0.524.1)
Oct 08 20:10:22 pplxnsms02 pacemaker-controld [2411] (do_state_transition) info: State transition S_FINALIZE_JOIN -> S_POLICY_ENGINE | input=I_FINALIZED cause=C_FSA_INTERNAL origin=check_join_state
Oct 08 20:10:22 pplxnsms02 pacemaker-controld [2411] (create_node_state_update) info: Node update for pplxnsms01 cancelled: no state, not seen yet
Oct 08 20:10:22 pplxnsms02 pacemaker-controld [2411] (abort_transition_graph) info: Transition -1 aborted: Quorum lost | source=crm_update_quorum:435 complete=true
Oct 08 20:10:22 pplxnsms02 pacemaker-controld [2411] (abort_transition_graph) info: Transition -1 aborted: Peer Cancelled | source=do_te_invoke:129 complete=true
Oct 08 20:10:22 pplxnsms02 pacemaker-based [2406] (cib_process_request) info: Forwarding cib_modify operation for section nodes to all (origin=local/crmd/23)
Oct 08 20:10:22 pplxnsms02 pacemaker-based [2406] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/24)
Oct 08 20:10:22 pplxnsms02 pacemaker-based [2406] (cib_process_request) info: Forwarding cib_modify operation for section cib to all (origin=local/crmd/25)
Oct 08 20:10:22 pplxnsms02 pacemaker-based [2406] (cib_process_request) info: Completed cib_modify operation for section nodes: OK (rc=0, origin=pplxnsms02/crmd/23, version=0.524.1)
Oct 08 20:10:22 pplxnsms02 pacemaker-based [2406] (cib_perform_op) info: Diff: --- 0.524.1 2
Oct 08 20:10:22 pplxnsms02 pacemaker-based [2406] (cib_perform_op) info: Diff: +++ 0.524.2 (null)
Oct 08 20:10:22 pplxnsms02 pacemaker-based [2406] (cib_perform_op) info: + /cib: @num_updates=2
Oct 08 20:10:22 pplxnsms02 pacemaker-based [2406] (cib_perform_op) info: + /cib/status/node_state[@id='2']: @crm-debug-origin=do_state_transition, @join=member, @expected=member
Oct 08 20:10:22 pplxnsms02 pacemaker-based [2406] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/24, version=0.524.2)
Oct 08 20:10:22 pplxnsms02 pacemaker-based [2406] (cib_perform_op) info: Diff: --- 0.524.2 2
Oct 08 20:10:22 pplxnsms02 pacemaker-based [2406] (cib_perform_op) info: Diff: +++ 0.524.3 (null)
Oct 08 20:10:22 pplxnsms02 pacemaker-based [2406] (cib_perform_op) info: + /cib: @num_updates=3, @have-quorum=0, @dc-uuid=2
Oct 08 20:10:22 pplxnsms02 pacemaker-based [2406] (cib_process_request) info: Completed cib_modify operation for section cib: OK (rc=0, origin=pplxnsms02/crmd/25, version=0.524.3)
Oct 08 20:10:22 pplxnsms02 pacemaker-based [2406] (cib_file_backup) info: Archived previous version as /var/lib/pacemaker/cib/cib-50.raw
Oct 08 20:10:22 pplxnsms02 pacemaker-based [2406] (cib_file_write_with_digest) info: Wrote version 0.524.0 of the CIB to disk (digest: 8d3f2d80d2e53fdaa7947d17e1f8c378)
Oct 08 20:10:22 pplxnsms02 pacemaker-based [2406] (cib_file_write_with_digest) info: Reading cluster configuration file /var/lib/pacemaker/cib/cib.NRCsB5 (digest: /var/lib/pacemaker/cib/cib.LnDDY6)
Oct 08 20:10:23 pplxnsms02 pacemaker-schedulerd[2410] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 08 20:10:23 pplxnsms02 pacemaker-schedulerd[2410] (unpack_config) notice: On loss of quorum: Ignore
Oct 08 20:10:23 pplxnsms02 pacemaker-schedulerd[2410] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 08 20:10:23 pplxnsms02 pacemaker-schedulerd[2410] (determine_online_status) info: Node pplxnsms02 is online
Oct 08 20:10:23 pplxnsms02 pacemaker-schedulerd[2410] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 08 20:10:23 pplxnsms02 pacemaker-schedulerd[2410] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 08 20:10:23 pplxnsms02 pacemaker-schedulerd[2410] (RecurringOp) info: Start recurring monitor (10s) for itm_vip on pplxnsms02
Oct 08 20:10:23 pplxnsms02 pacemaker-schedulerd[2410] (RecurringOp) info: Start recurring monitor (30s) for itm_lvm on pplxnsms02
Oct 08 20:10:23 pplxnsms02 pacemaker-schedulerd[2410] (RecurringOp) info: Start recurring monitor (20s) for itm_fs on pplxnsms02
Oct 08 20:10:23 pplxnsms02 pacemaker-schedulerd[2410] (RecurringOp) info: Start recurring monitor (20s) for itm_fs2 on pplxnsms02
Oct 08 20:10:23 pplxnsms02 pacemaker-schedulerd[2410] (RecurringOp) info: Start recurring monitor (20s) for itm_fs3 on pplxnsms02
Oct 08 20:10:23 pplxnsms02 pacemaker-schedulerd[2410] (RecurringOp) info: Start recurring monitor (20s) for nco_db2 on pplxnsms02
Oct 08 20:10:23 pplxnsms02 pacemaker-schedulerd[2410] (RecurringOp) info: Start recurring monitor (60s) for nco_omni on pplxnsms02
Oct 08 20:10:23 pplxnsms02 pacemaker-schedulerd[2410] (RecurringOp) info: Start recurring monitor (300s) for nco_itnm on pplxnsms02
Oct 08 20:10:23 pplxnsms02 pacemaker-schedulerd[2410] (RecurringOp) info: Start recurring monitor (10s) for nco_cognos on pplxnsms02
Oct 08 20:10:23 pplxnsms02 pacemaker-schedulerd[2410] (RecurringOp) info: Start recurring monitor (10s) for siem_vip on pplxnsms02
Oct 08 20:10:23 pplxnsms02 pacemaker-schedulerd[2410] (RecurringOp) info: Start recurring monitor (30s) for siem_lvm on pplxnsms02
Oct 08 20:10:23 pplxnsms02 pacemaker-schedulerd[2410] (RecurringOp) info: Start recurring monitor (20s) for siem_fs on pplxnsms02
Oct 08 20:10:23 pplxnsms02 pacemaker-schedulerd[2410] (RecurringOp) info: Start recurring monitor (10s) for siem_rsyslog on pplxnsms02
Oct 08 20:10:23 pplxnsms02 pacemaker-schedulerd[2410] (RecurringOp) info: Start recurring monitor (60s) for fence-sbd on pplxnsms02
Oct 08 20:10:23 pplxnsms02 pacemaker-schedulerd[2410] (stage6) warning: Scheduling Node pplxnsms01 for STONITH
Oct 08 20:10:23 pplxnsms02 pacemaker-schedulerd[2410] (log_list_item) notice: Actions: Fence (reboot) pplxnsms01 'node is unclean'
Oct 08 20:10:23 pplxnsms02 pacemaker-schedulerd[2410] (log_list_item) notice: Actions: Start itm_vip ( pplxnsms02 )
Oct 08 20:10:23 pplxnsms02 pacemaker-schedulerd[2410] (log_list_item) notice: Actions: Start itm_lvm ( pplxnsms02 )
Oct 08 20:10:23 pplxnsms02 pacemaker-schedulerd[2410] (log_list_item) notice: Actions: Start itm_fs ( pplxnsms02 )
Oct 08 20:10:23 pplxnsms02 pacemaker-schedulerd[2410] (log_list_item) notice: Actions: Start itm_fs2 ( pplxnsms02 )
Oct 08 20:10:23 pplxnsms02 pacemaker-schedulerd[2410] (log_list_item) notice: Actions: Start itm_fs3 ( pplxnsms02 )
Oct 08 20:10:23 pplxnsms02 pacemaker-schedulerd[2410] (log_list_item) notice: Actions: Start nco_db2 ( pplxnsms02 )
Oct 08 20:10:23 pplxnsms02 pacemaker-schedulerd[2410] (log_list_item) notice: Actions: Start nco_omni ( pplxnsms02 )
Oct 08 20:10:23 pplxnsms02 pacemaker-schedulerd[2410] (log_list_item) notice: Actions: Start nco_itnm ( pplxnsms02 )
Oct 08 20:10:23 pplxnsms02 pacemaker-schedulerd[2410] (log_list_item) notice: Actions: Start nco_cognos ( pplxnsms02 )
Oct 08 20:10:23 pplxnsms02 pacemaker-schedulerd[2410] (log_list_item) notice: Actions: Start siem_vip ( pplxnsms02 )
Oct 08 20:10:23 pplxnsms02 pacemaker-schedulerd[2410] (log_list_item) notice: Actions: Start siem_lvm ( pplxnsms02 )
Oct 08 20:10:23 pplxnsms02 pacemaker-schedulerd[2410] (log_list_item) notice: Actions: Start siem_fs ( pplxnsms02 )
Oct 08 20:10:23 pplxnsms02 pacemaker-schedulerd[2410] (log_list_item) notice: Actions: Start siem_rsyslog ( pplxnsms02 )
Oct 08 20:10:23 pplxnsms02 pacemaker-schedulerd[2410] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 08 20:10:23 pplxnsms02 pacemaker-schedulerd[2410] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 08 20:10:23 pplxnsms02 pacemaker-schedulerd[2410] (log_list_item) notice: Actions: Start fence-sbd ( pplxnsms02 )
Oct 08 20:10:23 pplxnsms02 pacemaker-schedulerd[2410] (pcmk__log_transition_summary) warning: Calculated transition 0 (with warnings), saving inputs in /var/lib/pacemaker/pengine/pe-warn-101.bz2
Oct 08 20:10:23 pplxnsms02 pacemaker-controld [2411] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 08 20:10:23 pplxnsms02 pacemaker-controld [2411] (do_te_invoke) info: Processing graph 0 (ref=pe_calc-dc-1728389423-8) derived from /var/lib/pacemaker/pengine/pe-warn-101.bz2
Oct 08 20:10:23 pplxnsms02 pacemaker-controld [2411] (te_rsc_command) notice: Initiating monitor operation itm_vip_monitor_0 locally on pplxnsms02 | action 1
Oct 08 20:10:23 pplxnsms02 pacemaker-execd [2408] (process_lrmd_get_rsc_info) info: Agent information for 'itm_vip' not in cache
Oct 08 20:10:23 pplxnsms02 pacemaker-execd [2408] (process_lrmd_rsc_register) info: Cached agent information for 'itm_vip'
Oct 08 20:10:23 pplxnsms02 pacemaker-controld [2411] (do_lrm_rsc_op) notice: Requesting local execution of probe operation for itm_vip on pplxnsms02 | transition_key=1:0:7:3a484884-3c2f-4db5-824b-4329dc0f3cd6 op_key=itm_vip_monitor_0
Oct 08 20:10:23 pplxnsms02 pacemaker-controld [2411] (wait_for_sync_result) info: IPaddr2_meta-data_0[4925] exited with status 0
Oct 08 20:10:23 pplxnsms02 pacemaker-based [2406] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/29)
Oct 08 20:10:23 pplxnsms02 pacemaker-based [2406] (cib_perform_op) info: Diff: --- 0.524.3 2
Oct 08 20:10:23 pplxnsms02 pacemaker-based [2406] (cib_perform_op) info: Diff: +++ 0.524.4 (null)
Oct 08 20:10:23 pplxnsms02 pacemaker-based [2406] (cib_perform_op) info: + /cib: @num_updates=4
Oct 08 20:10:23 pplxnsms02 pacemaker-based [2406] (cib_perform_op) info: + /cib/status/node_state[@id='2']: @crm-debug-origin=do_update_resource
Oct 08 20:10:23 pplxnsms02 pacemaker-based [2406] (cib_perform_op) info: ++ /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources:
Oct 08 20:10:23 pplxnsms02 pacemaker-based [2406] (cib_perform_op) info: ++
Oct 08 20:10:23 pplxnsms02 pacemaker-based [2406] (cib_perform_op) info: ++
Oct 08 20:10:24 pplxnsms02 pacemaker-based [2406] (cib_perform_op) info: ++
Oct 08 20:10:24 pplxnsms02 pacemaker-execd [2408] (process_lrmd_get_rsc_info) info: Agent information for 'itm_fs2' not in cache
Oct 08 20:10:24 pplxnsms02 pacemaker-based [2406] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/31, version=0.524.6)
Oct 08 20:10:24 pplxnsms02 pacemaker-execd [2408] (process_lrmd_rsc_register) info: Cached agent information for 'itm_fs2'
Oct 08 20:10:24 pplxnsms02 pacemaker-controld [2411] (do_lrm_rsc_op) notice: Requesting local execution of probe operation for itm_fs2 on pplxnsms02 | transition_key=4:0:7:3a484884-3c2f-4db5-824b-4329dc0f3cd6 op_key=itm_fs2_monitor_0
Oct 08 20:10:24 pplxnsms02 pacemaker-based [2406] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/32)
Oct 08 20:10:24 pplxnsms02 pacemaker-controld [2411] (te_fence_node) notice: Requesting fencing (reboot) of node pplxnsms01 | action=53 timeout=60000
Oct 08 20:10:24 pplxnsms02 pacemaker-controld [2411] (log_executor_event) notice: Result of probe operation for itm_lvm on pplxnsms02: not running | CIB update 33, graph action confirmed; call=9 key=itm_lvm_monitor_0 rc=7
Oct 08 20:10:24 pplxnsms02 pacemaker-controld [2411] (log_executor_event) notice: Result of probe operation for itm_vip on pplxnsms02: not running | CIB update 34, graph action confirmed; call=5 key=itm_vip_monitor_0 rc=7
Oct 08 20:10:24 pplxnsms02 pacemaker-fenced [2407] (handle_request) notice: Client pacemaker-controld.2411 wants to fence (reboot) pplxnsms01 using any device
Oct 08 20:10:24 pplxnsms02 pacemaker-fenced [2407] (initiate_remote_stonith_op) notice: Requesting peer fencing (reboot) targeting pplxnsms01 | id=0be85f16 state=querying base_timeout=60
Oct 08 20:10:24 pplxnsms02 pacemaker-based [2406] (cib_perform_op) info: Diff: --- 0.524.6 2
Oct 08 20:10:24 pplxnsms02 pacemaker-based [2406] (cib_perform_op) info: Diff: +++ 0.524.7 (null)
Oct 08 20:10:24 pplxnsms02 pacemaker-based [2406] (cib_perform_op) info: + /cib: @num_updates=7
Oct 08 20:10:24 pplxnsms02 pacemaker-based [2406] (cib_perform_op) info: ++ /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources:
Oct 08 20:10:24 pplxnsms02 pacemaker-based [2406] (cib_perform_op) info: ++
Oct 08 20:10:24 pplxnsms02 pacemaker-based [2406] (cib_perform_op) info: ++
Oct 08 20:10:24 pplxnsms02 pacemaker-based [2406] (cib_perform_op) info: ++
Oct 08 20:10:24 pplxnsms02 pacemaker-based [2406] (cib_perform_op) info: ++
Oct 08 20:10:24 pplxnsms02 pacemaker-based [2406] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/38, version=0.524.13)
Oct 08 20:10:24 pplxnsms02 pacemaker-controld [2411] (log_executor_event) notice: Result of probe operation for itm_fs3 on pplxnsms02: not running | CIB update 39, graph action confirmed; call=21 key=itm_fs3_monitor_0 rc=7
Oct 08 20:10:24 pplxnsms02 pacemaker-based [2406] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/39)
Oct 08 20:10:24 pplxnsms02 pacemaker-based [2406] (cib_perform_op) info: Diff: --- 0.524.13 2
Oct 08 20:10:24 pplxnsms02 pacemaker-based [2406] (cib_perform_op) info: Diff: +++ 0.524.14 (null)
Oct 08 20:10:24 pplxnsms02 pacemaker-based [2406] (cib_perform_op) info: + /cib: @num_updates=14
Oct 08 20:10:24 pplxnsms02 pacemaker-based [2406] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='itm_fs3']/lrm_rsc_op[@id='itm_fs3_last_0']: @transition-magic=0:7;5:0:7:3a484884-3c2f-4db5-824b-4329dc0f3cd6, @call-id=21, @rc-code=7, @op-status=0, @exec-time=244
Oct 08 20:10:24 pplxnsms02 pacemaker-based [2406] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/39, version=0.524.14)
Oct 08 20:10:24 pplxnsms02 pacemaker-controld [2411] (process_graph_event) info: Transition 0 action 5 (itm_fs3_monitor_0 on pplxnsms02) confirmed: not running | rc=7 call-id=21
Oct 08 20:10:24 pplxnsms02 pacemaker-controld [2411] (te_rsc_command) notice: Initiating monitor operation nco_itnm_monitor_0 locally on pplxnsms02 | action 8
Oct 08 20:10:24 pplxnsms02 pacemaker-execd [2408] (process_lrmd_get_rsc_info) info: Agent information for 'nco_itnm' not in cache
Oct 08 20:10:24 pplxnsms02 pacemaker-execd [2408] (process_lrmd_rsc_register) info: Cached agent information for 'nco_itnm'
Oct 08 20:10:24 pplxnsms02 pacemaker-controld [2411] (do_lrm_rsc_op) notice: Requesting local execution of probe operation for nco_itnm on pplxnsms02 | transition_key=8:0:7:3a484884-3c2f-4db5-824b-4329dc0f3cd6 op_key=nco_itnm_monitor_0
Oct 08 20:10:24 pplxnsms02 pacemaker-controld [2411] (wait_for_sync_result) info: itnm_meta-data_0[5355] exited with status 0
Oct 08 20:10:24 pplxnsms02 pacemaker-based [2406] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/40)
Oct 08 20:10:24 pplxnsms02 pacemaker-controld [2411] (log_executor_event) notice: Result of probe operation for itm_fs on pplxnsms02: not running | CIB update 41, graph action confirmed; call=13 key=itm_fs_monitor_0 rc=7
Oct 08 20:10:24 pplxnsms02 pacemaker-based [2406] (cib_perform_op) info: Diff: --- 0.524.14 2
Oct 08 20:10:24 pplxnsms02 pacemaker-based [2406] (cib_perform_op) info: Diff: +++ 0.524.15 (null)
Oct 08 20:10:24 pplxnsms02 pacemaker-based [2406] (cib_perform_op) info: + /cib: @num_updates=15
Oct 08 20:10:24 pplxnsms02 pacemaker-based [2406] (cib_perform_op) info: ++ /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources:
Oct 08 20:10:24 pplxnsms02 pacemaker-based [2406] (cib_perform_op) info: ++
Oct 08 20:10:24 pplxnsms02 pacemaker-based [2406] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/40, version=0.524.15)
Oct 08 20:10:24 pplxnsms02 pacemaker-based [2406] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/41)
Oct 08 20:10:24 pplxnsms02 pacemaker-based [2406] (cib_perform_op) info: Diff: --- 0.524.15 2
Oct 08 20:10:24 pplxnsms02 pacemaker-based [2406] (cib_perform_op) info: Diff: +++ 0.524.16 (null)
Oct 08 20:10:24 pplxnsms02 pacemaker-based [2406] (cib_perform_op) info: + /cib: @num_updates=16
Oct 08 20:10:24 pplxnsms02 pacemaker-based [2406] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='itm_fs']/lrm_rsc_op[@id='itm_fs_last_0']: @transition-magic=0:7;3:0:7:3a484884-3c2f-4db5-824b-4329dc0f3cd6, @call-id=13, @rc-code=7, @op-status=0, @last-rc-change=1728389424, @exec-time=312
Oct 08 20:10:24 pplxnsms02 pacemaker-based [2406] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/41, version=0.524.16)
Oct 08 20:10:24 pplxnsms02 pacemaker-controld [2411] (process_graph_event) info: Transition 0 action 3 (itm_fs_monitor_0 on pplxnsms02) confirmed: not running | rc=7 call-id=13
Oct 08 20:10:24 pplxnsms02 pacemaker-controld [2411] (te_rsc_command) notice: Initiating monitor operation nco_cognos_monitor_0 locally on pplxnsms02 | action 9
Oct 08 20:10:24 pplxnsms02 pacemaker-execd [2408] (process_lrmd_get_rsc_info) info: Agent information for 'nco_cognos' not in cache
Oct 08 20:10:24 pplxnsms02 pacemaker-execd [2408] (process_lrmd_rsc_register) info: Cached agent information for 'nco_cognos'
Oct 08 20:10:24 pplxnsms02 pacemaker-controld [2411] (do_lrm_rsc_op) notice: Requesting local execution of probe operation for nco_cognos on pplxnsms02 | transition_key=9:0:7:3a484884-3c2f-4db5-824b-4329dc0f3cd6 op_key=nco_cognos_monitor_0
Oct 08 20:10:24 omnibus(nco_omni)[5352]: ERROR: Cannot find the directory /san/tivoli/netcool!
Oct 08 20:10:24 itnm(nco_itnm)[5367]: ERROR: Cannot find the directory /san/tivoli/netcool!
Oct 08 20:10:24 pplxnsms02 pacemaker-controld [2411] (wait_for_sync_result) info: Cognos_meta-data_0[5372] exited with status 0
Oct 08 20:10:24 pplxnsms02 pacemaker-based [2406] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/42)
Oct 08 20:10:24 pplxnsms02 pacemaker-based [2406] (cib_perform_op) info: Diff: --- 0.524.16 2
Oct 08 20:10:24 pplxnsms02 pacemaker-based [2406] (cib_perform_op) info: Diff: +++ 0.524.17 (null)
Oct 08 20:10:24 pplxnsms02 pacemaker-based [2406] (cib_perform_op) info: + /cib: @num_updates=17
Oct 08 20:10:24 pplxnsms02 pacemaker-based [2406] (cib_perform_op) info: ++ /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources:
Oct 08 20:10:24 pplxnsms02 pacemaker-based [2406] (cib_perform_op) info: ++
Oct 08 20:10:24 pplxnsms02 pacemaker-based [2406] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/42, version=0.524.17)
Oct 08 20:10:24 pplxnsms02 pacemaker-controld [2411] (log_executor_event) notice: Result of probe operation for nco_omni on pplxnsms02: not running | CIB update 43, graph action confirmed; call=29 key=nco_omni_monitor_0 rc=7
Oct 08 20:10:24 pplxnsms02 pacemaker-based [2406] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/43)
Oct 08 20:10:24 pplxnsms02 pacemaker-based [2406] (cib_perform_op) info: Diff: --- 0.524.17 2
Oct 08 20:10:24 pplxnsms02 pacemaker-based [2406] (cib_perform_op) info: Diff: +++ 0.524.18 (null)
Oct 08 20:10:24 pplxnsms02 pacemaker-based [2406] (cib_perform_op) info: + /cib: @num_updates=18
Oct 08 20:10:24 pplxnsms02 pacemaker-based [2406] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='nco_omni']/lrm_rsc_op[@id='nco_omni_last_0']: @transition-magic=0:7;7:0:7:3a484884-3c2f-4db5-824b-4329dc0f3cd6, @call-id=29, @rc-code=7, @op-status=0, @exec-time=100
Oct 08 20:10:24 pplxnsms02 pacemaker-based [2406] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/43, version=0.524.18)
Oct 08 20:10:24 pplxnsms02 pacemaker-controld [2411] (process_graph_event) info: Transition 0 action 7 (nco_omni_monitor_0 on pplxnsms02) confirmed: not running | rc=7 call-id=29
Oct 08 20:10:24 pplxnsms02 pacemaker-controld [2411] (te_rsc_command) notice: Initiating monitor operation siem_vip_monitor_0 locally on pplxnsms02 | action 10
Oct 08 20:10:24 pplxnsms02 pacemaker-execd [2408] (process_lrmd_get_rsc_info) info: Agent information for 'siem_vip' not in cache
Oct 08 20:10:24 pplxnsms02 pacemaker-execd [2408] (process_lrmd_rsc_register) info: Cached agent information for 'siem_vip'
Oct 08 20:10:24 pplxnsms02 pacemaker-controld [2411] (do_lrm_rsc_op) notice: Requesting local execution of probe operation for siem_vip on pplxnsms02 | transition_key=10:0:7:3a484884-3c2f-4db5-824b-4329dc0f3cd6 op_key=siem_vip_monitor_0
Oct 08 20:10:24 pplxnsms02 pacemaker-based [2406] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/44)
Oct 08 20:10:24 pplxnsms02 pacemaker-based [2406] (cib_perform_op) info: Diff: --- 0.524.18 2
Oct 08 20:10:24 pplxnsms02 pacemaker-based [2406] (cib_perform_op) info: Diff: +++ 0.524.19 (null)
Oct 08 20:10:24 pplxnsms02 pacemaker-based [2406] (cib_perform_op) info: + /cib: @num_updates=19
Oct 08 20:10:24 pplxnsms02 pacemaker-based [2406] (cib_perform_op) info: ++ /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources:
Oct 08 20:10:24 pplxnsms02 pacemaker-based [2406] (cib_perform_op) info: ++
Oct 08 20:10:24 pplxnsms02 pacemaker-based [2406] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/44, version=0.524.19)
Oct 08 20:10:24 pplxnsms02 pacemaker-controld [2411] (log_executor_event) notice: Result of probe operation for nco_itnm on pplxnsms02: not running | CIB update 45, graph action confirmed; call=33 key=nco_itnm_monitor_0 rc=7
Oct 08 20:10:24 pplxnsms02 pacemaker-based [2406] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/45)
Oct 08 20:10:24 pplxnsms02 pacemaker-based [2406] (cib_perform_op) info: Diff: --- 0.524.19 2
Oct 08 20:10:24 pplxnsms02 pacemaker-based [2406] (cib_perform_op) info: Diff: +++ 0.524.20 (null)
Oct 08 20:10:24 pplxnsms02 pacemaker-based [2406] (cib_perform_op) info: + /cib: @num_updates=20
Oct 08 20:10:24 pplxnsms02 pacemaker-based [2406] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='nco_itnm']/lrm_rsc_op[@id='nco_itnm_last_0']: @transition-magic=0:7;8:0:7:3a484884-3c2f-4db5-824b-4329dc0f3cd6, @call-id=33, @rc-code=7, @op-status=0, @exec-time=83
Oct 08 20:10:24 pplxnsms02 pacemaker-based [2406] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/45, version=0.524.20)
Oct 08 20:10:24 pplxnsms02 pacemaker-controld [2411] (process_graph_event) info: Transition 0 action 8 (nco_itnm_monitor_0 on pplxnsms02) confirmed: not running | rc=7 call-id=33
Oct 08 20:10:24 pplxnsms02 pacemaker-controld [2411] (te_rsc_command) notice: Initiating monitor operation siem_lvm_monitor_0 locally on pplxnsms02 | action 11
Oct 08 20:10:24 pplxnsms02 pacemaker-execd [2408] (process_lrmd_get_rsc_info) info: Agent information for 'siem_lvm' not in cache
Oct 08 20:10:24 pplxnsms02 pacemaker-execd [2408] (process_lrmd_rsc_register) info: Cached agent information for 'siem_lvm'
Oct 08 20:10:24 pplxnsms02 pacemaker-controld [2411] (do_lrm_rsc_op) notice: Requesting local execution of probe operation for siem_lvm on pplxnsms02 | transition_key=11:0:7:3a484884-3c2f-4db5-824b-4329dc0f3cd6 op_key=siem_lvm_monitor_0
Oct 08 20:10:24 pplxnsms02 pacemaker-based [2406] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/46)
Oct 08 20:10:24 pplxnsms02 pacemaker-based [2406] (cib_perform_op) info: Diff: --- 0.524.20 2
Oct 08 20:10:24 pplxnsms02 pacemaker-based [2406] (cib_perform_op) info: Diff: +++ 0.524.21 (null)
Oct 08 20:10:24 pplxnsms02 pacemaker-based [2406] (cib_perform_op) info: + /cib: @num_updates=21
Oct 08 20:10:24 pplxnsms02 pacemaker-based [2406] (cib_perform_op) info: ++ /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources:
Oct 08 20:10:24 pplxnsms02 pacemaker-based [2406] (cib_perform_op) info: ++
Oct 08 20:10:24 pplxnsms02 pacemaker-based [2406] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/46, version=0.524.21)
Oct 08 20:10:24 Cognos(nco_cognos)[5392]: ERROR: Cannot find the directory /san/tivoli/IBM/WebSphere!
Oct 08 20:10:24 pplxnsms02 pacemaker-controld [2411] (log_executor_event) notice: Result of probe operation for siem_lvm on pplxnsms02: not running | CIB update 47, graph action confirmed; call=45 key=siem_lvm_monitor_0 rc=7
Oct 08 20:10:24 pplxnsms02 pacemaker-based [2406] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/47)
Oct 08 20:10:24 pplxnsms02 pacemaker-based [2406] (cib_perform_op) info: Diff: --- 0.524.21 2
Oct 08 20:10:24 pplxnsms02 pacemaker-based [2406] (cib_perform_op) info: Diff: +++ 0.524.22 (null)
Oct 08 20:10:24 pplxnsms02 pacemaker-based [2406] (cib_perform_op) info: + /cib: @num_updates=22
Oct 08 20:10:24 pplxnsms02 pacemaker-based [2406] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='siem_lvm']/lrm_rsc_op[@id='siem_lvm_last_0']: @transition-magic=0:7;11:0:7:3a484884-3c2f-4db5-824b-4329dc0f3cd6, @call-id=45, @rc-code=7, @op-status=0, @exec-time=18
Oct 08 20:10:24 pplxnsms02 pacemaker-based [2406] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/47, version=0.524.22)
Oct 08 20:10:24 pplxnsms02 pacemaker-controld [2411] (process_graph_event) info: Transition 0 action 11 (siem_lvm_monitor_0 on pplxnsms02) confirmed: not running | rc=7 call-id=45
Oct 08 20:10:24 pplxnsms02 pacemaker-controld [2411] (te_rsc_command) notice: Initiating monitor operation siem_fs_monitor_0 locally on pplxnsms02 | action 12
Oct 08 20:10:24 pplxnsms02 pacemaker-execd [2408] (process_lrmd_get_rsc_info) info: Agent information for 'siem_fs' not in cache
Oct 08 20:10:24 pplxnsms02 pacemaker-execd [2408] (process_lrmd_rsc_register) info: Cached agent information for 'siem_fs'
Oct 08 20:10:24 pplxnsms02 pacemaker-controld [2411] (do_lrm_rsc_op) notice: Requesting local execution of probe operation for siem_fs on pplxnsms02 | transition_key=12:0:7:3a484884-3c2f-4db5-824b-4329dc0f3cd6 op_key=siem_fs_monitor_0
Oct 08 20:10:24 pplxnsms02 pacemaker-based [2406] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/48)
Oct 08 20:10:24 pplxnsms02 pacemaker-based [2406] (cib_perform_op) info: Diff: --- 0.524.22 2
Oct 08 20:10:24 pplxnsms02 pacemaker-based [2406] (cib_perform_op) info: Diff: +++ 0.524.23 (null)
Oct 08 20:10:24 pplxnsms02 pacemaker-based [2406] (cib_perform_op) info: + /cib: @num_updates=23
Oct 08 20:10:24 pplxnsms02 pacemaker-based [2406] (cib_perform_op) info: ++ /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources:
Oct 08 20:10:24 pplxnsms02 pacemaker-based [2406] (cib_perform_op) info: ++
Oct 08 20:10:24 pplxnsms02 pacemaker-based [2406] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/48, version=0.524.23)
Oct 08 20:10:24 pplxnsms02 pacemaker-controld [2411] (log_executor_event) notice: Result of probe operation for nco_cognos on pplxnsms02: not running | CIB update 49, graph action confirmed; call=37 key=nco_cognos_monitor_0 rc=7
Oct 08 20:10:24 pplxnsms02 pacemaker-based [2406] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/49)
Oct 08 20:10:24 pplxnsms02 pacemaker-based [2406] (cib_perform_op) info: Diff: --- 0.524.23 2
Oct 08 20:10:24 pplxnsms02 pacemaker-based [2406] (cib_perform_op) info: Diff: +++ 0.524.24 (null)
Oct 08 20:10:24 pplxnsms02 pacemaker-based [2406] (cib_perform_op) info: + /cib: @num_updates=24
Oct 08 20:10:24 pplxnsms02 pacemaker-based [2406] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='nco_cognos']/lrm_rsc_op[@id='nco_cognos_last_0']: @transition-magic=0:7;9:0:7:3a484884-3c2f-4db5-824b-4329dc0f3cd6, @call-id=37, @rc-code=7, @op-status=0, @exec-time=83
Oct 08 20:10:24 pplxnsms02 pacemaker-based [2406] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/49, version=0.524.24)
Oct 08 20:10:24 pplxnsms02 pacemaker-controld [2411] (process_graph_event) info: Transition 0 action 9 (nco_cognos_monitor_0 on pplxnsms02) confirmed: not running | rc=7 call-id=37
Oct 08 20:10:24 pplxnsms02 pacemaker-controld [2411] (te_rsc_command) notice: Initiating monitor operation siem_rsyslog_monitor_0 locally on pplxnsms02 | action 13
Oct 08 20:10:24 pplxnsms02 pacemaker-execd [2408] (process_lrmd_get_rsc_info) info: Agent information for 'siem_rsyslog' not in cache
Oct 08 20:10:24 pplxnsms02 pacemaker-execd [2408] (process_lrmd_rsc_register) info: Cached agent information for 'siem_rsyslog'
Oct 08 20:10:24 pplxnsms02 pacemaker-controld [2411] (do_lrm_rsc_op) notice: Requesting local execution of probe operation for siem_rsyslog on pplxnsms02 | transition_key=13:0:7:3a484884-3c2f-4db5-824b-4329dc0f3cd6 op_key=siem_rsyslog_monitor_0
Oct 08 20:10:24 pplxnsms02 pacemaker-controld [2411] (wait_for_sync_result) info: siemsyslog_meta-data_0[5425] exited with status 0
Oct 08 20:10:24 pplxnsms02 pacemaker-based [2406] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/50)
Oct 08 20:10:24 pplxnsms02 pacemaker-based [2406] (cib_perform_op) info: Diff: --- 0.524.24 2
Oct 08 20:10:24 pplxnsms02 pacemaker-based [2406] (cib_perform_op) info: Diff: +++ 0.524.25 (null)
Oct 08 20:10:24 pplxnsms02 pacemaker-based [2406] (cib_perform_op) info: + /cib: @num_updates=25
Oct 08 20:10:24 pplxnsms02 pacemaker-based [2406] (cib_perform_op) info: ++ /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources:
Oct 08 20:10:24 pplxnsms02 pacemaker-based [2406] (cib_perform_op) info: ++
Oct 08 20:10:24 pplxnsms02 pacemaker-based [2406] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/50, version=0.524.25)
Oct 08 20:10:24 pplxnsms02 pacemaker-controld [2411] (log_executor_event) notice: Result of probe operation for siem_vip on pplxnsms02: not running | CIB update 51, graph action confirmed; call=41 key=siem_vip_monitor_0 rc=7
Oct 08 20:10:24 pplxnsms02 pacemaker-based [2406] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/51)
Oct 08 20:10:24 pplxnsms02 pacemaker-based [2406] (cib_perform_op) info: Diff: --- 0.524.25 2
Oct 08 20:10:24 pplxnsms02 pacemaker-based [2406] (cib_perform_op) info: Diff: +++ 0.524.26 (null)
Oct 08 20:10:24 pplxnsms02 pacemaker-based [2406] (cib_perform_op) info: + /cib: @num_updates=26
Oct 08 20:10:24 pplxnsms02 pacemaker-based [2406] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='siem_vip']/lrm_rsc_op[@id='siem_vip_last_0']: @transition-magic=0:7;10:0:7:3a484884-3c2f-4db5-824b-4329dc0f3cd6, @call-id=41, @rc-code=7, @op-status=0, @exec-time=217
Oct 08 20:10:24 pplxnsms02 pacemaker-execd [2408] (log_op_output) info: siem_rsyslog_monitor_0[5466] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 3317 1 0 20:10 ? 00:00:00 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:10:24 pplxnsms02 pacemaker-controld [2411] (log_executor_event) notice: Result of probe operation for siem_rsyslog on pplxnsms02: not running | CIB update 52, graph action confirmed; call=53 key=siem_rsyslog_monitor_0 rc=7
Oct 08 20:10:24 pplxnsms02 pacemaker-controld [2411] (log_executor_event) notice: siem_rsyslog_monitor_0@pplxnsms02 output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 3317 1 0 20:10 ? 00:00:00 /usr/sbin/rsyslogd -n: integer expression expected\n ]
Oct 08 20:10:24 pplxnsms02 pacemaker-based [2406] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/51, version=0.524.26)
Oct 08 20:10:24 pplxnsms02 pacemaker-based [2406] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/52)
Oct 08 20:10:24 pplxnsms02 pacemaker-controld [2411] (process_graph_event) info: Transition 0 action 10 (siem_vip_monitor_0 on pplxnsms02) confirmed: not running | rc=7 call-id=41
Oct 08 20:10:24 pplxnsms02 pacemaker-controld [2411] (te_rsc_command) notice: Initiating monitor operation web_mariadb_monitor_0 locally on pplxnsms02 | action 14
Oct 08 20:10:24 pplxnsms02 pacemaker-execd [2408] (process_lrmd_get_rsc_info) info: Agent information for 'web_mariadb' not in cache
Oct 08 20:10:24 pplxnsms02 pacemaker-execd [2408] (process_lrmd_rsc_register) info: Cached agent information for 'web_mariadb'
Oct 08 20:10:24 pplxnsms02 pacemaker-controld [2411] (do_lrm_rsc_op) notice: Requesting local execution of probe operation for web_mariadb on pplxnsms02 | transition_key=14:0:7:3a484884-3c2f-4db5-824b-4329dc0f3cd6 op_key=web_mariadb_monitor_0
Oct 08 20:10:24 pplxnsms02 pacemaker-based [2406] (cib_perform_op) info: Diff: --- 0.524.26 2
Oct 08 20:10:24 pplxnsms02 pacemaker-based [2406] (cib_perform_op) info: Diff: +++ 0.524.27 (null)
Oct 08 20:10:24 pplxnsms02 pacemaker-based [2406] (cib_perform_op) info: + /cib: @num_updates=27
Oct 08 20:10:24 pplxnsms02 pacemaker-based [2406] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='siem_rsyslog']/lrm_rsc_op[@id='siem_rsyslog_last_0']: @transition-magic=0:7;13:0:7:3a484884-3c2f-4db5-824b-4329dc0f3cd6, @call-id=53, @rc-code=7, @op-status=0, @exec-time=75
Oct 08 20:10:24 pplxnsms02 pacemaker-based [2406] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/52, version=0.524.27)
Oct 08 20:10:24 Filesystem(siem_fs)[5416]: WARNING: Couldn't find device [/dev/vgslog/lv_log01]. Expected /dev/??? to exist
Oct 08 20:10:24 pplxnsms02 pacemaker-controld [2411] (wait_for_sync_result) info: mysql_meta-data_0[5536] exited with status 0
Oct 08 20:10:24 pplxnsms02 pacemaker-based [2406] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/53)
Oct 08 20:10:24 pplxnsms02 pacemaker-controld [2411] (process_graph_event) info: Transition 0 action 13 (siem_rsyslog_monitor_0 on pplxnsms02) confirmed: not running | rc=7 call-id=53
Oct 08 20:10:24 pplxnsms02 pacemaker-controld [2411] (te_rsc_command) notice: Initiating monitor operation web_matomo_monitor_0 locally on pplxnsms02 | action 15
Oct 08 20:10:24 pplxnsms02 pacemaker-based [2406] (cib_perform_op) info: Diff: --- 0.524.27 2
Oct 08 20:10:24 pplxnsms02 pacemaker-based [2406] (cib_perform_op) info: Diff: +++ 0.524.28 (null)
Oct 08 20:10:24 pplxnsms02 pacemaker-based [2406] (cib_perform_op) info: + /cib: @num_updates=28
Oct 08 20:10:24 pplxnsms02 pacemaker-based [2406] (cib_perform_op) info: ++ /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources:
Oct 08 20:10:24 pplxnsms02 pacemaker-based [2406] (cib_perform_op) info: ++
Oct 08 20:10:24 pplxnsms02 pacemaker-execd [2408] (process_lrmd_get_rsc_info) info: Agent information for 'web_matomo' not in cache
Oct 08 20:10:24 pplxnsms02 pacemaker-based [2406] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/53, version=0.524.28)
Oct 08 20:10:24 pplxnsms02 pacemaker-execd [2408] (process_lrmd_rsc_register) info: Cached agent information for 'web_matomo'
Oct 08 20:10:24 pplxnsms02 pacemaker-controld [2411] (do_lrm_rsc_op) notice: Requesting local execution of probe operation for web_matomo on pplxnsms02 | transition_key=15:0:7:3a484884-3c2f-4db5-824b-4329dc0f3cd6 op_key=web_matomo_monitor_0
Oct 08 20:10:24 pplxnsms02 pacemaker-controld [2411] (wait_for_sync_result) info: apache_meta-data_0[5717] exited with status 0
Oct 08 20:10:24 pplxnsms02 pacemaker-based [2406] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/54)
Oct 08 20:10:24 pplxnsms02 pacemaker-controld [2411] (log_executor_event) notice: Result of probe operation for siem_fs on pplxnsms02: not running | CIB update 55, graph action confirmed; call=49 key=siem_fs_monitor_0 rc=7
Oct 08 20:10:24 pplxnsms02 pacemaker-based [2406] (cib_perform_op) info: Diff: --- 0.524.28 2
Oct 08 20:10:24 pplxnsms02 pacemaker-based [2406] (cib_perform_op) info: Diff: +++ 0.524.29 (null)
Oct 08 20:10:24 pplxnsms02 pacemaker-based [2406] (cib_perform_op) info: + /cib: @num_updates=29
Oct 08 20:10:24 pplxnsms02 pacemaker-based [2406] (cib_perform_op) info: ++ /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources:
Oct 08 20:10:24 pplxnsms02 pacemaker-based [2406] (cib_perform_op) info: ++
Oct 08 20:10:24 pplxnsms02 pacemaker-based [2406] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/54, version=0.524.29)
Oct 08 20:10:24 pplxnsms02 pacemaker-based [2406] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/55)
Oct 08 20:10:24 pplxnsms02 pacemaker-based [2406] (cib_perform_op) info: Diff: --- 0.524.29 2
Oct 08 20:10:24 pplxnsms02 pacemaker-based [2406] (cib_perform_op) info: Diff: +++ 0.524.30 (null)
Oct 08 20:10:24 pplxnsms02 pacemaker-based [2406] (cib_perform_op) info: + /cib: @num_updates=30
Oct 08 20:10:24 pplxnsms02 pacemaker-based [2406] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='siem_fs']/lrm_rsc_op[@id='siem_fs_last_0']: @transition-magic=0:7;12:0:7:3a484884-3c2f-4db5-824b-4329dc0f3cd6, @call-id=49, @rc-code=7, @op-status=0, @exec-time=452
Oct 08 20:10:24 pplxnsms02 pacemaker-based [2406] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/55, version=0.524.30)
Oct 08 20:10:24 pplxnsms02 pacemaker-controld [2411] (process_graph_event) info: Transition 0 action 12 (siem_fs_monitor_0 on pplxnsms02) confirmed: not running | rc=7 call-id=49
Oct 08 20:10:24 pplxnsms02 pacemaker-controld [2411] (te_rsc_command) notice: Initiating monitor operation fence-sbd_monitor_0 locally on pplxnsms02 | action 16
Oct 08 20:10:24 pplxnsms02 pacemaker-execd [2408] (process_lrmd_get_rsc_info) info: Agent information for 'fence-sbd' not in cache
Oct 08 20:10:24 pplxnsms02 pacemaker-execd [2408] (process_lrmd_rsc_register) info: Cached agent information for 'fence-sbd'
Oct 08 20:10:24 pplxnsms02 pacemaker-controld [2411] (do_lrm_rsc_op) notice: Requesting local execution of probe operation for fence-sbd on pplxnsms02 | transition_key=16:0:7:3a484884-3c2f-4db5-824b-4329dc0f3cd6 op_key=fence-sbd_monitor_0
Oct 08 20:10:25 pplxnsms02 pacemaker-fenced [2407] (dynamic_list_search_cb) info: Refreshing target list for fence-sbd
Oct 08 20:10:25 pplxnsms02 pacemaker-fenced [2407] (process_remote_stonith_query) info: Query result 1 of 1 from pplxnsms02 for pplxnsms01/reboot (1 device) 0be85f16-67a1-4237-ace2-64b0b12eedba
Oct 08 20:10:25 pplxnsms02 pacemaker-fenced [2407] (process_remote_stonith_query) info: All query replies have arrived, continuing (1 expected/1 received)
Oct 08 20:10:25 pplxnsms02 pacemaker-fenced [2407] (request_peer_fencing) info: Total timeout set to 60 for peer's fencing targeting pplxnsms01 for pacemaker-controld.2411|id=0be85f16
Oct 08 20:10:25 pplxnsms02 pacemaker-fenced [2407] (request_peer_fencing) notice: Requesting that pplxnsms02 perform 'reboot' action targeting pplxnsms01 | for client pacemaker-controld.2411 (72s, 0s)
Oct 08 20:10:25 pplxnsms02 pacemaker-fenced [2407] (can_fence_host_with_device) notice: fence-sbd is eligible to fence (reboot) pplxnsms01: dynamic-list
Oct 08 20:10:25 pplxnsms02 pacemaker-fenced [2407] (stonith_fence_get_devices_cb) info: Found 1 matching device for target 'pplxnsms01'
Oct 08 20:10:25 pplxnsms02 pacemaker-controld [2411] (wait_for_sync_result) info: fence_sbd_metadata_1[5804] exited with status 0
Oct 08 20:10:25 pplxnsms02 pacemaker-based [2406] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/56)
Oct 08 20:10:25 pplxnsms02 pacemaker-based [2406] (cib_perform_op) info: Diff: --- 0.524.30 2
Oct 08 20:10:25 pplxnsms02 pacemaker-based [2406] (cib_perform_op) info: Diff: +++ 0.524.31 (null)
Oct 08 20:10:25 pplxnsms02 pacemaker-based [2406] (cib_perform_op) info: + /cib: @num_updates=31
Oct 08 20:10:25 pplxnsms02 pacemaker-based [2406] (cib_perform_op) info: ++ /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources:
Oct 08 20:10:25 pplxnsms02 pacemaker-based [2406] (cib_perform_op) info: ++
Oct 08 20:10:25 pplxnsms02 pacemaker-based [2406] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/56, version=0.524.31)
Oct 08 20:10:25 pplxnsms02 pacemaker-controld [2411] (log_executor_event) notice: Result of probe operation for fence-sbd on pplxnsms02: not running | CIB update 57, graph action confirmed; call=65 key=fence-sbd_monitor_0 rc=7
Oct 08 20:10:25 pplxnsms02 pacemaker-based [2406] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/57)
Oct 08 20:10:25 pplxnsms02 pacemaker-based [2406] (cib_perform_op) info: Diff: --- 0.524.31 2
Oct 08 20:10:25 pplxnsms02 pacemaker-based [2406] (cib_perform_op) info: Diff: +++ 0.524.32 (null)
Oct 08 20:10:25 pplxnsms02 pacemaker-based [2406] (cib_perform_op) info: + /cib: @num_updates=32
Oct 08 20:10:25 pplxnsms02 pacemaker-based [2406] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='fence-sbd']/lrm_rsc_op[@id='fence-sbd_last_0']: @transition-magic=0:7;16:0:7:3a484884-3c2f-4db5-824b-4329dc0f3cd6, @call-id=65, @rc-code=7, @op-status=0, @last-rc-change=1728389425, @exec-time=4
Oct 08 20:10:25 pplxnsms02 pacemaker-based [2406] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/57, version=0.524.32)
Oct 08 20:10:25 pplxnsms02 pacemaker-controld [2411] (process_graph_event) info: Transition 0 action 16 (fence-sbd_monitor_0 on pplxnsms02) confirmed: not running | rc=7 call-id=65
Oct 08 20:10:25 mysql(web_mariadb)[5714]: ERROR: Datadir /siemlog/mysql doesn't exist
Oct 08 20:10:25 mysql(web_mariadb)[5714]: INFO: MySQL is not running
Oct 08 20:10:25 pplxnsms02 pacemaker-execd [2408] (log_op_output) info: web_mariadb_monitor_0[5714] error output [ ocf-exit-reason:Datadir /siemlog/mysql doesn't exist ]
Oct 08 20:10:25 pplxnsms02 pacemaker-controld [2411] (log_executor_event) notice: Result of probe operation for web_mariadb on pplxnsms02: not running (Datadir /siemlog/mysql doesn't exist) | CIB update 58, graph action confirmed; call=57 key=web_mariadb_monitor_0 rc=7
Oct 08 20:10:25 pplxnsms02 pacemaker-controld [2411] (log_executor_event) notice: web_mariadb_monitor_0@pplxnsms02 output [ ocf-exit-reason:Datadir /siemlog/mysql doesn't exist\n ]
Oct 08 20:10:25 pplxnsms02 pacemaker-based [2406] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/58)
Oct 08 20:10:25 pplxnsms02 pacemaker-based [2406] (cib_perform_op) info: Diff: --- 0.524.32 2
Oct 08 20:10:25 pplxnsms02 pacemaker-based [2406] (cib_perform_op) info: Diff: +++ 0.524.33 (null)
Oct 08 20:10:25 pplxnsms02 pacemaker-based [2406] (cib_perform_op) info: + /cib: @num_updates=33
Oct 08 20:10:25 pplxnsms02 pacemaker-based [2406] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='web_mariadb']/lrm_rsc_op[@id='web_mariadb_last_0']: @transition-magic=0:7;14:0:7:3a484884-3c2f-4db5-824b-4329dc0f3cd6, @call-id=57, @rc-code=7, @op-status=0, @exec-time=225
Oct 08 20:10:25 pplxnsms02 pacemaker-based [2406] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/58, version=0.524.33)
Oct 08 20:10:25 pplxnsms02 pacemaker-controld [2411] (process_graph_event) info: Transition 0 action 14 (web_mariadb_monitor_0 on pplxnsms02) confirmed: not running | rc=7 call-id=57
Oct 08 20:10:25 apache(web_matomo)[5801]: INFO: apache not running
Oct 08 20:10:25 pplxnsms02 pacemaker-controld [2411] (log_executor_event) notice: Result of probe operation for web_matomo on pplxnsms02: not running | CIB update 59, graph action confirmed; call=61 key=web_matomo_monitor_0 rc=7
Oct 08 20:10:25 pplxnsms02 pacemaker-based [2406] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/59)
Oct 08 20:10:25 pplxnsms02 pacemaker-based [2406] (cib_perform_op) info: Diff: --- 0.524.33 2
Oct 08 20:10:25 pplxnsms02 pacemaker-based [2406] (cib_perform_op) info: Diff: +++ 0.524.34 (null)
Oct 08 20:10:25 pplxnsms02 pacemaker-based [2406] (cib_perform_op) info: + /cib: @num_updates=34
Oct 08 20:10:25 pplxnsms02 pacemaker-based [2406] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='web_matomo']/lrm_rsc_op[@id='web_matomo_last_0']: @transition-magic=0:7;15:0:7:3a484884-3c2f-4db5-824b-4329dc0f3cd6, @call-id=61, @rc-code=7, @op-status=0, @exec-time=213
Oct 08 20:10:25 pplxnsms02 pacemaker-based [2406] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/59, version=0.524.34)
Oct 08 20:10:25 pplxnsms02 pacemaker-controld [2411] (process_graph_event) info: Transition 0 action 15 (web_matomo_monitor_0 on pplxnsms02) confirmed: not running | rc=7 call-id=61
Oct 08 20:10:26 pplxnsms02 pacemaker-based [2406] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/60)
Oct 08 20:10:26 pplxnsms02 pacemaker-controld [2411] (log_executor_event) notice: Result of probe operation for nco_db2 on pplxnsms02: not running | CIB update 60, graph action confirmed; call=25 key=nco_db2_monitor_0 rc=7
Oct 08 20:10:26 pplxnsms02 pacemaker-based [2406] (cib_perform_op) info: Diff: --- 0.524.34 2
Oct 08 20:10:26 pplxnsms02 pacemaker-based [2406] (cib_perform_op) info: Diff: +++ 0.524.35 (null)
Oct 08 20:10:26 pplxnsms02 pacemaker-based [2406] (cib_perform_op) info: + /cib: @num_updates=35
Oct 08 20:10:26 pplxnsms02 pacemaker-based [2406] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='nco_db2']/lrm_rsc_op[@id='nco_db2_last_0']: @transition-magic=0:7;6:0:7:3a484884-3c2f-4db5-824b-4329dc0f3cd6, @call-id=25, @rc-code=7, @op-status=0, @exec-time=2547
Oct 08 20:10:26 pplxnsms02 pacemaker-based [2406] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/60, version=0.524.35)
Oct 08 20:10:26 pplxnsms02 pacemaker-controld [2411] (process_graph_event) info: Transition 0 action 6 (nco_db2_monitor_0 on pplxnsms02) confirmed: not running | rc=7 call-id=25
Oct 08 20:10:31 pplxnsms02 pacemaker-based [2406] (cib_process_ping) info: Reporting our current digest to pplxnsms02: fcd447a8cc4b107d9a72df2180f375dc for 0.524.35 (0x55cbc0bef800 0)
Oct 08 20:10:31 pplxnsms02 pacemaker-controld [2411] (pcmk__procfs_pid_of) info: Found pacemaker-based active as process 2406
Oct 08 20:10:31 pplxnsms02 pacemaker-controld [2411] (throttle_send_command) info: New throttle mode: low load (was undetermined)
Oct 08 20:10:45 pplxnsms02 pacemaker-fenced [2407] (log_async_result) notice: Operation 'reboot' [5814] targeting pplxnsms01 using fence-sbd returned 0 | call 4 from pacemaker-controld.2411
Oct 08 20:10:45 pplxnsms02 pacemaker-fenced [2407] (finalize_op) notice: Operation 'reboot' targeting pplxnsms01 by pplxnsms02 for pacemaker-controld.2411@pplxnsms02: OK (complete) | id=0be85f16
Oct 08 20:10:45 pplxnsms02 pacemaker-controld [2411] (tengine_stonith_callback) notice: Fence operation 4 for pplxnsms01 passed
Oct 08 20:10:45 pplxnsms02 pacemaker-controld [2411] (update_peer_state_iter) notice: Node pplxnsms01 state is now lost | nodeid=1 previous=unknown source=crmd_peer_down
Oct 08 20:10:45 pplxnsms02 pacemaker-controld [2411] (peer_update_callback) info: Cluster node pplxnsms01 is now lost (was in unknown state)
Oct 08 20:10:45 pplxnsms02 pacemaker-controld [2411] (crm_update_peer_proc) info: crmd_peer_down: Node pplxnsms01[1] - all processes are now offline
Oct 08 20:10:45 pplxnsms02 pacemaker-controld [2411] (peer_update_callback) info: Node pplxnsms01 is no longer a peer | DC=true old=0x0000000 new=0x0000001
Oct 08 20:10:45 pplxnsms02 pacemaker-controld [2411] (pcmk__update_peer_expected) info: crmd_peer_down: Node pplxnsms01[1] - expected state is now down (was (null))
Oct 08 20:10:45 pplxnsms02 pacemaker-controld [2411] (controld_delete_node_state) info: Deleting all state for node pplxnsms01 (via CIB call 63) | xpath=//node_state[@uname='pplxnsms01']/*
Oct 08 20:10:45 pplxnsms02 pacemaker-controld [2411] (handle_fence_notification) notice: Peer pplxnsms01 was terminated (reboot) by pplxnsms02 on behalf of pacemaker-controld.2411@pplxnsms02: OK | event=0be85f16-67a1-4237-ace2-64b0b12eedba
Oct 08 20:10:45 pplxnsms02 pacemaker-controld [2411] (controld_delete_node_state) info: Deleting all state for node pplxnsms01 (via CIB call 65) | xpath=//node_state[@uname='pplxnsms01']/*
Oct 08 20:10:45 pplxnsms02 pacemaker-based [2406] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/61)
Oct 08 20:10:45 pplxnsms02 pacemaker-controld [2411] (te_rsc_command) notice: Initiating start operation itm_vip_start_0 locally on pplxnsms02 | action 17
Oct 08 20:10:45 pplxnsms02 pacemaker-controld [2411] (do_lrm_rsc_op) notice: Requesting local execution of start operation for itm_vip on pplxnsms02 | transition_key=17:0:0:3a484884-3c2f-4db5-824b-4329dc0f3cd6 op_key=itm_vip_start_0
Oct 08 20:10:45 pplxnsms02 pacemaker-execd [2408] (log_execute) info: executing - rsc:itm_vip action:start call_id:66
Oct 08 20:10:45 pplxnsms02 pacemaker-based [2406] (cib_perform_op) info: Diff: --- 0.524.35 2
Oct 08 20:10:45 pplxnsms02 pacemaker-based [2406] (cib_perform_op) info: Diff: +++ 0.524.36 (null)
Oct 08 20:10:45 pplxnsms02 pacemaker-based [2406] (cib_perform_op) info: + /cib: @num_updates=36
Oct 08 20:10:45 pplxnsms02 pacemaker-based [2406] (cib_perform_op) info: ++ /cib/status:
Oct 08 20:10:45 pplxnsms02 pacemaker-controld [2411] (te_rsc_command) notice: Initiating start operation siem_vip_start_0 locally on pplxnsms02 | action 39
Oct 08 20:10:45 pplxnsms02 pacemaker-controld [2411] (do_lrm_rsc_op) notice: Requesting local execution of start operation for siem_vip on pplxnsms02 | transition_key=39:0:0:3a484884-3c2f-4db5-824b-4329dc0f3cd6 op_key=siem_vip_start_0
Oct 08 20:10:45 pplxnsms02 pacemaker-based [2406] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/61, version=0.524.36)
Oct 08 20:10:45 pplxnsms02 pacemaker-based [2406] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/62)
Oct 08 20:10:45 pplxnsms02 pacemaker-based [2406] (cib_process_request) info: Forwarding cib_delete operation for section //node_state[@uname='pplxnsms01']/* to all (origin=local/crmd/63)
Oct 08 20:10:45 pplxnsms02 pacemaker-based [2406] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/64)
Oct 08 20:10:45 pplxnsms02 pacemaker-based [2406] (cib_process_request) info: Forwarding cib_delete operation for section //node_state[@uname='pplxnsms01']/* to all (origin=local/crmd/65)
Oct 08 20:10:45 pplxnsms02 pacemaker-based [2406] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/66)
Oct 08 20:10:45 pplxnsms02 pacemaker-execd [2408] (log_execute) info: executing - rsc:siem_vip action:start call_id:67
Oct 08 20:10:45 pplxnsms02 pacemaker-based [2406] (cib_perform_op) info: Diff: --- 0.524.36 2
Oct 08 20:10:45 pplxnsms02 pacemaker-based [2406] (cib_perform_op) info: Diff: +++ 0.524.37 (null)
Oct 08 20:10:45 pplxnsms02 pacemaker-based [2406] (cib_perform_op) info: + /cib: @num_updates=37
Oct 08 20:10:45 pplxnsms02 pacemaker-based [2406] (cib_perform_op) info: + /cib/status/node_state[@id='1']: @crm-debug-origin=send_stonith_update, @in_ccm=false, @join=down, @expected=down
Oct 08 20:10:45 pplxnsms02 pacemaker-based [2406] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/62, version=0.524.37)
Oct 08 20:10:45 pplxnsms02 pacemaker-controld [2411] (te_rsc_command) notice: Initiating start operation fence-sbd_start_0 locally on pplxnsms02 | action 51
Oct 08 20:10:45 pplxnsms02 pacemaker-controld [2411] (do_lrm_rsc_op) notice: Requesting local execution of start operation for fence-sbd on pplxnsms02 | transition_key=51:0:0:3a484884-3c2f-4db5-824b-4329dc0f3cd6 op_key=fence-sbd_start_0
Oct 08 20:10:45 pplxnsms02 pacemaker-based [2406] (cib_process_request) info: Completed cib_delete operation for section //node_state[@uname='pplxnsms01']/*: OK (rc=0, origin=pplxnsms02/crmd/63, version=0.524.37)
Oct 08 20:10:45 pplxnsms02 pacemaker-based [2406] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/64, version=0.524.37)
Oct 08 20:10:45 pplxnsms02 pacemaker-execd [2408] (log_execute) info: executing - rsc:fence-sbd action:start call_id:68
Oct 08 20:10:45 pplxnsms02 pacemaker-based [2406] (cib_process_request) info: Completed cib_delete operation for section //node_state[@uname='pplxnsms01']/*: OK (rc=0, origin=pplxnsms02/crmd/65, version=0.524.37)
Oct 08 20:10:45 pplxnsms02 pacemaker-based [2406] (cib_perform_op) info: Diff: --- 0.524.37 2
Oct 08 20:10:45 pplxnsms02 pacemaker-based [2406] (cib_perform_op) info: Diff: +++ 0.524.38 (null)
Oct 08 20:10:45 pplxnsms02 pacemaker-based [2406] (cib_perform_op) info: + /cib: @num_updates=38
Oct 08 20:10:45 pplxnsms02 pacemaker-based [2406] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='itm_vip']/lrm_rsc_op[@id='itm_vip_last_0']: @operation_key=itm_vip_start_0, @operation=start, @transition-key=17:0:0:3a484884-3c2f-4db5-824b-4329dc0f3cd6, @transition-magic=-1:193;17:0:0:3a484884-3c2f-4db5-824b-4329dc0f3cd6, @call-id=-1, @rc-code=193, @op-status=-1, @last-rc-change=1728389445, @exec-time=0
Oct 08 20:10:45 pplxnsms02 pacemaker-based [2406] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/66, version=0.524.38)
Oct 08 20:10:45 pplxnsms02 pacemaker-based [2406] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/67)
Oct 08 20:10:45 pplxnsms02 pacemaker-controld [2411] (cib_fencing_updated) info: Fencing update 62 for pplxnsms01: complete
Oct 08 20:10:45 pplxnsms02 pacemaker-controld [2411] (cib_fencing_updated) info: Fencing update 64 for pplxnsms01: complete
Oct 08 20:10:45 pplxnsms02 pacemaker-based [2406] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/68)
Oct 08 20:10:45 pplxnsms02 pacemaker-based [2406] (cib_perform_op) info: Diff: --- 0.524.38 2
Oct 08 20:10:45 pplxnsms02 pacemaker-based [2406] (cib_perform_op) info: Diff: +++ 0.524.39 (null)
Oct 08 20:10:45 pplxnsms02 pacemaker-based [2406] (cib_perform_op) info: + /cib: @num_updates=39
Oct 08 20:10:45 pplxnsms02 pacemaker-based [2406] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='siem_vip']/lrm_rsc_op[@id='siem_vip_last_0']: @operation_key=siem_vip_start_0, @operation=start, @transition-key=39:0:0:3a484884-3c2f-4db5-824b-4329dc0f3cd6, @transition-magic=-1:193;39:0:0:3a484884-3c2f-4db5-824b-4329dc0f3cd6, @call-id=-1, @rc-code=193, @op-status=-1, @last-rc-change=1728389445, @exec-time=0
Oct 08 20:10:45 pplxnsms02 pacemaker-based [2406] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/67, version=0.524.39)
Oct 08 20:10:45 pplxnsms02 pacemaker-based [2406] (cib_perform_op) info: Diff: --- 0.524.39 2
Oct 08 20:10:45 pplxnsms02 pacemaker-based [2406] (cib_perform_op) info: Diff: +++ 0.524.40 (null)
Oct 08 20:10:45 pplxnsms02 pacemaker-based [2406] (cib_perform_op) info: + /cib: @num_updates=40
Oct 08 20:10:45 pplxnsms02 pacemaker-based [2406] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='fence-sbd']/lrm_rsc_op[@id='fence-sbd_last_0']: @operation_key=fence-sbd_start_0, @operation=start, @transition-key=51:0:0:3a484884-3c2f-4db5-824b-4329dc0f3cd6, @transition-magic=-1:193;51:0:0:3a484884-3c2f-4db5-824b-4329dc0f3cd6, @call-id=-1, @rc-code=193, @op-status=-1, @last-rc-change=1728389445, @exec-time=0
Oct 08 20:10:45 pplxnsms02 pacemaker-based [2406] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/68, version=0.524.40)
Oct 08 20:10:45 IPaddr2(siem_vip)[6408]: INFO: Adding inet address 192.168.133.40/24 with broadcast address 192.168.133.255 to device ens224
Oct 08 20:10:45 IPaddr2(siem_vip)[6408]: INFO: Bringing device ens224 up
Oct 08 20:10:45 IPaddr2(itm_vip)[6407]: INFO: Adding inet address 192.168.133.136/24 with broadcast address 192.168.133.255 to device ens224
Oct 08 20:10:45 IPaddr2(siem_vip)[6408]: INFO: /usr/libexec/heartbeat/send_arp -i 200 -r 5 -p /run/resource-agents/send_arp-192.168.133.40 ens224 192.168.133.40 auto not_used not_used
Oct 08 20:10:45 IPaddr2(itm_vip)[6407]: INFO: Bringing device ens224 up
Oct 08 20:10:45 pplxnsms02 pacemaker-execd [2408] (log_finished) info: siem_vip start (call 67, PID 6408) exited with status 0 (execution time 155ms)
Oct 08 20:10:45 IPaddr2(itm_vip)[6407]: INFO: /usr/libexec/heartbeat/send_arp -i 200 -r 5 -p /run/resource-agents/send_arp-192.168.133.136 ens224 192.168.133.136 auto not_used not_used
Oct 08 20:10:45 pplxnsms02 pacemaker-execd [2408] (log_finished) info: itm_vip start (call 66, PID 6407) exited with status 0 (execution time 167ms)
Oct 08 20:10:45 pplxnsms02 pacemaker-controld [2411] (wait_for_sync_result) info: IPaddr2_meta-data_0[6572] exited with status 0
Oct 08 20:10:45 pplxnsms02 pacemaker-controld [2411] (log_executor_event) notice: Result of start operation for siem_vip on pplxnsms02: ok | CIB update 69, graph action confirmed; call=67 key=siem_vip_start_0 rc=0
Oct 08 20:10:45 pplxnsms02 pacemaker-based [2406] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/69)
Oct 08 20:10:45 pplxnsms02 pacemaker-based [2406] (cib_perform_op) info: Diff: --- 0.524.40 2
Oct 08 20:10:45 pplxnsms02 pacemaker-based [2406] (cib_perform_op) info: Diff: +++ 0.524.41 (null)
Oct 08 20:10:45 pplxnsms02 pacemaker-based [2406] (cib_perform_op) info: + /cib: @num_updates=41
Oct 08 20:10:45 pplxnsms02 pacemaker-based [2406] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='siem_vip']/lrm_rsc_op[@id='siem_vip_last_0']: @transition-magic=0:0;39:0:0:3a484884-3c2f-4db5-824b-4329dc0f3cd6, @call-id=67, @rc-code=0, @op-status=0, @exec-time=155
Oct 08 20:10:45 pplxnsms02 pacemaker-based [2406] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/69, version=0.524.41)
Oct 08 20:10:45 pplxnsms02 pacemaker-controld [2411] (wait_for_sync_result) info: IPaddr2_meta-data_0[6584] exited with status 0
Oct 08 20:10:45 pplxnsms02 pacemaker-controld [2411] (log_executor_event) notice: Result of start operation for itm_vip on pplxnsms02: ok | CIB update 70, graph action confirmed; call=66 key=itm_vip_start_0 rc=0
Oct 08 20:10:45 pplxnsms02 pacemaker-based [2406] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/70)
Oct 08 20:10:45 pplxnsms02 pacemaker-controld [2411] (process_graph_event) info: Transition 0 action 39 (siem_vip_start_0 on pplxnsms02) confirmed: ok | rc=0 call-id=67
Oct 08 20:10:45 pplxnsms02 pacemaker-controld [2411] (te_rsc_command) notice: Initiating monitor operation siem_vip_monitor_10000 locally on pplxnsms02 | action 40
Oct 08 20:10:45 pplxnsms02 pacemaker-controld [2411] (do_lrm_rsc_op) notice: Requesting local execution of monitor operation for siem_vip on pplxnsms02 | transition_key=40:0:0:3a484884-3c2f-4db5-824b-4329dc0f3cd6 op_key=siem_vip_monitor_10000
Oct 08 20:10:45 pplxnsms02 pacemaker-controld [2411] (te_rsc_command) notice: Initiating start operation siem_lvm_start_0 locally on pplxnsms02 | action 41
Oct 08 20:10:45 pplxnsms02 pacemaker-controld [2411] (do_lrm_rsc_op) notice: Requesting local execution of start operation for siem_lvm on pplxnsms02 | transition_key=41:0:0:3a484884-3c2f-4db5-824b-4329dc0f3cd6 op_key=siem_lvm_start_0
Oct 08 20:10:45 pplxnsms02 pacemaker-execd [2408] (log_execute) info: executing - rsc:siem_lvm action:start call_id:70
Oct 08 20:10:45 pplxnsms02 pacemaker-based [2406] (cib_perform_op) info: Diff: --- 0.524.41 2
Oct 08 20:10:45 pplxnsms02 pacemaker-based [2406] (cib_perform_op) info: Diff: +++ 0.524.42 (null)
Oct 08 20:10:45 pplxnsms02 pacemaker-based [2406] (cib_perform_op) info: + /cib: @num_updates=42
Oct 08 20:10:45 pplxnsms02 pacemaker-based [2406] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='itm_vip']/lrm_rsc_op[@id='itm_vip_last_0']: @transition-magic=0:0;17:0:0:3a484884-3c2f-4db5-824b-4329dc0f3cd6, @call-id=66, @rc-code=0, @op-status=0, @exec-time=167
Oct 08 20:10:45 pplxnsms02 pacemaker-based [2406] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/70, version=0.524.42)
Oct 08 20:10:45 pplxnsms02 pacemaker-based [2406] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/71)
Oct 08 20:10:45 pplxnsms02 pacemaker-based [2406] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/72)
Oct 08 20:10:45 pplxnsms02 pacemaker-controld [2411] (process_graph_event) info: Transition 0 action 17 (itm_vip_start_0 on pplxnsms02) confirmed: ok | rc=0 call-id=66
Oct 08 20:10:45 pplxnsms02 pacemaker-controld [2411] (te_rsc_command) notice: Initiating monitor operation itm_vip_monitor_10000 locally on pplxnsms02 | action 18
Oct 08 20:10:45 pplxnsms02 pacemaker-controld [2411] (do_lrm_rsc_op) notice: Requesting local execution of monitor operation for itm_vip on pplxnsms02 | transition_key=18:0:0:3a484884-3c2f-4db5-824b-4329dc0f3cd6 op_key=itm_vip_monitor_10000
Oct 08 20:10:45 pplxnsms02 pacemaker-based [2406] (cib_perform_op) info: Diff: --- 0.524.42 2
Oct 08 20:10:45 pplxnsms02 pacemaker-based [2406] (cib_perform_op) info: Diff: +++ 0.524.43 (null)
Oct 08 20:10:45 pplxnsms02 pacemaker-based [2406] (cib_perform_op) info: + /cib: @num_updates=43
Oct 08 20:10:45 pplxnsms02 pacemaker-based [2406] (cib_perform_op) info: ++ /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='siem_vip']: 3 | from pplxnsms02
Oct 08 20:11:28 pplxnsms02 pacemaker-attrd [2416] (attrd_start_election_if_needed) info: Starting an election to determine the writer
Oct 08 20:11:28 pplxnsms02 pacemaker-attrd [2416] (election_check) info: election-attrd won by local node
Oct 08 20:11:28 pplxnsms02 pacemaker-attrd [2416] (attrd_declare_winner) notice: Recorded local node as attribute writer (was unset)
Oct 08 20:11:28 pplxnsms02 pacemaker-attrd [2416] (write_attribute) info: Processed 1 private change for #attrd-protocol, id=n/a, set=n/a
Oct 08 20:11:28 pplxnsms02 pacemaker-fenced [2414] (cib_native_signon_raw) info: Successfully connected to CIB manager for stonithd
Oct 08 20:11:28 pplxnsms02 pacemaker-controld [2418] (cib_native_signon_raw) info: Successfully connected to CIB manager for crmd
Oct 08 20:11:28 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Completed cib_delete operation for section //node_state[@uname='pplxnsms02']/transient_attributes: OK (rc=0, origin=pplxnsms02/attrd/2, version=0.524.0)
Oct 08 20:11:28 pplxnsms02 pacemaker-fenced [2414] (setup_cib) info: Watching for fencing topology changes
Oct 08 20:11:28 pplxnsms02 pacemaker-fenced [2414] (qb_ipcs_us_publish) info: server name: stonith-ng
Oct 08 20:11:28 pplxnsms02 pacemaker-fenced [2414] (main) notice: Pacemaker fencer successfully started and accepting connections
Oct 08 20:11:28 pplxnsms02 pacemaker-fenced [2414] (pcmk_cpg_membership) info: Group stonith-ng event 0: node 2 pid 2414 joined via cpg_join
Oct 08 20:11:28 pplxnsms02 pacemaker-fenced [2414] (pcmk_cpg_membership) info: Group stonith-ng event 0: pplxnsms02 (node 2 pid 2414) is member
Oct 08 20:11:28 pplxnsms02 pacemaker-fenced [2414] (init_cib_cache_cb) info: Updating device list from CIB
Oct 08 20:11:28 pplxnsms02 pacemaker-fenced [2414] (cib_devices_update) info: Updating devices to version 0.524.0
Oct 08 20:11:28 pplxnsms02 pacemaker-fenced [2414] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 08 20:11:28 pplxnsms02 pacemaker-fenced [2414] (unpack_config) notice: On loss of quorum: Ignore
Oct 08 20:11:28 pplxnsms02 pacemaker-controld [2418] (get_cluster_type) info: Verifying cluster type: 'corosync'
Oct 08 20:11:28 pplxnsms02 pacemaker-controld [2418] (get_cluster_type) info: Assuming an active 'corosync' cluster
Oct 08 20:11:28 pplxnsms02 pacemaker-controld [2418] (crm_cluster_connect) notice: Connecting to corosync cluster infrastructure
Oct 08 20:11:28 pplxnsms02 pacemaker-controld [2418] (crm_get_peer) info: Created entry 40a3592b-b73e-4d44-9d79-3366e730bdc3/0x5591c6ef80b0 for node pplxnsms02/2 (1 total)
Oct 08 20:11:28 pplxnsms02 pacemaker-controld [2418] (crm_get_peer) info: Node 2 is now known as pplxnsms02
Oct 08 20:11:28 pplxnsms02 pacemaker-controld [2418] (peer_update_callback) info: Cluster node pplxnsms02 is now in unknown state
Oct 08 20:11:28 pplxnsms02 pacemaker-controld [2418] (crm_get_peer) info: Node 2 has uuid 2
Oct 08 20:11:28 pplxnsms02 pacemaker-controld [2418] (crm_update_peer_proc) info: cluster_connect_cpg: Node pplxnsms02[2] - corosync-cpg is now online
Oct 08 20:11:28 pplxnsms02 pacemaker-controld [2418] (peer_update_callback) info: Node pplxnsms02 is now a peer | DC= old=0x0000000 new=0x4000000
Oct 08 20:11:28 pplxnsms02 pacemaker-controld [2418] (te_trigger_stonith_history_sync) info: Fence history will be synchronized cluster-wide within 5 seconds
Oct 08 20:11:28 pplxnsms02 pacemaker-controld [2418] (pcmk__corosync_connect) info: Connection to corosync established
Oct 08 20:11:28 pplxnsms02 pacemaker-controld [2418] (pcmk__corosync_quorum_connect) warning: No quorum
Oct 08 20:11:28 pplxnsms02 pacemaker-controld [2418] (crm_get_peer) info: Created entry 1a38a489-efe2-4602-840d-a11dd8aaddc2/0x5591c6efb7e0 for node pplxnsms01/1 (2 total)
Oct 08 20:11:28 pplxnsms02 pacemaker-controld [2418] (crm_get_peer) info: Node 1 is now known as pplxnsms01
Oct 08 20:11:28 pplxnsms02 pacemaker-controld [2418] (peer_update_callback) info: Cluster node pplxnsms01 is now in unknown state
Oct 08 20:11:28 pplxnsms02 pacemaker-controld [2418] (crm_get_peer) info: Node 1 has uuid 1
Oct 08 20:11:28 pplxnsms02 pacemaker-controld [2418] (do_ha_control) info: Connected to the cluster
Oct 08 20:11:28 pplxnsms02 pacemaker-controld [2418] (lrmd_ipc_connect) info: Connecting to executor
Oct 08 20:11:28 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Forwarding cib_modify operation for section nodes to all (origin=local/crmd/4)
Oct 08 20:11:28 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Completed cib_modify operation for section nodes: OK (rc=0, origin=pplxnsms02/crmd/4, version=0.524.0)
Oct 08 20:11:28 pplxnsms02 pacemaker-controld [2418] (try_local_executor_connect) info: Connection to the local executor established
Oct 08 20:11:28 pplxnsms02 pacemaker-controld [2418] (do_started) info: Delaying start, no membership data (0000000000100000)
Oct 08 20:11:28 pplxnsms02 pacemaker-controld [2418] (do_started) info: Delaying start, no membership data (0000000000100000)
Oct 08 20:11:28 pplxnsms02 pacemaker-controld [2418] (quorum_notification_cb) info: Quorum still lost | membership=1350 members=1
Oct 08 20:11:28 pplxnsms02 pacemaker-controld [2418] (update_peer_state_iter) notice: Node pplxnsms02 state is now member | nodeid=2 previous=unknown source=quorum_notification_cb
Oct 08 20:11:28 pplxnsms02 pacemaker-controld [2418] (peer_update_callback) info: Cluster node pplxnsms02 is now member (was in unknown state)
Oct 08 20:11:28 pplxnsms02 pacemaker-controld [2418] (pcmk__reap_unseen_nodes) info: State of node pplxnsms01[1] is still unknown
Oct 08 20:11:28 pplxnsms02 pacemaker-controld [2418] (do_started) info: Delaying start, Config not read (0000000000000040)
Oct 08 20:11:28 pplxnsms02 pacemaker-controld [2418] (pcmk_cpg_membership) info: Group crmd event 0: node 2 pid 2418 joined via cpg_join
Oct 08 20:11:28 pplxnsms02 pacemaker-controld [2418] (pcmk_cpg_membership) info: Group crmd event 0: pplxnsms02 (node 2 pid 2418) is member
Oct 08 20:11:28 pplxnsms02 pacemaker-controld [2418] (do_started) info: Delaying start, Config not read (0000000000000040)
Oct 08 20:11:28 pplxnsms02 pacemaker-controld [2418] (do_started) info: Delaying start, Config not read (0000000000000040)
Oct 08 20:11:28 pplxnsms02 pacemaker-controld [2418] (qb_ipcs_us_publish) info: server name: crmd
Oct 08 20:11:28 pplxnsms02 pacemaker-controld [2418] (do_started) notice: Pacemaker controller successfully started and accepting connections
Oct 08 20:11:28 pplxnsms02 pacemaker-controld [2418] (do_log) info: Input I_PENDING received in state S_STARTING from do_started
Oct 08 20:11:28 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_STARTING -> S_PENDING | input=I_PENDING cause=C_FSA_INTERNAL origin=do_started
Oct 08 20:11:29 pplxnsms02 pacemaker-fenced [2414] (wait_for_sync_result) info: fence_sbd_metadata_1[2485] exited with status 0
Oct 08 20:11:29 pplxnsms02 pacemaker-fenced [2414] (stonith_device_register) notice: Added 'fence-sbd' to device list (1 active device)
Oct 08 20:11:29 pplxnsms02 pacemaker-controld [2418] (te_trigger_stonith_history_sync) info: Fence history will be synchronized cluster-wide within 30 seconds
Oct 08 20:11:29 pplxnsms02 pacemaker-controld [2418] (te_connect_stonith) notice: Fencer successfully connected
Oct 08 20:11:49 pplxnsms02 pacemaker-controld [2418] (crm_timer_popped) info: Election Trigger just popped | input=I_DC_TIMEOUT time=20000ms
Oct 08 20:11:49 pplxnsms02 pacemaker-controld [2418] (do_log) warning: Input I_DC_TIMEOUT received in state S_PENDING from crm_timer_popped
Oct 08 20:11:49 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: State transition S_PENDING -> S_ELECTION | input=I_DC_TIMEOUT cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 08 20:11:49 pplxnsms02 pacemaker-controld [2418] (election_check) info: election-DC won by local node
Oct 08 20:11:49 pplxnsms02 pacemaker-controld [2418] (do_log) info: Input I_ELECTION_DC received in state S_ELECTION from election_win_cb
Oct 08 20:11:49 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_ELECTION -> S_INTEGRATION | input=I_ELECTION_DC cause=C_FSA_INTERNAL origin=election_win_cb
Oct 08 20:11:49 pplxnsms02 pacemaker-controld [2418] (do_te_control) info: Registering TE UUID: c2eb7813-bdec-4a6a-b84c-2918ad8d7ea1
Oct 08 20:11:49 pplxnsms02 pacemaker-controld [2418] (pcmk__pid_active) info: Could not read from /proc/1698/exe: Permission denied | errno=13
Oct 08 20:11:49 pplxnsms02 pacemaker-controld [2418] (do_dc_takeover) info: Taking over DC status for this partition
Oct 08 20:11:49 pplxnsms02 pacemaker-based [2413] (cib_process_readwrite) info: We are now in R/W mode
Oct 08 20:11:49 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Completed cib_master operation for section 'all': OK (rc=0, origin=local/crmd/7, version=0.524.0)
Oct 08 20:11:49 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Forwarding cib_modify operation for section cib to all (origin=local/crmd/8)
Oct 08 20:11:49 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Completed cib_modify operation for section cib: OK (rc=0, origin=pplxnsms02/crmd/8, version=0.524.0)
Oct 08 20:11:49 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Forwarding cib_modify operation for section crm_config to all (origin=local/crmd/10)
Oct 08 20:11:49 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Completed cib_modify operation for section crm_config: OK (rc=0, origin=pplxnsms02/crmd/10, version=0.524.0)
Oct 08 20:11:49 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Forwarding cib_modify operation for section crm_config to all (origin=local/crmd/12)
Oct 08 20:11:49 pplxnsms02 pacemaker-controld [2418] (join_make_offer) info: Not making join-1 offer to inactive node pplxnsms01
Oct 08 20:11:49 pplxnsms02 pacemaker-controld [2418] (join_make_offer) info: Making join-1 offers based on membership event 1350
Oct 08 20:11:49 pplxnsms02 pacemaker-controld [2418] (join_make_offer) info: Sending join-1 offer to pplxnsms02
Oct 08 20:11:49 pplxnsms02 pacemaker-controld [2418] (do_dc_join_offer_all) info: Waiting on join-1 requests from 1 outstanding node
Oct 08 20:11:49 pplxnsms02 pacemaker-controld [2418] (update_dc) info: Set DC to pplxnsms02 (3.13.0)
Oct 08 20:11:49 pplxnsms02 pacemaker-controld [2418] (pcmk__update_peer_expected) info: update_dc: Node pplxnsms02[2] - expected state is now member (was (null))
Oct 08 20:11:49 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Completed cib_modify operation for section crm_config: OK (rc=0, origin=pplxnsms02/crmd/12, version=0.524.0)
Oct 08 20:11:49 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Forwarding cib_modify operation for section crm_config to all (origin=local/crmd/14)
Oct 08 20:11:49 pplxnsms02 pacemaker-controld [2418] (stonith__watchdog_fencing_enabled_for_node_api) notice: Cluster does not have watchdog fencing device
Oct 08 20:11:49 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Completed cib_modify operation for section crm_config: OK (rc=0, origin=pplxnsms02/crmd/14, version=0.524.0)
Oct 08 20:11:49 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: State transition S_INTEGRATION -> S_FINALIZE_JOIN | input=I_INTEGRATED cause=C_FSA_INTERNAL origin=check_join_state
Oct 08 20:11:49 pplxnsms02 pacemaker-controld [2418] (controld_delete_node_state) info: Deleting resource history for node pplxnsms02 (via CIB call 19) | xpath=//node_state[@uname='pplxnsms02']/lrm
Oct 08 20:11:49 pplxnsms02 pacemaker-based [2413] (cib_process_replace) info: Digest matched on replace from pplxnsms02: 3ee2a3044e50b4f9747d375984348bab
Oct 08 20:11:49 pplxnsms02 pacemaker-based [2413] (cib_process_replace) info: Replaced 0.524.0 with 0.524.0 from pplxnsms02
Oct 08 20:11:49 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Completed cib_replace operation for section 'all': OK (rc=0, origin=pplxnsms02/crmd/17, version=0.524.0)
Oct 08 20:11:49 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Forwarding cib_modify operation for section nodes to all (origin=local/crmd/18)
Oct 08 20:11:49 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Forwarding cib_delete operation for section //node_state[@uname='pplxnsms02']/lrm to all (origin=local/crmd/19)
Oct 08 20:11:49 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/20)
Oct 08 20:11:49 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Completed cib_modify operation for section nodes: OK (rc=0, origin=pplxnsms02/crmd/18, version=0.524.0)
Oct 08 20:11:49 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Completed cib_delete operation for section //node_state[@uname='pplxnsms02']/lrm: OK (rc=0, origin=pplxnsms02/crmd/19, version=0.524.0)
Oct 08 20:11:49 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: --- 0.524.0 2
Oct 08 20:11:49 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: +++ 0.524.1 (null)
Oct 08 20:11:49 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib: @num_updates=1
Oct 08 20:11:49 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: ++ /cib/status:
Oct 08 20:11:49 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: ++
Oct 08 20:11:49 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: ++
Oct 08 20:11:49 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: ++
Oct 08 20:11:49 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: ++
Oct 08 20:11:49 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/20, version=0.524.1)
Oct 08 20:11:49 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: State transition S_FINALIZE_JOIN -> S_POLICY_ENGINE | input=I_FINALIZED cause=C_FSA_INTERNAL origin=check_join_state
Oct 08 20:11:49 pplxnsms02 pacemaker-controld [2418] (create_node_state_update) info: Node update for pplxnsms01 cancelled: no state, not seen yet
Oct 08 20:11:49 pplxnsms02 pacemaker-controld [2418] (abort_transition_graph) info: Transition -1 aborted: Quorum lost | source=crm_update_quorum:435 complete=true
Oct 08 20:11:49 pplxnsms02 pacemaker-controld [2418] (abort_transition_graph) info: Transition -1 aborted: Peer Cancelled | source=do_te_invoke:129 complete=true
Oct 08 20:11:49 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Forwarding cib_modify operation for section nodes to all (origin=local/crmd/23)
Oct 08 20:11:49 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/24)
Oct 08 20:11:49 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Forwarding cib_modify operation for section cib to all (origin=local/crmd/25)
Oct 08 20:11:49 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Completed cib_modify operation for section nodes: OK (rc=0, origin=pplxnsms02/crmd/23, version=0.524.1)
Oct 08 20:11:49 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: --- 0.524.1 2
Oct 08 20:11:49 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: +++ 0.524.2 (null)
Oct 08 20:11:49 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib: @num_updates=2
Oct 08 20:11:49 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib/status/node_state[@id='2']: @crm-debug-origin=do_state_transition, @join=member, @expected=member
Oct 08 20:11:49 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/24, version=0.524.2)
Oct 08 20:11:49 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: --- 0.524.2 2
Oct 08 20:11:49 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: +++ 0.524.3 (null)
Oct 08 20:11:49 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib: @num_updates=3, @have-quorum=0, @dc-uuid=2
Oct 08 20:11:49 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Completed cib_modify operation for section cib: OK (rc=0, origin=pplxnsms02/crmd/25, version=0.524.3)
Oct 08 20:11:49 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 08 20:11:49 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) notice: On loss of quorum: Ignore
Oct 08 20:11:49 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 08 20:11:49 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms02 is online
Oct 08 20:11:49 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 08 20:11:49 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 08 20:11:49 pplxnsms02 pacemaker-schedulerd[2417] (RecurringOp) info: Start recurring monitor (10s) for itm_vip on pplxnsms02
Oct 08 20:11:49 pplxnsms02 pacemaker-schedulerd[2417] (RecurringOp) info: Start recurring monitor (30s) for itm_lvm on pplxnsms02
Oct 08 20:11:49 pplxnsms02 pacemaker-schedulerd[2417] (RecurringOp) info: Start recurring monitor (20s) for itm_fs on pplxnsms02
Oct 08 20:11:49 pplxnsms02 pacemaker-schedulerd[2417] (RecurringOp) info: Start recurring monitor (20s) for itm_fs2 on pplxnsms02
Oct 08 20:11:49 pplxnsms02 pacemaker-schedulerd[2417] (RecurringOp) info: Start recurring monitor (20s) for itm_fs3 on pplxnsms02
Oct 08 20:11:49 pplxnsms02 pacemaker-schedulerd[2417] (RecurringOp) info: Start recurring monitor (20s) for nco_db2 on pplxnsms02
Oct 08 20:11:49 pplxnsms02 pacemaker-schedulerd[2417] (RecurringOp) info: Start recurring monitor (60s) for nco_omni on pplxnsms02
Oct 08 20:11:49 pplxnsms02 pacemaker-schedulerd[2417] (RecurringOp) info: Start recurring monitor (300s) for nco_itnm on pplxnsms02
Oct 08 20:11:49 pplxnsms02 pacemaker-schedulerd[2417] (RecurringOp) info: Start recurring monitor (10s) for nco_cognos on pplxnsms02
Oct 08 20:11:49 pplxnsms02 pacemaker-schedulerd[2417] (RecurringOp) info: Start recurring monitor (10s) for siem_vip on pplxnsms02
Oct 08 20:11:49 pplxnsms02 pacemaker-schedulerd[2417] (RecurringOp) info: Start recurring monitor (30s) for siem_lvm on pplxnsms02
Oct 08 20:11:49 pplxnsms02 pacemaker-schedulerd[2417] (RecurringOp) info: Start recurring monitor (20s) for siem_fs on pplxnsms02
Oct 08 20:11:49 pplxnsms02 pacemaker-schedulerd[2417] (RecurringOp) info: Start recurring monitor (10s) for siem_rsyslog on pplxnsms02
Oct 08 20:11:49 pplxnsms02 pacemaker-schedulerd[2417] (RecurringOp) info: Start recurring monitor (60s) for fence-sbd on pplxnsms02
Oct 08 20:11:49 pplxnsms02 pacemaker-schedulerd[2417] (stage6) warning: Scheduling Node pplxnsms01 for STONITH
Oct 08 20:11:49 pplxnsms02 pacemaker-schedulerd[2417] (log_list_item) notice: Actions: Fence (reboot) pplxnsms01 'node is unclean'
Oct 08 20:11:49 pplxnsms02 pacemaker-schedulerd[2417] (log_list_item) notice: Actions: Start itm_vip ( pplxnsms02 )
Oct 08 20:11:49 pplxnsms02 pacemaker-schedulerd[2417] (log_list_item) notice: Actions: Start itm_lvm ( pplxnsms02 )
Oct 08 20:11:49 pplxnsms02 pacemaker-schedulerd[2417] (log_list_item) notice: Actions: Start itm_fs ( pplxnsms02 )
Oct 08 20:11:49 pplxnsms02 pacemaker-schedulerd[2417] (log_list_item) notice: Actions: Start itm_fs2 ( pplxnsms02 )
Oct 08 20:11:49 pplxnsms02 pacemaker-schedulerd[2417] (log_list_item) notice: Actions: Start itm_fs3 ( pplxnsms02 )
Oct 08 20:11:49 pplxnsms02 pacemaker-schedulerd[2417] (log_list_item) notice: Actions: Start nco_db2 ( pplxnsms02 )
Oct 08 20:11:49 pplxnsms02 pacemaker-schedulerd[2417] (log_list_item) notice: Actions: Start nco_omni ( pplxnsms02 )
Oct 08 20:11:49 pplxnsms02 pacemaker-schedulerd[2417] (log_list_item) notice: Actions: Start nco_itnm ( pplxnsms02 )
Oct 08 20:11:49 pplxnsms02 pacemaker-schedulerd[2417] (log_list_item) notice: Actions: Start nco_cognos ( pplxnsms02 )
Oct 08 20:11:49 pplxnsms02 pacemaker-schedulerd[2417] (log_list_item) notice: Actions: Start siem_vip ( pplxnsms02 )
Oct 08 20:11:49 pplxnsms02 pacemaker-schedulerd[2417] (log_list_item) notice: Actions: Start siem_lvm ( pplxnsms02 )
Oct 08 20:11:49 pplxnsms02 pacemaker-schedulerd[2417] (log_list_item) notice: Actions: Start siem_fs ( pplxnsms02 )
Oct 08 20:11:49 pplxnsms02 pacemaker-schedulerd[2417] (log_list_item) notice: Actions: Start siem_rsyslog ( pplxnsms02 )
Oct 08 20:11:49 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 08 20:11:49 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 08 20:11:49 pplxnsms02 pacemaker-schedulerd[2417] (log_list_item) notice: Actions: Start fence-sbd ( pplxnsms02 )
Oct 08 20:11:49 pplxnsms02 pacemaker-based [2413] (cib_file_backup) info: Archived previous version as /var/lib/pacemaker/cib/cib-52.raw
Oct 08 20:11:49 pplxnsms02 pacemaker-based [2413] (cib_file_write_with_digest) info: Wrote version 0.524.0 of the CIB to disk (digest: cdfbc094566a397e2f7e078b8587f515)
Oct 08 20:11:49 pplxnsms02 pacemaker-based [2413] (cib_file_write_with_digest) info: Reading cluster configuration file /var/lib/pacemaker/cib/cib.kG6uhu (digest: /var/lib/pacemaker/cib/cib.GjV2sV)
Oct 08 20:11:49 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__log_transition_summary) warning: Calculated transition 0 (with warnings), saving inputs in /var/lib/pacemaker/pengine/pe-warn-102.bz2
Oct 08 20:11:49 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 08 20:11:49 pplxnsms02 pacemaker-controld [2418] (do_te_invoke) info: Processing graph 0 (ref=pe_calc-dc-1728389509-8) derived from /var/lib/pacemaker/pengine/pe-warn-102.bz2
Oct 08 20:11:49 pplxnsms02 pacemaker-controld [2418] (te_rsc_command) notice: Initiating monitor operation itm_vip_monitor_0 locally on pplxnsms02 | action 1
Oct 08 20:11:49 pplxnsms02 pacemaker-execd [2415] (process_lrmd_get_rsc_info) info: Agent information for 'itm_vip' not in cache
Oct 08 20:11:49 pplxnsms02 pacemaker-execd [2415] (process_lrmd_rsc_register) info: Cached agent information for 'itm_vip'
Oct 08 20:11:49 pplxnsms02 pacemaker-controld [2418] (do_lrm_rsc_op) notice: Requesting local execution of probe operation for itm_vip on pplxnsms02 | transition_key=1:0:7:c2eb7813-bdec-4a6a-b84c-2918ad8d7ea1 op_key=itm_vip_monitor_0
Oct 08 20:11:49 pplxnsms02 pacemaker-controld [2418] (wait_for_sync_result) info: IPaddr2_meta-data_0[3847] exited with status 0
Oct 08 20:11:49 pplxnsms02 pacemaker-controld [2418] (te_rsc_command) notice: Initiating monitor operation itm_lvm_monitor_0 locally on pplxnsms02 | action 2
Oct 08 20:11:49 pplxnsms02 pacemaker-execd [2415] (process_lrmd_get_rsc_info) info: Agent information for 'itm_lvm' not in cache
Oct 08 20:11:49 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/28)
Oct 08 20:11:49 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: --- 0.524.3 2
Oct 08 20:11:49 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: +++ 0.524.4 (null)
Oct 08 20:11:49 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib: @num_updates=4
Oct 08 20:11:49 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib/status/node_state[@id='2']: @crm-debug-origin=do_update_resource
Oct 08 20:11:49 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: ++ /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources:
Oct 08 20:11:49 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: ++
Oct 08 20:11:49 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: ++
Oct 08 20:11:50 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: ++
Oct 08 20:11:50 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/30, version=0.524.6)
Oct 08 20:11:50 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/31)
Oct 08 20:11:50 pplxnsms02 pacemaker-controld [2418] (te_fence_node) notice: Requesting fencing (reboot) of node pplxnsms01 | action=53 timeout=60000
Oct 08 20:11:50 pplxnsms02 pacemaker-fenced [2414] (handle_request) notice: Client pacemaker-controld.2418 wants to fence (reboot) pplxnsms01 using any device
Oct 08 20:11:50 pplxnsms02 pacemaker-fenced [2414] (initiate_remote_stonith_op) notice: Requesting peer fencing (reboot) targeting pplxnsms01 | id=579697b4 state=querying base_timeout=60
Oct 08 20:11:50 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: --- 0.524.6 2
Oct 08 20:11:50 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: +++ 0.524.7 (null)
Oct 08 20:11:50 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib: @num_updates=7
Oct 08 20:11:50 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: ++ /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources:
Oct 08 20:11:50 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: ++
Oct 08 20:11:50 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: ++
Oct 08 20:11:50 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: ++
Oct 08 20:11:50 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: ++
Oct 08 20:11:50 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/37, version=0.524.13)
Oct 08 20:11:50 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/38)
Oct 08 20:11:50 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: --- 0.524.13 2
Oct 08 20:11:50 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: +++ 0.524.14 (null)
Oct 08 20:11:50 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib: @num_updates=14
Oct 08 20:11:50 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='itm_fs2']/lrm_rsc_op[@id='itm_fs2_last_0']: @transition-magic=0:7;4:0:7:c2eb7813-bdec-4a6a-b84c-2918ad8d7ea1, @call-id=17, @rc-code=7, @op-status=0, @exec-time=366
Oct 08 20:11:50 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/38, version=0.524.14)
Oct 08 20:11:50 pplxnsms02 pacemaker-controld [2418] (process_graph_event) info: Transition 0 action 4 (itm_fs2_monitor_0 on pplxnsms02) confirmed: not running | rc=7 call-id=17
Oct 08 20:11:50 pplxnsms02 pacemaker-controld [2418] (te_rsc_command) notice: Initiating monitor operation nco_itnm_monitor_0 locally on pplxnsms02 | action 8
Oct 08 20:11:50 pplxnsms02 pacemaker-execd [2415] (process_lrmd_get_rsc_info) info: Agent information for 'nco_itnm' not in cache
Oct 08 20:11:50 pplxnsms02 pacemaker-execd [2415] (process_lrmd_rsc_register) info: Cached agent information for 'nco_itnm'
Oct 08 20:11:50 pplxnsms02 pacemaker-controld [2418] (do_lrm_rsc_op) notice: Requesting local execution of probe operation for nco_itnm on pplxnsms02 | transition_key=8:0:7:c2eb7813-bdec-4a6a-b84c-2918ad8d7ea1 op_key=nco_itnm_monitor_0
Oct 08 20:11:50 omnibus(nco_omni)[4274]: ERROR: Cannot find the directory /san/tivoli/netcool!
Oct 08 20:11:50 pplxnsms02 pacemaker-controld [2418] (wait_for_sync_result) info: itnm_meta-data_0[4280] exited with status 0
Oct 08 20:11:50 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/39)
Oct 08 20:11:50 pplxnsms02 pacemaker-controld [2418] (log_executor_event) notice: Result of probe operation for itm_fs3 on pplxnsms02: not running | CIB update 40, graph action confirmed; call=21 key=itm_fs3_monitor_0 rc=7
Oct 08 20:11:50 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: --- 0.524.14 2
Oct 08 20:11:50 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: +++ 0.524.15 (null)
Oct 08 20:11:50 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib: @num_updates=15
Oct 08 20:11:50 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: ++ /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources:
Oct 08 20:11:50 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: ++
Oct 08 20:11:50 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/39, version=0.524.15)
Oct 08 20:11:50 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/40)
Oct 08 20:11:50 pplxnsms02 pacemaker-controld [2418] (log_executor_event) notice: Result of probe operation for nco_omni on pplxnsms02: not running | CIB update 41, graph action confirmed; call=29 key=nco_omni_monitor_0 rc=7
Oct 08 20:11:50 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: --- 0.524.15 2
Oct 08 20:11:50 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: +++ 0.524.16 (null)
Oct 08 20:11:50 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib: @num_updates=16
Oct 08 20:11:50 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='itm_fs3']/lrm_rsc_op[@id='itm_fs3_last_0']: @transition-magic=0:7;5:0:7:c2eb7813-bdec-4a6a-b84c-2918ad8d7ea1, @call-id=21, @rc-code=7, @op-status=0, @exec-time=363
Oct 08 20:11:50 pplxnsms02 pacemaker-controld [2418] (process_graph_event) info: Transition 0 action 5 (itm_fs3_monitor_0 on pplxnsms02) confirmed: not running | rc=7 call-id=21
Oct 08 20:11:50 pplxnsms02 pacemaker-controld [2418] (te_rsc_command) notice: Initiating monitor operation nco_cognos_monitor_0 locally on pplxnsms02 | action 9
Oct 08 20:11:50 pplxnsms02 pacemaker-execd [2415] (process_lrmd_get_rsc_info) info: Agent information for 'nco_cognos' not in cache
Oct 08 20:11:50 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/40, version=0.524.16)
Oct 08 20:11:50 pplxnsms02 pacemaker-execd [2415] (process_lrmd_rsc_register) info: Cached agent information for 'nco_cognos'
Oct 08 20:11:50 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/41)
Oct 08 20:11:50 pplxnsms02 pacemaker-controld [2418] (do_lrm_rsc_op) notice: Requesting local execution of probe operation for nco_cognos on pplxnsms02 | transition_key=9:0:7:c2eb7813-bdec-4a6a-b84c-2918ad8d7ea1 op_key=nco_cognos_monitor_0
Oct 08 20:11:50 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: --- 0.524.16 2
Oct 08 20:11:50 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: +++ 0.524.17 (null)
Oct 08 20:11:50 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib: @num_updates=17
Oct 08 20:11:50 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='nco_omni']/lrm_rsc_op[@id='nco_omni_last_0']: @transition-magic=0:7;7:0:7:c2eb7813-bdec-4a6a-b84c-2918ad8d7ea1, @call-id=29, @rc-code=7, @op-status=0, @exec-time=76
Oct 08 20:11:50 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/41, version=0.524.17)
Oct 08 20:11:50 itnm(nco_itnm)[4299]: ERROR: Cannot find the directory /san/tivoli/netcool!
Oct 08 20:11:50 pplxnsms02 pacemaker-controld [2418] (wait_for_sync_result) info: Cognos_meta-data_0[4306] exited with status 0
Oct 08 20:11:50 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/42)
Oct 08 20:11:50 pplxnsms02 pacemaker-controld [2418] (process_graph_event) info: Transition 0 action 7 (nco_omni_monitor_0 on pplxnsms02) confirmed: not running | rc=7 call-id=29
Oct 08 20:11:50 pplxnsms02 pacemaker-controld [2418] (te_rsc_command) notice: Initiating monitor operation siem_vip_monitor_0 locally on pplxnsms02 | action 10
Oct 08 20:11:50 pplxnsms02 pacemaker-execd [2415] (process_lrmd_get_rsc_info) info: Agent information for 'siem_vip' not in cache
Oct 08 20:11:50 pplxnsms02 pacemaker-execd [2415] (process_lrmd_rsc_register) info: Cached agent information for 'siem_vip'
Oct 08 20:11:50 pplxnsms02 pacemaker-controld [2418] (do_lrm_rsc_op) notice: Requesting local execution of probe operation for siem_vip on pplxnsms02 | transition_key=10:0:7:c2eb7813-bdec-4a6a-b84c-2918ad8d7ea1 op_key=siem_vip_monitor_0
Oct 08 20:11:50 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: --- 0.524.17 2
Oct 08 20:11:50 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: +++ 0.524.18 (null)
Oct 08 20:11:50 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib: @num_updates=18
Oct 08 20:11:50 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: ++ /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources:
Oct 08 20:11:50 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: ++
Oct 08 20:11:50 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/42, version=0.524.18)
Oct 08 20:11:50 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/43)
Oct 08 20:11:50 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: --- 0.524.18 2
Oct 08 20:11:50 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: +++ 0.524.19 (null)
Oct 08 20:11:50 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib: @num_updates=19
Oct 08 20:11:50 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: ++ /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources:
Oct 08 20:11:50 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: ++
Oct 08 20:11:50 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/43, version=0.524.19)
Oct 08 20:11:50 Cognos(nco_cognos)[4324]: ERROR: Cannot find the directory /san/tivoli/IBM/WebSphere!
Oct 08 20:11:50 pplxnsms02 pacemaker-controld [2418] (log_executor_event) notice: Result of probe operation for nco_itnm on pplxnsms02: not running | CIB update 44, graph action confirmed; call=33 key=nco_itnm_monitor_0 rc=7
Oct 08 20:11:50 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/44)
Oct 08 20:11:50 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: --- 0.524.19 2
Oct 08 20:11:50 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: +++ 0.524.20 (null)
Oct 08 20:11:50 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib: @num_updates=20
Oct 08 20:11:50 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='nco_itnm']/lrm_rsc_op[@id='nco_itnm_last_0']: @transition-magic=0:7;8:0:7:c2eb7813-bdec-4a6a-b84c-2918ad8d7ea1, @call-id=33, @rc-code=7, @op-status=0, @exec-time=95
Oct 08 20:11:50 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/44, version=0.524.20)
Oct 08 20:11:50 pplxnsms02 pacemaker-controld [2418] (process_graph_event) info: Transition 0 action 8 (nco_itnm_monitor_0 on pplxnsms02) confirmed: not running | rc=7 call-id=33
Oct 08 20:11:50 pplxnsms02 pacemaker-controld [2418] (te_rsc_command) notice: Initiating monitor operation siem_lvm_monitor_0 locally on pplxnsms02 | action 11
Oct 08 20:11:50 pplxnsms02 pacemaker-execd [2415] (process_lrmd_get_rsc_info) info: Agent information for 'siem_lvm' not in cache
Oct 08 20:11:50 pplxnsms02 pacemaker-execd [2415] (process_lrmd_rsc_register) info: Cached agent information for 'siem_lvm'
Oct 08 20:11:50 pplxnsms02 pacemaker-controld [2418] (do_lrm_rsc_op) notice: Requesting local execution of probe operation for siem_lvm on pplxnsms02 | transition_key=11:0:7:c2eb7813-bdec-4a6a-b84c-2918ad8d7ea1 op_key=siem_lvm_monitor_0
Oct 08 20:11:50 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/45)
Oct 08 20:11:50 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: --- 0.524.20 2
Oct 08 20:11:50 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: +++ 0.524.21 (null)
Oct 08 20:11:50 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib: @num_updates=21
Oct 08 20:11:50 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: ++ /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources:
Oct 08 20:11:50 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: ++
Oct 08 20:11:50 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/45, version=0.524.21)
Oct 08 20:11:50 pplxnsms02 pacemaker-controld [2418] (log_executor_event) notice: Result of probe operation for siem_lvm on pplxnsms02: not running | CIB update 46, graph action confirmed; call=45 key=siem_lvm_monitor_0 rc=7
Oct 08 20:11:50 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/46)
Oct 08 20:11:50 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: --- 0.524.21 2
Oct 08 20:11:50 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: +++ 0.524.22 (null)
Oct 08 20:11:50 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib: @num_updates=22
Oct 08 20:11:50 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='siem_lvm']/lrm_rsc_op[@id='siem_lvm_last_0']: @transition-magic=0:7;11:0:7:c2eb7813-bdec-4a6a-b84c-2918ad8d7ea1, @call-id=45, @rc-code=7, @op-status=0, @exec-time=19
Oct 08 20:11:50 pplxnsms02 pacemaker-controld [2418] (process_graph_event) info: Transition 0 action 11 (siem_lvm_monitor_0 on pplxnsms02) confirmed: not running | rc=7 call-id=45
Oct 08 20:11:50 pplxnsms02 pacemaker-controld [2418] (te_rsc_command) notice: Initiating monitor operation siem_fs_monitor_0 locally on pplxnsms02 | action 12
Oct 08 20:11:50 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/46, version=0.524.22)
Oct 08 20:11:50 pplxnsms02 pacemaker-execd [2415] (process_lrmd_get_rsc_info) info: Agent information for 'siem_fs' not in cache
Oct 08 20:11:50 pplxnsms02 pacemaker-execd [2415] (process_lrmd_rsc_register) info: Cached agent information for 'siem_fs'
Oct 08 20:11:50 pplxnsms02 pacemaker-controld [2418] (do_lrm_rsc_op) notice: Requesting local execution of probe operation for siem_fs on pplxnsms02 | transition_key=12:0:7:c2eb7813-bdec-4a6a-b84c-2918ad8d7ea1 op_key=siem_fs_monitor_0
Oct 08 20:11:50 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/47)
Oct 08 20:11:50 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: --- 0.524.22 2
Oct 08 20:11:50 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: +++ 0.524.23 (null)
Oct 08 20:11:50 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib: @num_updates=23
Oct 08 20:11:50 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: ++ /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources:
Oct 08 20:11:50 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: ++
Oct 08 20:11:50 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/47, version=0.524.23)
Oct 08 20:11:50 pplxnsms02 pacemaker-controld [2418] (log_executor_event) notice: Result of probe operation for nco_cognos on pplxnsms02: not running | CIB update 48, graph action confirmed; call=37 key=nco_cognos_monitor_0 rc=7
Oct 08 20:11:50 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/48)
Oct 08 20:11:50 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: --- 0.524.23 2
Oct 08 20:11:50 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: +++ 0.524.24 (null)
Oct 08 20:11:50 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib: @num_updates=24
Oct 08 20:11:50 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='nco_cognos']/lrm_rsc_op[@id='nco_cognos_last_0']: @transition-magic=0:7;9:0:7:c2eb7813-bdec-4a6a-b84c-2918ad8d7ea1, @call-id=37, @rc-code=7, @op-status=0, @exec-time=108
Oct 08 20:11:50 pplxnsms02 pacemaker-controld [2418] (process_graph_event) info: Transition 0 action 9 (nco_cognos_monitor_0 on pplxnsms02) confirmed: not running | rc=7 call-id=37
Oct 08 20:11:50 pplxnsms02 pacemaker-controld [2418] (te_rsc_command) notice: Initiating monitor operation siem_rsyslog_monitor_0 locally on pplxnsms02 | action 13
Oct 08 20:11:50 pplxnsms02 pacemaker-execd [2415] (process_lrmd_get_rsc_info) info: Agent information for 'siem_rsyslog' not in cache
Oct 08 20:11:50 pplxnsms02 pacemaker-execd [2415] (process_lrmd_rsc_register) info: Cached agent information for 'siem_rsyslog'
Oct 08 20:11:50 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/48, version=0.524.24)
Oct 08 20:11:50 pplxnsms02 pacemaker-controld [2418] (do_lrm_rsc_op) notice: Requesting local execution of probe operation for siem_rsyslog on pplxnsms02 | transition_key=13:0:7:c2eb7813-bdec-4a6a-b84c-2918ad8d7ea1 op_key=siem_rsyslog_monitor_0
Oct 08 20:11:50 pplxnsms02 pacemaker-controld [2418] (wait_for_sync_result) info: siemsyslog_meta-data_0[4385] exited with status 0
Oct 08 20:11:50 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/49)
Oct 08 20:11:50 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: --- 0.524.24 2
Oct 08 20:11:50 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: +++ 0.524.25 (null)
Oct 08 20:11:50 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib: @num_updates=25
Oct 08 20:11:50 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: ++ /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources:
Oct 08 20:11:50 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: ++
Oct 08 20:11:50 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/49, version=0.524.25)
Oct 08 20:11:50 pplxnsms02 pacemaker-controld [2418] (log_executor_event) notice: Result of probe operation for siem_vip on pplxnsms02: not running | CIB update 50, graph action confirmed; call=41 key=siem_vip_monitor_0 rc=7
Oct 08 20:11:50 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/50)
Oct 08 20:11:50 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: --- 0.524.25 2
Oct 08 20:11:50 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: +++ 0.524.26 (null)
Oct 08 20:11:50 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib: @num_updates=26
Oct 08 20:11:50 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='siem_vip']/lrm_rsc_op[@id='siem_vip_last_0']: @transition-magic=0:7;10:0:7:c2eb7813-bdec-4a6a-b84c-2918ad8d7ea1, @call-id=41, @rc-code=7, @op-status=0, @exec-time=171
Oct 08 20:11:50 pplxnsms02 pacemaker-controld [2418] (process_graph_event) info: Transition 0 action 10 (siem_vip_monitor_0 on pplxnsms02) confirmed: not running | rc=7 call-id=41
Oct 08 20:11:50 pplxnsms02 pacemaker-controld [2418] (te_rsc_command) notice: Initiating monitor operation web_mariadb_monitor_0 locally on pplxnsms02 | action 14
Oct 08 20:11:50 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/50, version=0.524.26)
Oct 08 20:11:50 pplxnsms02 pacemaker-execd [2415] (process_lrmd_get_rsc_info) info: Agent information for 'web_mariadb' not in cache
Oct 08 20:11:50 pplxnsms02 pacemaker-execd [2415] (process_lrmd_rsc_register) info: Cached agent information for 'web_mariadb'
Oct 08 20:11:50 pplxnsms02 pacemaker-controld [2418] (do_lrm_rsc_op) notice: Requesting local execution of probe operation for web_mariadb on pplxnsms02 | transition_key=14:0:7:c2eb7813-bdec-4a6a-b84c-2918ad8d7ea1 op_key=web_mariadb_monitor_0
Oct 08 20:11:50 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_0[4416] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 2972 1 0 20:11 ? 00:00:00 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:11:50 pplxnsms02 pacemaker-fenced [2414] (dynamic_list_search_cb) info: Refreshing target list for fence-sbd
Oct 08 20:11:50 pplxnsms02 pacemaker-fenced [2414] (process_remote_stonith_query) info: Query result 1 of 1 from pplxnsms02 for pplxnsms01/reboot (1 device) 579697b4-f37c-49e8-9c60-ce3bd361da29
Oct 08 20:11:50 pplxnsms02 pacemaker-fenced [2414] (process_remote_stonith_query) info: All query replies have arrived, continuing (1 expected/1 received)
Oct 08 20:11:50 pplxnsms02 pacemaker-fenced [2414] (request_peer_fencing) info: Total timeout set to 60 for peer's fencing targeting pplxnsms01 for pacemaker-controld.2418|id=579697b4
Oct 08 20:11:50 pplxnsms02 pacemaker-fenced [2414] (request_peer_fencing) notice: Requesting that pplxnsms02 perform 'reboot' action targeting pplxnsms01 | for client pacemaker-controld.2418 (72s, 0s)
Oct 08 20:11:50 pplxnsms02 pacemaker-fenced [2414] (can_fence_host_with_device) notice: fence-sbd is eligible to fence (reboot) pplxnsms01: dynamic-list
Oct 08 20:11:50 pplxnsms02 pacemaker-fenced [2414] (stonith_fence_get_devices_cb) info: Found 1 matching device for target 'pplxnsms01'
Oct 08 20:11:50 pplxnsms02 pacemaker-controld [2418] (wait_for_sync_result) info: mysql_meta-data_0[4437] exited with status 0
Oct 08 20:11:50 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/51)
Oct 08 20:11:50 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: --- 0.524.26 2
Oct 08 20:11:50 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: +++ 0.524.27 (null)
Oct 08 20:11:50 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib: @num_updates=27
Oct 08 20:11:50 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: ++ /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources:
Oct 08 20:11:50 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: ++
Oct 08 20:11:50 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/51, version=0.524.27)
Oct 08 20:11:50 pplxnsms02 pacemaker-controld [2418] (log_executor_event) notice: Result of probe operation for siem_rsyslog on pplxnsms02: not running | CIB update 52, graph action confirmed; call=53 key=siem_rsyslog_monitor_0 rc=7
Oct 08 20:11:50 pplxnsms02 pacemaker-controld [2418] (log_executor_event) notice: siem_rsyslog_monitor_0@pplxnsms02 output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 2972 1 0 20:11 ? 00:00:00 /usr/sbin/rsyslogd -n: integer expression expected\n ]
Oct 08 20:11:50 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/52)
Oct 08 20:11:50 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: --- 0.524.27 2
Oct 08 20:11:50 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: +++ 0.524.28 (null)
Oct 08 20:11:50 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib: @num_updates=28
Oct 08 20:11:50 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='siem_rsyslog']/lrm_rsc_op[@id='siem_rsyslog_last_0']: @transition-magic=0:7;13:0:7:c2eb7813-bdec-4a6a-b84c-2918ad8d7ea1, @call-id=53, @rc-code=7, @op-status=0, @exec-time=75
Oct 08 20:11:50 pplxnsms02 pacemaker-controld [2418] (process_graph_event) info: Transition 0 action 13 (siem_rsyslog_monitor_0 on pplxnsms02) confirmed: not running | rc=7 call-id=53
Oct 08 20:11:50 pplxnsms02 pacemaker-controld [2418] (te_rsc_command) notice: Initiating monitor operation web_matomo_monitor_0 locally on pplxnsms02 | action 15
Oct 08 20:11:50 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/52, version=0.524.28)
Oct 08 20:11:50 pplxnsms02 pacemaker-execd [2415] (process_lrmd_get_rsc_info) info: Agent information for 'web_matomo' not in cache
Oct 08 20:11:50 pplxnsms02 pacemaker-execd [2415] (process_lrmd_rsc_register) info: Cached agent information for 'web_matomo'
Oct 08 20:11:50 pplxnsms02 pacemaker-controld [2418] (do_lrm_rsc_op) notice: Requesting local execution of probe operation for web_matomo on pplxnsms02 | transition_key=15:0:7:c2eb7813-bdec-4a6a-b84c-2918ad8d7ea1 op_key=web_matomo_monitor_0
Oct 08 20:11:50 Filesystem(siem_fs)[4370]: WARNING: Couldn't find device [/dev/vgslog/lv_log01]. Expected /dev/??? to exist
Oct 08 20:11:50 pplxnsms02 pacemaker-controld [2418] (wait_for_sync_result) info: apache_meta-data_0[4551] exited with status 0
Oct 08 20:11:50 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/53)
Oct 08 20:11:50 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: --- 0.524.28 2
Oct 08 20:11:50 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: +++ 0.524.29 (null)
Oct 08 20:11:50 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib: @num_updates=29
Oct 08 20:11:50 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: ++ /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources:
Oct 08 20:11:50 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: ++
Oct 08 20:11:50 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/53, version=0.524.29)
Oct 08 20:11:51 pplxnsms02 pacemaker-controld [2418] (log_executor_event) notice: Result of probe operation for siem_fs on pplxnsms02: not running | CIB update 54, graph action confirmed; call=49 key=siem_fs_monitor_0 rc=7
Oct 08 20:11:51 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/54)
Oct 08 20:11:51 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: --- 0.524.29 2
Oct 08 20:11:51 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: +++ 0.524.30 (null)
Oct 08 20:11:51 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib: @num_updates=30
Oct 08 20:11:51 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='siem_fs']/lrm_rsc_op[@id='siem_fs_last_0']: @transition-magic=0:7;12:0:7:c2eb7813-bdec-4a6a-b84c-2918ad8d7ea1, @call-id=49, @rc-code=7, @op-status=0, @exec-time=469
Oct 08 20:11:51 pplxnsms02 pacemaker-controld [2418] (process_graph_event) info: Transition 0 action 12 (siem_fs_monitor_0 on pplxnsms02) confirmed: not running | rc=7 call-id=49
Oct 08 20:11:51 pplxnsms02 pacemaker-controld [2418] (te_rsc_command) notice: Initiating monitor operation fence-sbd_monitor_0 locally on pplxnsms02 | action 16
Oct 08 20:11:51 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/54, version=0.524.30)
Oct 08 20:11:51 pplxnsms02 pacemaker-execd [2415] (process_lrmd_get_rsc_info) info: Agent information for 'fence-sbd' not in cache
Oct 08 20:11:51 pplxnsms02 pacemaker-execd [2415] (process_lrmd_rsc_register) info: Cached agent information for 'fence-sbd'
Oct 08 20:11:51 pplxnsms02 pacemaker-controld [2418] (do_lrm_rsc_op) notice: Requesting local execution of probe operation for fence-sbd on pplxnsms02 | transition_key=16:0:7:c2eb7813-bdec-4a6a-b84c-2918ad8d7ea1 op_key=fence-sbd_monitor_0
Oct 08 20:11:51 pplxnsms02 pacemaker-controld [2418] (wait_for_sync_result) info: fence_sbd_metadata_1[4775] exited with status 0
Oct 08 20:11:51 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/55)
Oct 08 20:11:51 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: --- 0.524.30 2
Oct 08 20:11:51 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: +++ 0.524.31 (null)
Oct 08 20:11:51 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib: @num_updates=31
Oct 08 20:11:51 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: ++ /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources:
Oct 08 20:11:51 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: ++
Oct 08 20:11:51 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/55, version=0.524.31)
Oct 08 20:11:51 pplxnsms02 pacemaker-controld [2418] (log_executor_event) notice: Result of probe operation for fence-sbd on pplxnsms02: not running | CIB update 56, graph action confirmed; call=65 key=fence-sbd_monitor_0 rc=7
Oct 08 20:11:51 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/56)
Oct 08 20:11:51 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: --- 0.524.31 2
Oct 08 20:11:51 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: +++ 0.524.32 (null)
Oct 08 20:11:51 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib: @num_updates=32
Oct 08 20:11:51 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='fence-sbd']/lrm_rsc_op[@id='fence-sbd_last_0']: @transition-magic=0:7;16:0:7:c2eb7813-bdec-4a6a-b84c-2918ad8d7ea1, @call-id=65, @rc-code=7, @op-status=0, @exec-time=8
Oct 08 20:11:51 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/56, version=0.524.32)
Oct 08 20:11:51 pplxnsms02 pacemaker-controld [2418] (process_graph_event) info: Transition 0 action 16 (fence-sbd_monitor_0 on pplxnsms02) confirmed: not running | rc=7 call-id=65
Oct 08 20:11:51 apache(web_matomo)[4650]: INFO: apache not running
Oct 08 20:11:51 mysql(web_mariadb)[4541]: ERROR: Datadir /siemlog/mysql doesn't exist
Oct 08 20:11:51 pplxnsms02 pacemaker-controld [2418] (log_executor_event) notice: Result of probe operation for web_matomo on pplxnsms02: not running | CIB update 57, graph action confirmed; call=61 key=web_matomo_monitor_0 rc=7
Oct 08 20:11:51 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/57)
Oct 08 20:11:51 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: --- 0.524.32 2
Oct 08 20:11:51 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: +++ 0.524.33 (null)
Oct 08 20:11:51 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib: @num_updates=33
Oct 08 20:11:51 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='web_matomo']/lrm_rsc_op[@id='web_matomo_last_0']: @transition-magic=0:7;15:0:7:c2eb7813-bdec-4a6a-b84c-2918ad8d7ea1, @call-id=61, @rc-code=7, @op-status=0, @exec-time=293
Oct 08 20:11:51 pplxnsms02 pacemaker-controld [2418] (process_graph_event) info: Transition 0 action 15 (web_matomo_monitor_0 on pplxnsms02) confirmed: not running | rc=7 call-id=61
Oct 08 20:11:51 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/57, version=0.524.33)
Oct 08 20:11:51 mysql(web_mariadb)[4541]: INFO: MySQL is not running
Oct 08 20:11:51 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: web_mariadb_monitor_0[4541] error output [ ocf-exit-reason:Datadir /siemlog/mysql doesn't exist ]
Oct 08 20:11:51 pplxnsms02 pacemaker-controld [2418] (log_executor_event) notice: Result of probe operation for web_mariadb on pplxnsms02: not running (Datadir /siemlog/mysql doesn't exist) | CIB update 58, graph action confirmed; call=57 key=web_mariadb_monitor_0 rc=7
Oct 08 20:11:51 pplxnsms02 pacemaker-controld [2418] (log_executor_event) notice: web_mariadb_monitor_0@pplxnsms02 output [ ocf-exit-reason:Datadir /siemlog/mysql doesn't exist\n ]
Oct 08 20:11:51 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/58)
Oct 08 20:11:51 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: --- 0.524.33 2
Oct 08 20:11:51 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: +++ 0.524.34 (null)
Oct 08 20:11:51 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib: @num_updates=34
Oct 08 20:11:51 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='web_mariadb']/lrm_rsc_op[@id='web_mariadb_last_0']: @transition-magic=0:7;14:0:7:c2eb7813-bdec-4a6a-b84c-2918ad8d7ea1, @call-id=57, @rc-code=7, @op-status=0, @exec-time=463
Oct 08 20:11:51 pplxnsms02 pacemaker-controld [2418] (process_graph_event) info: Transition 0 action 14 (web_mariadb_monitor_0 on pplxnsms02) confirmed: not running | rc=7 call-id=57
Oct 08 20:11:51 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/58, version=0.524.34)
Oct 08 20:11:52 pplxnsms02 pacemaker-controld [2418] (log_executor_event) notice: Result of probe operation for nco_db2 on pplxnsms02: not running | CIB update 59, graph action confirmed; call=25 key=nco_db2_monitor_0 rc=7
Oct 08 20:11:52 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/59)
Oct 08 20:11:52 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: --- 0.524.34 2
Oct 08 20:11:52 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: +++ 0.524.35 (null)
Oct 08 20:11:52 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib: @num_updates=35
Oct 08 20:11:52 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='nco_db2']/lrm_rsc_op[@id='nco_db2_last_0']: @transition-magic=0:7;6:0:7:c2eb7813-bdec-4a6a-b84c-2918ad8d7ea1, @call-id=25, @rc-code=7, @op-status=0, @exec-time=2798
Oct 08 20:11:52 pplxnsms02 pacemaker-controld [2418] (process_graph_event) info: Transition 0 action 6 (nco_db2_monitor_0 on pplxnsms02) confirmed: not running | rc=7 call-id=25
Oct 08 20:11:52 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/59, version=0.524.35)
Oct 08 20:11:57 pplxnsms02 pacemaker-based [2413] (cib_process_ping) info: Reporting our current digest to pplxnsms02: 9eb1078d31ad025bb0e5d44467e650f5 for 0.524.35 (0x55cd0e8c2e30 0)
Oct 08 20:11:58 pplxnsms02 pacemaker-controld [2418] (pcmk__procfs_pid_of) info: Found pacemaker-based active as process 2413
Oct 08 20:11:58 pplxnsms02 pacemaker-controld [2418] (throttle_check_thresholds) info: Moderate CPU load detected: 5.730000
Oct 08 20:11:58 pplxnsms02 pacemaker-controld [2418] (throttle_send_command) info: New throttle mode: medium load (was undetermined)
Oct 08 20:12:11 pplxnsms02 pacemaker-fenced [2414] (log_async_result) notice: Operation 'reboot' [4481] targeting pplxnsms01 using fence-sbd returned 0 | call 4 from pacemaker-controld.2418
Oct 08 20:12:11 pplxnsms02 pacemaker-fenced [2414] (finalize_op) notice: Operation 'reboot' targeting pplxnsms01 by pplxnsms02 for pacemaker-controld.2418@pplxnsms02: OK (complete) | id=579697b4
Oct 08 20:12:11 pplxnsms02 pacemaker-controld [2418] (tengine_stonith_callback) notice: Fence operation 4 for pplxnsms01 passed
Oct 08 20:12:11 pplxnsms02 pacemaker-controld [2418] (update_peer_state_iter) notice: Node pplxnsms01 state is now lost | nodeid=1 previous=unknown source=crmd_peer_down
Oct 08 20:12:11 pplxnsms02 pacemaker-controld [2418] (peer_update_callback) info: Cluster node pplxnsms01 is now lost (was in unknown state)
Oct 08 20:12:11 pplxnsms02 pacemaker-controld [2418] (crm_update_peer_proc) info: crmd_peer_down: Node pplxnsms01[1] - all processes are now offline
Oct 08 20:12:11 pplxnsms02 pacemaker-controld [2418] (peer_update_callback) info: Node pplxnsms01 is no longer a peer | DC=true old=0x0000000 new=0x0000001
Oct 08 20:12:11 pplxnsms02 pacemaker-controld [2418] (pcmk__update_peer_expected) info: crmd_peer_down: Node pplxnsms01[1] - expected state is now down (was (null))
Oct 08 20:12:11 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/60)
Oct 08 20:12:11 pplxnsms02 pacemaker-controld [2418] (controld_delete_node_state) info: Deleting all state for node pplxnsms01 (via CIB call 62) | xpath=//node_state[@uname='pplxnsms01']/*
Oct 08 20:12:11 pplxnsms02 pacemaker-controld [2418] (handle_fence_notification) notice: Peer pplxnsms01 was terminated (reboot) by pplxnsms02 on behalf of pacemaker-controld.2418@pplxnsms02: OK | event=579697b4-f37c-49e8-9c60-ce3bd361da29
Oct 08 20:12:11 pplxnsms02 pacemaker-controld [2418] (controld_delete_node_state) info: Deleting all state for node pplxnsms01 (via CIB call 64) | xpath=//node_state[@uname='pplxnsms01']/*
Oct 08 20:12:11 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: --- 0.524.35 2
Oct 08 20:12:11 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: +++ 0.524.36 (null)
Oct 08 20:12:11 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib: @num_updates=36
Oct 08 20:12:11 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: ++ /cib/status:
Oct 08 20:12:11 pplxnsms02 pacemaker-controld [2418] (te_rsc_command) notice: Initiating start operation itm_vip_start_0 locally on pplxnsms02 | action 17
Oct 08 20:12:11 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/60, version=0.524.36)
Oct 08 20:12:11 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/61)
Oct 08 20:12:11 pplxnsms02 pacemaker-controld [2418] (do_lrm_rsc_op) notice: Requesting local execution of start operation for itm_vip on pplxnsms02 | transition_key=17:0:0:c2eb7813-bdec-4a6a-b84c-2918ad8d7ea1 op_key=itm_vip_start_0
Oct 08 20:12:11 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Forwarding cib_delete operation for section //node_state[@uname='pplxnsms01']/* to all (origin=local/crmd/62)
Oct 08 20:12:11 pplxnsms02 pacemaker-execd [2415] (log_execute) info: executing - rsc:itm_vip action:start call_id:66
Oct 08 20:12:11 pplxnsms02 pacemaker-controld [2418] (te_rsc_command) notice: Initiating start operation siem_vip_start_0 locally on pplxnsms02 | action 39
Oct 08 20:12:11 pplxnsms02 pacemaker-controld [2418] (do_lrm_rsc_op) notice: Requesting local execution of start operation for siem_vip on pplxnsms02 | transition_key=39:0:0:c2eb7813-bdec-4a6a-b84c-2918ad8d7ea1 op_key=siem_vip_start_0
Oct 08 20:12:11 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/63)
Oct 08 20:12:11 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Forwarding cib_delete operation for section //node_state[@uname='pplxnsms01']/* to all (origin=local/crmd/64)
Oct 08 20:12:11 pplxnsms02 pacemaker-execd [2415] (log_execute) info: executing - rsc:siem_vip action:start call_id:67
Oct 08 20:12:11 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: --- 0.524.36 2
Oct 08 20:12:11 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: +++ 0.524.37 (null)
Oct 08 20:12:11 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib: @num_updates=37
Oct 08 20:12:11 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib/status/node_state[@id='1']: @crm-debug-origin=send_stonith_update, @in_ccm=false, @join=down, @expected=down
Oct 08 20:12:11 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/61, version=0.524.37)
Oct 08 20:12:11 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Completed cib_delete operation for section //node_state[@uname='pplxnsms01']/*: OK (rc=0, origin=pplxnsms02/crmd/62, version=0.524.37)
Oct 08 20:12:11 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/63, version=0.524.37)
Oct 08 20:12:11 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Completed cib_delete operation for section //node_state[@uname='pplxnsms01']/*: OK (rc=0, origin=pplxnsms02/crmd/64, version=0.524.37)
Oct 08 20:12:11 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/65)
Oct 08 20:12:11 pplxnsms02 pacemaker-controld [2418] (cib_fencing_updated) info: Fencing update 61 for pplxnsms01: complete
Oct 08 20:12:11 pplxnsms02 pacemaker-controld [2418] (cib_fencing_updated) info: Fencing update 63 for pplxnsms01: complete
Oct 08 20:12:11 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/66)
Oct 08 20:12:11 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: --- 0.524.37 2
Oct 08 20:12:11 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: +++ 0.524.38 (null)
Oct 08 20:12:11 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib: @num_updates=38
Oct 08 20:12:11 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='itm_vip']/lrm_rsc_op[@id='itm_vip_last_0']: @operation_key=itm_vip_start_0, @operation=start, @transition-key=17:0:0:c2eb7813-bdec-4a6a-b84c-2918ad8d7ea1, @transition-magic=-1:193;17:0:0:c2eb7813-bdec-4a6a-b84c-2918ad8d7ea1, @call-id=-1, @rc-code=193, @op-status=-1, @last-rc-change=1728389531, @exec-time=0
Oct 08 20:12:11 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/65, version=0.524.38)
Oct 08 20:12:11 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: --- 0.524.38 2
Oct 08 20:12:11 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: +++ 0.524.39 (null)
Oct 08 20:12:11 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib: @num_updates=39
Oct 08 20:12:11 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='siem_vip']/lrm_rsc_op[@id='siem_vip_last_0']: @operation_key=siem_vip_start_0, @operation=start, @transition-key=39:0:0:c2eb7813-bdec-4a6a-b84c-2918ad8d7ea1, @transition-magic=-1:193;39:0:0:c2eb7813-bdec-4a6a-b84c-2918ad8d7ea1, @call-id=-1, @rc-code=193, @op-status=-1, @last-rc-change=1728389531, @exec-time=0
Oct 08 20:12:11 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/66, version=0.524.39)
Oct 08 20:12:11 IPaddr2(itm_vip)[6427]: INFO: Adding inet address 192.168.133.136/24 with broadcast address 192.168.133.255 to device ens224
Oct 08 20:12:11 IPaddr2(siem_vip)[6428]: INFO: Adding inet address 192.168.133.40/24 with broadcast address 192.168.133.255 to device ens224
Oct 08 20:12:11 IPaddr2(itm_vip)[6427]: INFO: Bringing device ens224 up
Oct 08 20:12:11 IPaddr2(siem_vip)[6428]: INFO: Bringing device ens224 up
Oct 08 20:12:11 IPaddr2(itm_vip)[6427]: INFO: /usr/libexec/heartbeat/send_arp -i 200 -r 5 -p /run/resource-agents/send_arp-192.168.133.136 ens224 192.168.133.136 auto not_used not_used
Oct 08 20:12:11 IPaddr2(siem_vip)[6428]: INFO: /usr/libexec/heartbeat/send_arp -i 200 -r 5 -p /run/resource-agents/send_arp-192.168.133.40 ens224 192.168.133.40 auto not_used not_used
Oct 08 20:12:11 pplxnsms02 pacemaker-execd [2415] (log_finished) info: itm_vip start (call 66, PID 6427) exited with status 0 (execution time 93ms)
Oct 08 20:12:11 pplxnsms02 pacemaker-execd [2415] (log_finished) info: siem_vip start (call 67, PID 6428) exited with status 0 (execution time 97ms)
Oct 08 20:12:11 pplxnsms02 pacemaker-controld [2418] (wait_for_sync_result) info: IPaddr2_meta-data_0[6573] exited with status 0
Oct 08 20:12:11 pplxnsms02 pacemaker-controld [2418] (log_executor_event) notice: Result of start operation for itm_vip on pplxnsms02: ok | CIB update 67, graph action confirmed; call=66 key=itm_vip_start_0 rc=0
Oct 08 20:12:11 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/67)
Oct 08 20:12:11 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: --- 0.524.39 2
Oct 08 20:12:11 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: +++ 0.524.40 (null)
Oct 08 20:12:11 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib: @num_updates=40
Oct 08 20:12:11 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='itm_vip']/lrm_rsc_op[@id='itm_vip_last_0']: @transition-magic=0:0;17:0:0:c2eb7813-bdec-4a6a-b84c-2918ad8d7ea1, @call-id=66, @rc-code=0, @op-status=0, @exec-time=93
Oct 08 20:12:11 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/67, version=0.524.40)
Oct 08 20:12:11 pplxnsms02 pacemaker-controld [2418] (wait_for_sync_result) info: IPaddr2_meta-data_0[6587] exited with status 0
Oct 08 20:12:11 pplxnsms02 pacemaker-controld [2418] (log_executor_event) notice: Result of start operation for siem_vip on pplxnsms02: ok | CIB update 68, graph action confirmed; call=67 key=siem_vip_start_0 rc=0
Oct 08 20:12:11 pplxnsms02 pacemaker-controld [2418] (process_graph_event) info: Transition 0 action 17 (itm_vip_start_0 on pplxnsms02) confirmed: ok | rc=0 call-id=66
Oct 08 20:12:11 pplxnsms02 pacemaker-controld [2418] (te_rsc_command) notice: Initiating monitor operation itm_vip_monitor_10000 locally on pplxnsms02 | action 18
Oct 08 20:12:11 pplxnsms02 pacemaker-controld [2418] (do_lrm_rsc_op) notice: Requesting local execution of monitor operation for itm_vip on pplxnsms02 | transition_key=18:0:0:c2eb7813-bdec-4a6a-b84c-2918ad8d7ea1 op_key=itm_vip_monitor_10000
Oct 08 20:12:11 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/68)
Oct 08 20:12:11 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/69)
Oct 08 20:12:11 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: --- 0.524.40 2
Oct 08 20:12:11 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: +++ 0.524.41 (null)
Oct 08 20:12:11 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib: @num_updates=41
Oct 08 20:12:11 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='siem_vip']/lrm_rsc_op[@id='siem_vip_last_0']: @transition-magic=0:0;39:0:0:c2eb7813-bdec-4a6a-b84c-2918ad8d7ea1, @call-id=67, @rc-code=0, @op-status=0, @exec-time=97
Oct 08 20:12:11 pplxnsms02 pacemaker-controld [2418] (process_graph_event) info: Transition 0 action 39 (siem_vip_start_0 on pplxnsms02) confirmed: ok | rc=0 call-id=67
Oct 08 20:12:11 pplxnsms02 pacemaker-controld [2418] (te_rsc_command) notice: Initiating start operation itm_lvm_start_0 locally on pplxnsms02 | action 19
Oct 08 20:12:11 pplxnsms02 pacemaker-controld [2418] (do_lrm_rsc_op) notice: Requesting local execution of start operation for itm_lvm on pplxnsms02 | transition_key=19:0:0:c2eb7813-bdec-4a6a-b84c-2918ad8d7ea1 op_key=itm_lvm_start_0
Oct 08 20:12:11 pplxnsms02 pacemaker-execd [2415] (log_execute) info: executing - rsc:itm_lvm action:start call_id:69
Oct 08 20:12:11 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/68, version=0.524.41)
Oct 08 20:12:11 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: --- 0.524.41 2
Oct 08 20:12:11 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: +++ 0.524.42 (null)
Oct 08 20:12:11 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib: @num_updates=42
Oct 08 20:12:11 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: ++ /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='itm_vip']: S_INTEGRATION | input=I_NODE_JOIN cause=C_FSA_INTERNAL origin=peer_update_callback
Oct 08 20:12:13 pplxnsms02 pacemaker-controld [2418] (do_dc_join_offer_one) info: Making join-1 offers to any unconfirmed nodes because an unknown node joined
Oct 08 20:12:13 pplxnsms02 pacemaker-controld [2418] (join_make_offer) info: Making join-1 offers based on membership event 1354
Oct 08 20:12:13 pplxnsms02 pacemaker-controld [2418] (join_make_offer) info: Sending join-1 offer to pplxnsms01
Oct 08 20:12:13 pplxnsms02 pacemaker-controld [2418] (join_make_offer) info: Not making join-1 offer to already known node pplxnsms02 (confirmed)
Oct 08 20:12:13 pplxnsms02 pacemaker-controld [2418] (abort_transition_graph) notice: Transition 0 aborted: Peer Halt | source=do_te_invoke:135 complete=false
Oct 08 20:12:13 pplxnsms02 pacemaker-attrd [2416] (crm_get_peer) info: Created entry db91bba2-c983-48e4-aa49-9532dea5d18d/0x561a57b81610 for node pplxnsms01/1 (2 total)
Oct 08 20:12:13 pplxnsms02 pacemaker-attrd [2416] (crm_get_peer) info: Node 1 is now known as pplxnsms01
Oct 08 20:12:13 pplxnsms02 pacemaker-attrd [2416] (crm_get_peer) info: Node 1 has uuid 1
Oct 08 20:12:13 pplxnsms02 pacemaker-attrd [2416] (pcmk_cpg_membership) info: Group attrd event 1: pplxnsms01 (node 1 pid 2374) is member
Oct 08 20:12:13 pplxnsms02 pacemaker-attrd [2416] (crm_update_peer_proc) info: pcmk_cpg_membership: Node pplxnsms01[1] - corosync-cpg is now online
Oct 08 20:12:13 pplxnsms02 pacemaker-attrd [2416] (update_peer_state_iter) notice: Node pplxnsms01 state is now member | nodeid=1 previous=unknown source=crm_update_peer_proc
Oct 08 20:12:13 pplxnsms02 pacemaker-attrd [2416] (pcmk_cpg_membership) info: Group attrd event 1: pplxnsms02 (node 2 pid 2416) is member
Oct 08 20:12:13 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/93)
Oct 08 20:12:13 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: --- 0.524.62 2
Oct 08 20:12:13 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: +++ 0.524.63 (null)
Oct 08 20:12:13 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib: @num_updates=63
Oct 08 20:12:13 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib/status/node_state[@id='1']: @crmd=online, @crm-debug-origin=peer_update_callback
Oct 08 20:12:13 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/93, version=0.524.63)
Oct 08 20:12:13 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Completed cib_delete operation for section //node_state[@uname='pplxnsms01']/transient_attributes: OK (rc=0, origin=pplxnsms01/attrd/2, version=0.524.63)
Oct 08 20:12:13 pplxnsms02 pacemaker-attrd [2416] (attrd_peer_update) notice: Setting #attrd-protocol[pplxnsms01]: (unset) -> 3 | from pplxnsms01
Oct 08 20:12:13 pplxnsms02 pacemaker-attrd [2416] (write_attribute) info: Processed 2 private changes for #attrd-protocol, id=n/a, set=n/a
Oct 08 20:12:13 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Completed cib_modify operation for section nodes: OK (rc=0, origin=pplxnsms01/crmd/4, version=0.524.63)
Oct 08 20:12:13 pplxnsms02 pacemaker-controld [2418] (log_executor_event) notice: Result of monitor operation for itm_fs on pplxnsms02: ok | CIB update 94, graph action unconfirmed; call=77 key=itm_fs_monitor_20000 rc=0
Oct 08 20:12:13 pplxnsms02 pacemaker-controld [2418] (abort_transition_graph) info: Transition 0 aborted: Peer Halt | source=do_te_invoke:135 complete=false
Oct 08 20:12:13 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/94)
Oct 08 20:12:13 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: --- 0.524.63 2
Oct 08 20:12:13 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: +++ 0.524.64 (null)
Oct 08 20:12:13 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib: @num_updates=64
Oct 08 20:12:13 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='itm_fs']/lrm_rsc_op[@id='itm_fs_monitor_20000']: @transition-magic=0:0;22:0:0:c2eb7813-bdec-4a6a-b84c-2918ad8d7ea1, @call-id=77, @rc-code=0, @op-status=0, @exec-time=96
Oct 08 20:12:13 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/94, version=0.524.64)
Oct 08 20:12:13 pplxnsms02 pacemaker-controld [2418] (process_graph_event) info: Transition 0 action 22 (itm_fs_monitor_20000 on pplxnsms02) confirmed: ok | rc=0 call-id=77
Oct 08 20:12:13 pplxnsms02 pacemaker-controld [2418] (abort_transition_graph) info: Transition 0 aborted: Peer Halt | source=do_te_invoke:135 complete=false
Oct 08 20:12:13 pplxnsms02 pacemaker-controld [2418] (abort_transition_graph) info: Transition 0 aborted: Peer Halt | source=do_te_invoke:135 complete=false
Oct 08 20:12:13 pplxnsms02 pacemaker-controld [2418] (abort_transition_graph) info: Transition 0 aborted: Peer Halt | source=do_te_invoke:135 complete=false
Oct 08 20:12:13 pplxnsms02 pacemaker-controld [2418] (log_executor_event) notice: Result of monitor operation for siem_fs on pplxnsms02: ok | CIB update 95, graph action unconfirmed; call=76 key=siem_fs_monitor_20000 rc=0
Oct 08 20:12:13 pplxnsms02 pacemaker-controld [2418] (abort_transition_graph) info: Transition 0 aborted: Peer Halt | source=do_te_invoke:135 complete=false
Oct 08 20:12:13 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/95)
Oct 08 20:12:13 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: --- 0.524.64 2
Oct 08 20:12:13 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: +++ 0.524.65 (null)
Oct 08 20:12:13 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib: @num_updates=65
Oct 08 20:12:13 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='siem_fs']/lrm_rsc_op[@id='siem_fs_monitor_20000']: @transition-magic=0:0;44:0:0:c2eb7813-bdec-4a6a-b84c-2918ad8d7ea1, @call-id=76, @rc-code=0, @op-status=0, @exec-time=104
Oct 08 20:12:13 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/95, version=0.524.65)
Oct 08 20:12:13 pplxnsms02 pacemaker-controld [2418] (process_graph_event) info: Transition 0 action 44 (siem_fs_monitor_20000 on pplxnsms02) confirmed: ok | rc=0 call-id=76
Oct 08 20:12:13 pplxnsms02 pacemaker-controld [2418] (abort_transition_graph) info: Transition 0 aborted: Peer Halt | source=do_te_invoke:135 complete=false
Oct 08 20:12:13 pplxnsms02 pacemaker-controld [2418] (pcmk__execute_graph) notice: Transition 0 (Complete=31, Pending=0, Fired=0, Skipped=3, Incomplete=17, Source=/var/lib/pacemaker/pengine/pe-warn-102.bz2): Stopped
Oct 08 20:12:13 pplxnsms02 pacemaker-controld [2418] (abort_transition_graph) info: Transition 0 aborted: Peer Halt | source=do_te_invoke:135 complete=true
Oct 08 20:12:14 pplxnsms02 pacemaker-controld [2418] (join_make_offer) info: Sending join-1 offer to pplxnsms01
Oct 08 20:12:14 pplxnsms02 pacemaker-controld [2418] (join_make_offer) info: Sending join-1 offer to pplxnsms02
Oct 08 20:12:14 pplxnsms02 pacemaker-controld [2418] (abort_transition_graph) info: Transition 0 aborted: Node join | source=do_dc_join_offer_one:258 complete=true
Oct 08 20:12:14 pplxnsms02 pacemaker-controld [2418] (do_dc_join_offer_one) info: Waiting on join-1 requests from 2 outstanding nodes
Oct 08 20:12:14 pplxnsms02 pacemaker-controld [2418] (pcmk__update_peer_expected) info: do_dc_join_filter_offer: Node pplxnsms01[1] - expected state is now member (was down)
Oct 08 20:12:14 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: State transition S_INTEGRATION -> S_FINALIZE_JOIN | input=I_INTEGRATED cause=C_FSA_INTERNAL origin=check_join_state
Oct 08 20:12:14 pplxnsms02 pacemaker-based [2413] (cib_process_replace) info: Digest matched on replace from pplxnsms02: fd951501d84a967d5c8454de1aaafe6f
Oct 08 20:12:14 pplxnsms02 pacemaker-based [2413] (cib_process_replace) info: Replaced 0.524.65 with 0.524.65 from pplxnsms02
Oct 08 20:12:14 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Completed cib_replace operation for section 'all': OK (rc=0, origin=pplxnsms02/crmd/97, version=0.524.65)
Oct 08 20:12:14 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Forwarding cib_modify operation for section nodes to all (origin=local/crmd/98)
Oct 08 20:12:14 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Forwarding cib_modify operation for section nodes to all (origin=local/crmd/99)
Oct 08 20:12:14 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Completed cib_modify operation for section nodes: OK (rc=0, origin=pplxnsms02/crmd/98, version=0.524.65)
Oct 08 20:12:14 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Completed cib_modify operation for section nodes: OK (rc=0, origin=pplxnsms02/crmd/99, version=0.524.65)
Oct 08 20:12:14 pplxnsms02 pacemaker-based [2413] (cib_file_backup) info: Archived previous version as /var/lib/pacemaker/cib/cib-53.raw
Oct 08 20:12:14 pplxnsms02 pacemaker-based [2413] (cib_file_write_with_digest) info: Wrote version 0.524.0 of the CIB to disk (digest: 454933a706423a3b4b30749a62f5a48f)
Oct 08 20:12:14 pplxnsms02 pacemaker-based [2413] (cib_file_write_with_digest) info: Reading cluster configuration file /var/lib/pacemaker/cib/cib.76GCqV (digest: /var/lib/pacemaker/cib/cib.rQTepi)
Oct 08 20:12:14 pplxnsms02 pacemaker-controld [2418] (wait_for_sync_result) info: LVM-activate_meta-data_0[7514] exited with status 0
Oct 08 20:12:14 pplxnsms02 pacemaker-controld [2418] (wait_for_sync_result) info: Filesystem_meta-data_0[7519] exited with status 0
Oct 08 20:12:14 pplxnsms02 pacemaker-controld [2418] (wait_for_sync_result) info: LVM-activate_meta-data_0[7572] exited with status 0
Oct 08 20:12:14 pplxnsms02 pacemaker-controld [2418] (wait_for_sync_result) info: Filesystem_meta-data_0[7576] exited with status 0
Oct 08 20:12:14 pplxnsms02 pacemaker-controld [2418] (wait_for_sync_result) info: IPaddr2_meta-data_0[7629] exited with status 0
Oct 08 20:12:14 pplxnsms02 pacemaker-controld [2418] (wait_for_sync_result) info: IPaddr2_meta-data_0[7633] exited with status 0
Oct 08 20:12:14 pplxnsms02 pacemaker-controld [2418] (controld_delete_node_state) info: Deleting resource history for node pplxnsms01 (via CIB call 100) | xpath=//node_state[@uname='pplxnsms01']/lrm
Oct 08 20:12:14 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Forwarding cib_delete operation for section //node_state[@uname='pplxnsms01']/lrm to all (origin=local/crmd/100)
Oct 08 20:12:14 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/101)
Oct 08 20:12:14 pplxnsms02 pacemaker-controld [2418] (controld_delete_node_state) info: Deleting resource history for node pplxnsms02 (via CIB call 102) | xpath=//node_state[@uname='pplxnsms02']/lrm
Oct 08 20:12:14 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Forwarding cib_delete operation for section //node_state[@uname='pplxnsms02']/lrm to all (origin=local/crmd/102)
Oct 08 20:12:14 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Completed cib_delete operation for section //node_state[@uname='pplxnsms01']/lrm: OK (rc=0, origin=pplxnsms02/crmd/100, version=0.524.65)
Oct 08 20:12:14 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: --- 0.524.65 2
Oct 08 20:12:14 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: +++ 0.524.66 (null)
Oct 08 20:12:14 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib: @num_updates=66
Oct 08 20:12:14 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib/status/node_state[@id='1']: @crm-debug-origin=do_lrm_query_internal
Oct 08 20:12:14 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: ++ /cib/status/node_state[@id='1']:
Oct 08 20:12:14 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: ++
Oct 08 20:12:14 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: ++
Oct 08 20:12:14 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/101, version=0.524.66)
Oct 08 20:12:14 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: --- 0.524.66 2
Oct 08 20:12:14 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: +++ 0.524.67 (null)
Oct 08 20:12:14 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: -- /cib/status/node_state[@id='2']/lrm[@id='2']
Oct 08 20:12:14 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib: @num_updates=67
Oct 08 20:12:14 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Completed cib_delete operation for section //node_state[@uname='pplxnsms02']/lrm: OK (rc=0, origin=pplxnsms02/crmd/102, version=0.524.67)
Oct 08 20:12:14 pplxnsms02 pacemaker-controld [2418] (wait_for_sync_result) info: LVM-activate_meta-data_0[7637] exited with status 0
Oct 08 20:12:14 pplxnsms02 pacemaker-controld [2418] (wait_for_sync_result) info: Filesystem_meta-data_0[7641] exited with status 0
Oct 08 20:12:14 pplxnsms02 pacemaker-controld [2418] (wait_for_sync_result) info: LVM-activate_meta-data_0[7694] exited with status 0
Oct 08 20:12:14 pplxnsms02 pacemaker-controld [2418] (wait_for_sync_result) info: Filesystem_meta-data_0[7698] exited with status 0
Oct 08 20:12:14 pplxnsms02 pacemaker-controld [2418] (wait_for_sync_result) info: IPaddr2_meta-data_0[7751] exited with status 0
Oct 08 20:12:14 pplxnsms02 pacemaker-controld [2418] (wait_for_sync_result) info: IPaddr2_meta-data_0[7755] exited with status 0
Oct 08 20:12:14 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/103)
Oct 08 20:12:14 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: State transition S_FINALIZE_JOIN -> S_POLICY_ENGINE | input=I_FINALIZED cause=C_FSA_INTERNAL origin=check_join_state
Oct 08 20:12:14 pplxnsms02 pacemaker-controld [2418] (abort_transition_graph) info: Transition 0 aborted: Peer Cancelled | source=do_te_invoke:129 complete=true
Oct 08 20:12:14 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Forwarding cib_modify operation for section nodes to all (origin=local/crmd/106)
Oct 08 20:12:14 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/107)
Oct 08 20:12:14 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Forwarding cib_modify operation for section cib to all (origin=local/crmd/108)
Oct 08 20:12:14 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: --- 0.524.67 2
Oct 08 20:12:14 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: +++ 0.524.68 (null)
Oct 08 20:12:14 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib: @num_updates=68
Oct 08 20:12:14 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib/status/node_state[@id='2']: @crm-debug-origin=do_lrm_query_internal
Oct 08 20:12:14 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: ++ /cib/status/node_state[@id='2']:
Oct 08 20:12:14 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: ++
Oct 08 20:12:14 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: ++
Oct 08 20:12:14 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: ++
Oct 08 20:12:14 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: ++
Oct 08 20:12:14 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: ++
Oct 08 20:12:14 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: ++
Oct 08 20:12:14 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: ++
Oct 08 20:12:14 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: ++
Oct 08 20:12:14 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: ++
Oct 08 20:12:14 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: ++
Oct 08 20:12:14 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: ++
Oct 08 20:12:14 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: ++
Oct 08 20:12:14 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: ++
Oct 08 20:12:14 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: ++
Oct 08 20:12:14 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: ++
Oct 08 20:12:14 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: ++
Oct 08 20:12:14 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: ++
Oct 08 20:12:14 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: ++
Oct 08 20:12:14 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: ++
Oct 08 20:12:14 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: ++
Oct 08 20:12:14 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: ++
Oct 08 20:12:14 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: ++
Oct 08 20:12:14 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: ++
Oct 08 20:12:14 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: ++
Oct 08 20:12:14 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: ++
Oct 08 20:12:14 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: ++
Oct 08 20:12:14 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: ++
Oct 08 20:12:14 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: ++
Oct 08 20:12:14 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: ++
Oct 08 20:12:14 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: ++
Oct 08 20:12:14 pplxnsms02 pacemaker-controld [2418] (abort_transition_graph) info: Transition 0 aborted: History refresh | source=process_resource_updates:269 complete=true
Oct 08 20:12:14 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/103, version=0.524.68)
Oct 08 20:12:14 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Completed cib_modify operation for section nodes: OK (rc=0, origin=pplxnsms02/crmd/106, version=0.524.68)
Oct 08 20:12:14 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: --- 0.524.68 2
Oct 08 20:12:14 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: +++ 0.524.69 (null)
Oct 08 20:12:14 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib: @num_updates=69
Oct 08 20:12:14 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib/status/node_state[@id='2']: @crm-debug-origin=do_state_transition
Oct 08 20:12:14 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib/status/node_state[@id='1']: @crm-debug-origin=do_state_transition, @join=member, @expected=member
Oct 08 20:12:14 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/107, version=0.524.69)
Oct 08 20:12:14 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Completed cib_modify operation for section cib: OK (rc=0, origin=pplxnsms02/crmd/108, version=0.524.69)
Oct 08 20:12:14 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 08 20:12:14 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) notice: On loss of quorum: Ignore
Oct 08 20:12:14 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 08 20:12:14 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms02 is online
Oct 08 20:12:14 pplxnsms02 pacemaker-schedulerd[2417] (unpack_transient_attributes) info: Node pplxnsms01 is in standby-mode
Oct 08 20:12:14 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 08 20:12:14 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms01 is standby
Oct 08 20:12:14 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 08 20:12:14 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 08 20:12:14 pplxnsms02 pacemaker-schedulerd[2417] (RecurringOp) info: Start recurring monitor (20s) for itm_fs2 on pplxnsms02
Oct 08 20:12:14 pplxnsms02 pacemaker-schedulerd[2417] (RecurringOp) info: Start recurring monitor (20s) for itm_fs3 on pplxnsms02
Oct 08 20:12:14 pplxnsms02 pacemaker-schedulerd[2417] (RecurringOp) info: Start recurring monitor (20s) for nco_db2 on pplxnsms02
Oct 08 20:12:14 pplxnsms02 pacemaker-schedulerd[2417] (RecurringOp) info: Start recurring monitor (60s) for nco_omni on pplxnsms02
Oct 08 20:12:14 pplxnsms02 pacemaker-schedulerd[2417] (RecurringOp) info: Start recurring monitor (300s) for nco_itnm on pplxnsms02
Oct 08 20:12:14 pplxnsms02 pacemaker-schedulerd[2417] (RecurringOp) info: Start recurring monitor (10s) for nco_cognos on pplxnsms02
Oct 08 20:12:14 pplxnsms02 pacemaker-schedulerd[2417] (RecurringOp) info: Start recurring monitor (10s) for siem_rsyslog on pplxnsms02
Oct 08 20:12:14 pplxnsms02 pacemaker-schedulerd[2417] (RecurringOp) info: Start recurring monitor (60s) for fence-sbd on pplxnsms02
Oct 08 20:12:14 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 08 20:12:14 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 08 20:12:14 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 08 20:12:14 pplxnsms02 pacemaker-schedulerd[2417] (log_list_item) notice: Actions: Start itm_fs2 ( pplxnsms02 )
Oct 08 20:12:14 pplxnsms02 pacemaker-schedulerd[2417] (log_list_item) notice: Actions: Start itm_fs3 ( pplxnsms02 )
Oct 08 20:12:14 pplxnsms02 pacemaker-schedulerd[2417] (log_list_item) notice: Actions: Start nco_db2 ( pplxnsms02 )
Oct 08 20:12:14 pplxnsms02 pacemaker-schedulerd[2417] (log_list_item) notice: Actions: Start nco_omni ( pplxnsms02 )
Oct 08 20:12:14 pplxnsms02 pacemaker-schedulerd[2417] (log_list_item) notice: Actions: Start nco_itnm ( pplxnsms02 )
Oct 08 20:12:14 pplxnsms02 pacemaker-schedulerd[2417] (log_list_item) notice: Actions: Start nco_cognos ( pplxnsms02 )
Oct 08 20:12:14 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_vip (Started pplxnsms02)
Oct 08 20:12:14 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms02)
Oct 08 20:12:14 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_fs (Started pplxnsms02)
Oct 08 20:12:14 pplxnsms02 pacemaker-schedulerd[2417] (log_list_item) notice: Actions: Start siem_rsyslog ( pplxnsms02 )
Oct 08 20:12:14 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 08 20:12:14 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 08 20:12:14 pplxnsms02 pacemaker-schedulerd[2417] (log_list_item) notice: Actions: Start fence-sbd ( pplxnsms02 )
Oct 08 20:12:14 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__log_transition_summary) notice: Calculated transition 1, saving inputs in /var/lib/pacemaker/pengine/pe-input-998.bz2
Oct 08 20:12:14 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 08 20:12:14 pplxnsms02 pacemaker-controld [2418] (do_te_invoke) info: Processing graph 1 (ref=pe_calc-dc-1728389534-46) derived from /var/lib/pacemaker/pengine/pe-input-998.bz2
Oct 08 20:12:14 pplxnsms02 pacemaker-controld [2418] (te_rsc_command) notice: Initiating monitor operation itm_vip_monitor_0 on pplxnsms01 | action 7
Oct 08 20:12:14 pplxnsms02 pacemaker-controld [2418] (te_rsc_command) notice: Initiating monitor operation itm_lvm_monitor_0 on pplxnsms01 | action 8
Oct 08 20:12:14 pplxnsms02 pacemaker-controld [2418] (te_rsc_command) notice: Initiating monitor operation itm_fs_monitor_0 on pplxnsms01 | action 9
Oct 08 20:12:14 pplxnsms02 pacemaker-controld [2418] (te_rsc_command) notice: Initiating monitor operation itm_fs2_monitor_0 on pplxnsms01 | action 10
Oct 08 20:12:15 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: --- 0.524.69 2
Oct 08 20:12:15 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: +++ 0.524.70 (null)
Oct 08 20:12:15 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib: @num_updates=70
Oct 08 20:12:15 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib/status/node_state[@id='1']: @crm-debug-origin=do_update_resource
Oct 08 20:12:15 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: ++ /cib/status/node_state[@id='1']/lrm[@id='1']/lrm_resources:
Oct 08 20:12:15 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: ++
Oct 08 20:12:15 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: ++
Oct 08 20:12:16 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: ++
Oct 08 20:12:16 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms01/crmd/10, version=0.524.72)
Oct 08 20:12:16 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: --- 0.524.72 2
Oct 08 20:12:16 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: +++ 0.524.73 (null)
Oct 08 20:12:16 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib: @num_updates=73
Oct 08 20:12:16 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib/status/node_state[@id='1']/lrm[@id='1']/lrm_resources/lrm_resource[@id='itm_lvm']/lrm_rsc_op[@id='itm_lvm_last_0']: @transition-magic=0:7;8:1:7:c2eb7813-bdec-4a6a-b84c-2918ad8d7ea1, @call-id=9, @rc-code=7, @op-status=0, @exec-time=292
Oct 08 20:12:16 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms01/crmd/11, version=0.524.73)
Oct 08 20:12:16 pplxnsms02 pacemaker-controld [2418] (process_graph_event) info: Transition 1 action 8 (itm_lvm_monitor_0 on pplxnsms01) confirmed: not running | rc=7 call-id=9
Oct 08 20:12:16 pplxnsms02 pacemaker-controld [2418] (te_rsc_command) notice: Initiating monitor operation itm_fs3_monitor_0 on pplxnsms01 | action 11
Oct 08 20:12:16 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: --- 0.524.73 2
Oct 08 20:12:16 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: +++ 0.524.74 (null)
Oct 08 20:12:16 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib: @num_updates=74
Oct 08 20:12:16 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib/status/node_state[@id='1']/lrm[@id='1']/lrm_resources/lrm_resource[@id='itm_vip']/lrm_rsc_op[@id='itm_vip_last_0']: @transition-magic=0:0;7:1:7:c2eb7813-bdec-4a6a-b84c-2918ad8d7ea1, @call-id=5, @rc-code=0, @op-status=0, @last-rc-change=1728389535, @exec-time=934
Oct 08 20:12:16 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: ++ /cib/status/node_state[@id='1']/lrm[@id='1']/lrm_resources/lrm_resource[@id='itm_vip']:
Oct 08 20:12:16 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: ++
Oct 08 20:12:16 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms01/crmd/13, version=0.524.75)
Oct 08 20:12:16 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: --- 0.524.75 2
Oct 08 20:12:16 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: +++ 0.524.76 (null)
Oct 08 20:12:16 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib: @num_updates=76
Oct 08 20:12:16 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: ++ /cib/status/node_state[@id='1']/lrm[@id='1']/lrm_resources:
Oct 08 20:12:16 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: ++
Oct 08 20:12:16 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms01/crmd/14, version=0.524.76)
Oct 08 20:12:19 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: --- 0.524.76 2
Oct 08 20:12:19 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: +++ 0.524.77 (null)
Oct 08 20:12:19 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib: @num_updates=77
Oct 08 20:12:19 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib/status/node_state[@id='1']/lrm[@id='1']/lrm_resources/lrm_resource[@id='itm_fs2']/lrm_rsc_op[@id='itm_fs2_last_0']: @transition-magic=0:7;10:1:7:c2eb7813-bdec-4a6a-b84c-2918ad8d7ea1, @call-id=17, @rc-code=7, @op-status=0, @exec-time=3076
Oct 08 20:12:19 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms01/crmd/15, version=0.524.77)
Oct 08 20:12:19 pplxnsms02 pacemaker-controld [2418] (process_graph_event) info: Transition 1 action 10 (itm_fs2_monitor_0 on pplxnsms01) confirmed: not running | rc=7 call-id=17
Oct 08 20:12:19 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: --- 0.524.77 2
Oct 08 20:12:19 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: +++ 0.524.78 (null)
Oct 08 20:12:19 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib: @num_updates=78
Oct 08 20:12:19 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib/status/node_state[@id='1']/lrm[@id='1']/lrm_resources/lrm_resource[@id='itm_fs']/lrm_rsc_op[@id='itm_fs_last_0']: @transition-magic=0:7;9:1:7:c2eb7813-bdec-4a6a-b84c-2918ad8d7ea1, @call-id=13, @rc-code=7, @op-status=0, @last-rc-change=1728389536, @exec-time=3079
Oct 08 20:12:19 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms01/crmd/16, version=0.524.78)
Oct 08 20:12:19 pplxnsms02 pacemaker-controld [2418] (process_graph_event) info: Transition 1 action 9 (itm_fs_monitor_0 on pplxnsms01) confirmed: not running | rc=7 call-id=13
Oct 08 20:12:19 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: --- 0.524.78 2
Oct 08 20:12:19 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: +++ 0.524.79 (null)
Oct 08 20:12:19 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib: @num_updates=79
Oct 08 20:12:19 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib/status/node_state[@id='1']/lrm[@id='1']/lrm_resources/lrm_resource[@id='itm_fs3']/lrm_rsc_op[@id='itm_fs3_last_0']: @transition-magic=0:7;11:1:7:c2eb7813-bdec-4a6a-b84c-2918ad8d7ea1, @call-id=21, @rc-code=7, @op-status=0, @exec-time=3131
Oct 08 20:12:19 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms01/crmd/17, version=0.524.79)
Oct 08 20:12:19 pplxnsms02 pacemaker-controld [2418] (process_graph_event) info: Transition 1 action 11 (itm_fs3_monitor_0 on pplxnsms01) confirmed: not running | rc=7 call-id=21
Oct 08 20:12:19 pplxnsms02 pacemaker-controld [2418] (pcmk__execute_graph) notice: Transition 1 (Complete=7, Pending=0, Fired=0, Skipped=12, Incomplete=28, Source=/var/lib/pacemaker/pengine/pe-input-998.bz2): Stopped
Oct 08 20:12:19 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_FSA_INTERNAL origin=notify_crmd
Oct 08 20:12:19 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 08 20:12:19 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) notice: On loss of quorum: Ignore
Oct 08 20:12:19 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 08 20:12:19 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms02 is online
Oct 08 20:12:19 pplxnsms02 pacemaker-schedulerd[2417] (unpack_transient_attributes) info: Node pplxnsms01 is in standby-mode
Oct 08 20:12:19 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 08 20:12:19 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms01 is standby
Oct 08 20:12:19 pplxnsms02 pacemaker-schedulerd[2417] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Oct 8 20:12:15 2024
Oct 08 20:12:19 pplxnsms02 pacemaker-schedulerd[2417] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Oct 8 20:12:15 2024
Oct 08 20:12:19 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 08 20:12:19 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 08 20:12:19 pplxnsms02 pacemaker-schedulerd[2417] (native_create_actions) error: ocf resource itm_vip might be active on 2 nodes (attempting recovery)
Oct 08 20:12:19 pplxnsms02 pacemaker-schedulerd[2417] (native_create_actions) notice: See https://wiki.clusterlabs.org/wiki/FAQ#Resource_is_Too_Active for more information
Oct 08 20:12:19 pplxnsms02 pacemaker-schedulerd[2417] (RecurringOp) info: Start recurring monitor (10s) for itm_vip on pplxnsms02
Oct 08 20:12:19 pplxnsms02 pacemaker-schedulerd[2417] (RecurringOp) info: Start recurring monitor (20s) for itm_fs2 on pplxnsms02
Oct 08 20:12:19 pplxnsms02 pacemaker-schedulerd[2417] (RecurringOp) info: Start recurring monitor (20s) for itm_fs3 on pplxnsms02
Oct 08 20:12:19 pplxnsms02 pacemaker-schedulerd[2417] (RecurringOp) info: Start recurring monitor (20s) for nco_db2 on pplxnsms02
Oct 08 20:12:19 pplxnsms02 pacemaker-schedulerd[2417] (RecurringOp) info: Start recurring monitor (60s) for nco_omni on pplxnsms02
Oct 08 20:12:19 pplxnsms02 pacemaker-schedulerd[2417] (RecurringOp) info: Start recurring monitor (300s) for nco_itnm on pplxnsms02
Oct 08 20:12:19 pplxnsms02 pacemaker-schedulerd[2417] (RecurringOp) info: Start recurring monitor (10s) for nco_cognos on pplxnsms02
Oct 08 20:12:19 pplxnsms02 pacemaker-schedulerd[2417] (RecurringOp) info: Start recurring monitor (10s) for siem_rsyslog on pplxnsms02
Oct 08 20:12:19 pplxnsms02 pacemaker-schedulerd[2417] (RecurringOp) info: Start recurring monitor (60s) for fence-sbd on pplxnsms02
Oct 08 20:12:19 pplxnsms02 pacemaker-schedulerd[2417] (log_list_item) notice: Actions: Restart itm_vip ( pplxnsms02 )
Oct 08 20:12:19 pplxnsms02 pacemaker-schedulerd[2417] (log_list_item) notice: Actions: Restart itm_lvm ( pplxnsms02 ) due to required itm_vip start
Oct 08 20:12:19 pplxnsms02 pacemaker-schedulerd[2417] (log_list_item) notice: Actions: Restart itm_fs ( pplxnsms02 ) due to required itm_lvm start
Oct 08 20:12:19 pplxnsms02 pacemaker-schedulerd[2417] (log_list_item) notice: Actions: Start itm_fs2 ( pplxnsms02 )
Oct 08 20:12:19 pplxnsms02 pacemaker-schedulerd[2417] (log_list_item) notice: Actions: Start itm_fs3 ( pplxnsms02 )
Oct 08 20:12:19 pplxnsms02 pacemaker-schedulerd[2417] (log_list_item) notice: Actions: Start nco_db2 ( pplxnsms02 )
Oct 08 20:12:19 pplxnsms02 pacemaker-schedulerd[2417] (log_list_item) notice: Actions: Start nco_omni ( pplxnsms02 )
Oct 08 20:12:19 pplxnsms02 pacemaker-schedulerd[2417] (log_list_item) notice: Actions: Start nco_itnm ( pplxnsms02 )
Oct 08 20:12:19 pplxnsms02 pacemaker-schedulerd[2417] (log_list_item) notice: Actions: Start nco_cognos ( pplxnsms02 )
Oct 08 20:12:19 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_vip (Started pplxnsms02)
Oct 08 20:12:19 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms02)
Oct 08 20:12:19 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_fs (Started pplxnsms02)
Oct 08 20:12:19 pplxnsms02 pacemaker-schedulerd[2417] (log_list_item) notice: Actions: Start siem_rsyslog ( pplxnsms02 )
Oct 08 20:12:19 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 08 20:12:19 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 08 20:12:19 pplxnsms02 pacemaker-schedulerd[2417] (log_list_item) notice: Actions: Start fence-sbd ( pplxnsms02 )
Oct 08 20:12:19 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__log_transition_summary) error: Calculated transition 2 (with errors), saving inputs in /var/lib/pacemaker/pengine/pe-error-27.bz2
Oct 08 20:12:19 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 08 20:12:19 pplxnsms02 pacemaker-controld [2418] (do_te_invoke) info: Processing graph 2 (ref=pe_calc-dc-1728389539-52) derived from /var/lib/pacemaker/pengine/pe-error-27.bz2
Oct 08 20:12:19 pplxnsms02 pacemaker-controld [2418] (te_rsc_command) notice: Initiating stop operation itm_fs_stop_0 locally on pplxnsms02 | action 23
Oct 08 20:12:19 pplxnsms02 pacemaker-execd [2415] (cancel_recurring_action) info: Cancelling ocf operation itm_fs_monitor_20000
Oct 08 20:12:19 pplxnsms02 pacemaker-controld [2418] (do_lrm_rsc_op) notice: Requesting local execution of stop operation for itm_fs on pplxnsms02 | transition_key=23:2:0:c2eb7813-bdec-4a6a-b84c-2918ad8d7ea1 op_key=itm_fs_stop_0
Oct 08 20:12:19 pplxnsms02 pacemaker-execd [2415] (log_execute) info: executing - rsc:itm_fs action:stop call_id:79
Oct 08 20:12:19 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/112)
Oct 08 20:12:19 pplxnsms02 pacemaker-controld [2418] (te_rsc_command) notice: Initiating monitor operation nco_db2_monitor_0 on pplxnsms01 | action 7
Oct 08 20:12:19 pplxnsms02 pacemaker-controld [2418] (te_rsc_command) notice: Initiating monitor operation nco_omni_monitor_0 on pplxnsms01 | action 8
Oct 08 20:12:19 pplxnsms02 pacemaker-controld [2418] (te_rsc_command) notice: Initiating monitor operation nco_itnm_monitor_0 on pplxnsms01 | action 9
Oct 08 20:12:19 pplxnsms02 pacemaker-controld [2418] (te_rsc_command) notice: Initiating monitor operation nco_cognos_monitor_0 on pplxnsms01 | action 10
Oct 08 20:12:19 pplxnsms02 pacemaker-controld [2418] (log_executor_event) info: Result of monitor operation for itm_fs on pplxnsms02: Cancelled | graph action confirmed; call=77 key=itm_fs_monitor_20000
Oct 08 20:12:19 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: --- 0.524.79 2
Oct 08 20:12:19 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: +++ 0.524.80 (null)
Oct 08 20:12:19 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib: @num_updates=80
Oct 08 20:12:19 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib/status/node_state[@id='2']: @crm-debug-origin=do_update_resource
Oct 08 20:12:19 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='itm_fs']/lrm_rsc_op[@id='itm_fs_last_0']: @operation_key=itm_fs_stop_0, @operation=stop, @crm-debug-origin=do_update_resource, @transition-key=23:2:0:c2eb7813-bdec-4a6a-b84c-2918ad8d7ea1, @transition-magic=-1:193;23:2:0:c2eb7813-bdec-4a6a-b84c-2918ad8d7ea1, @call-id=-1, @rc-code=193, @op-status=-1, @last-rc-change=1728389539, @exec-time=0
Oct 08 20:12:19 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/112, version=0.524.80)
Oct 08 20:12:19 Filesystem(itm_fs)[7771]: INFO: Running stop for /dev/vgsan/lv_tivoli on /san/tivoli
Oct 08 20:12:19 Filesystem(itm_fs)[7771]: INFO: Trying to unmount /san/tivoli
Oct 08 20:12:19 Filesystem(itm_fs)[7771]: INFO: unmounted /san/tivoli successfully
Oct 08 20:12:19 pplxnsms02 pacemaker-execd [2415] (log_finished) info: itm_fs stop (call 79, PID 7771) exited with status 0 (execution time 169ms)
Oct 08 20:12:19 pplxnsms02 pacemaker-controld [2418] (log_executor_event) notice: Result of stop operation for itm_fs on pplxnsms02: ok | CIB update 113, graph action confirmed; call=79 key=itm_fs_stop_0 rc=0
Oct 08 20:12:19 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/113)
Oct 08 20:12:19 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: --- 0.524.80 2
Oct 08 20:12:19 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: +++ 0.524.81 (null)
Oct 08 20:12:19 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib: @num_updates=81
Oct 08 20:12:19 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='itm_fs']/lrm_rsc_op[@id='itm_fs_last_0']: @transition-magic=0:0;23:2:0:c2eb7813-bdec-4a6a-b84c-2918ad8d7ea1, @call-id=79, @rc-code=0, @op-status=0, @exec-time=169
Oct 08 20:12:19 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/113, version=0.524.81)
Oct 08 20:12:19 pplxnsms02 pacemaker-controld [2418] (process_graph_event) info: Transition 2 action 23 (itm_fs_stop_0 on pplxnsms02) confirmed: ok | rc=0 call-id=79
Oct 08 20:12:19 pplxnsms02 pacemaker-controld [2418] (te_rsc_command) notice: Initiating stop operation itm_lvm_stop_0 locally on pplxnsms02 | action 21
Oct 08 20:12:19 pplxnsms02 pacemaker-execd [2415] (cancel_recurring_action) info: Cancelling ocf operation itm_lvm_monitor_30000
Oct 08 20:12:19 pplxnsms02 pacemaker-controld [2418] (do_lrm_rsc_op) notice: Requesting local execution of stop operation for itm_lvm on pplxnsms02 | transition_key=21:2:0:c2eb7813-bdec-4a6a-b84c-2918ad8d7ea1 op_key=itm_lvm_stop_0
Oct 08 20:12:19 pplxnsms02 pacemaker-execd [2415] (log_execute) info: executing - rsc:itm_lvm action:stop call_id:81
Oct 08 20:12:19 pplxnsms02 pacemaker-controld [2418] (log_executor_event) info: Result of monitor operation for itm_lvm on pplxnsms02: Cancelled | graph action confirmed; call=74 key=itm_lvm_monitor_30000
Oct 08 20:12:19 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/114)
Oct 08 20:12:19 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: --- 0.524.81 2
Oct 08 20:12:19 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: +++ 0.524.82 (null)
Oct 08 20:12:19 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib: @num_updates=82
Oct 08 20:12:19 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='itm_lvm']/lrm_rsc_op[@id='itm_lvm_last_0']: @operation_key=itm_lvm_stop_0, @operation=stop, @crm-debug-origin=do_update_resource, @transition-key=21:2:0:c2eb7813-bdec-4a6a-b84c-2918ad8d7ea1, @transition-magic=-1:193;21:2:0:c2eb7813-bdec-4a6a-b84c-2918ad8d7ea1, @call-id=-1, @rc-code=193, @op-status=-1, @last-rc-change=1728389539, @exec-time=0
Oct 08 20:12:19 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/114, version=0.524.82)
Oct 08 20:12:19 LVM-activate(itm_lvm)[7914]: INFO: Deactivating vgsan
Oct 08 20:12:19 LVM-activate(itm_lvm)[7914]: INFO: vgsan: deactivated successfully.
Oct 08 20:12:19 pplxnsms02 pacemaker-execd [2415] (log_finished) info: itm_lvm stop (call 81, PID 7914) exited with status 0 (execution time 90ms)
Oct 08 20:12:19 pplxnsms02 pacemaker-controld [2418] (log_executor_event) notice: Result of stop operation for itm_lvm on pplxnsms02: ok | CIB update 115, graph action confirmed; call=81 key=itm_lvm_stop_0 rc=0
Oct 08 20:12:19 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/115)
Oct 08 20:12:19 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: --- 0.524.82 2
Oct 08 20:12:19 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: +++ 0.524.83 (null)
Oct 08 20:12:19 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib: @num_updates=83
Oct 08 20:12:19 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='itm_lvm']/lrm_rsc_op[@id='itm_lvm_last_0']: @transition-magic=0:0;21:2:0:c2eb7813-bdec-4a6a-b84c-2918ad8d7ea1, @call-id=81, @rc-code=0, @op-status=0, @exec-time=90
Oct 08 20:12:19 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/115, version=0.524.83)
Oct 08 20:12:19 pplxnsms02 pacemaker-controld [2418] (process_graph_event) info: Transition 2 action 21 (itm_lvm_stop_0 on pplxnsms02) confirmed: ok | rc=0 call-id=81
Oct 08 20:12:19 pplxnsms02 pacemaker-controld [2418] (te_rsc_command) notice: Initiating stop operation itm_vip_stop_0 locally on pplxnsms02 | action 18
Oct 08 20:12:19 pplxnsms02 pacemaker-execd [2415] (cancel_recurring_action) info: Cancelling ocf operation itm_vip_monitor_10000
Oct 08 20:12:19 pplxnsms02 pacemaker-controld [2418] (do_lrm_rsc_op) notice: Requesting local execution of stop operation for itm_vip on pplxnsms02 | transition_key=18:2:0:c2eb7813-bdec-4a6a-b84c-2918ad8d7ea1 op_key=itm_vip_stop_0
Oct 08 20:12:19 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/116)
Oct 08 20:12:19 pplxnsms02 pacemaker-execd [2415] (log_execute) info: executing - rsc:itm_vip action:stop call_id:83
Oct 08 20:12:19 pplxnsms02 pacemaker-controld [2418] (log_executor_event) info: Result of monitor operation for itm_vip on pplxnsms02: Cancelled | graph action confirmed; call=68 key=itm_vip_monitor_10000
Oct 08 20:12:19 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: --- 0.524.83 2
Oct 08 20:12:19 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: +++ 0.524.84 (null)
Oct 08 20:12:19 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib: @num_updates=84
Oct 08 20:12:19 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='itm_vip']/lrm_rsc_op[@id='itm_vip_last_0']: @operation_key=itm_vip_stop_0, @operation=stop, @crm-debug-origin=do_update_resource, @transition-key=18:2:0:c2eb7813-bdec-4a6a-b84c-2918ad8d7ea1, @transition-magic=-1:193;18:2:0:c2eb7813-bdec-4a6a-b84c-2918ad8d7ea1, @call-id=-1, @rc-code=193, @op-status=-1, @last-rc-change=1728389539, @exec-time=0
Oct 08 20:12:19 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/116, version=0.524.84)
Oct 08 20:12:19 IPaddr2(itm_vip)[7945]: INFO: IP status = ok, IP_CIP=
Oct 08 20:12:19 pplxnsms02 pacemaker-execd [2415] (log_finished) info: itm_vip stop (call 83, PID 7945) exited with status 0 (execution time 57ms)
Oct 08 20:12:19 pplxnsms02 pacemaker-controld [2418] (log_executor_event) notice: Result of stop operation for itm_vip on pplxnsms02: ok | CIB update 117, graph action confirmed; call=83 key=itm_vip_stop_0 rc=0
Oct 08 20:12:19 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/117)
Oct 08 20:12:19 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: --- 0.524.84 2
Oct 08 20:12:19 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: +++ 0.524.85 (null)
Oct 08 20:12:19 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib: @num_updates=85
Oct 08 20:12:19 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='itm_vip']/lrm_rsc_op[@id='itm_vip_last_0']: @transition-magic=0:0;18:2:0:c2eb7813-bdec-4a6a-b84c-2918ad8d7ea1, @call-id=83, @rc-code=0, @op-status=0, @exec-time=57
Oct 08 20:12:19 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/117, version=0.524.85)
Oct 08 20:12:19 pplxnsms02 pacemaker-controld [2418] (process_graph_event) info: Transition 2 action 18 (itm_vip_stop_0 on pplxnsms02) confirmed: ok | rc=0 call-id=83
Oct 08 20:12:19 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: --- 0.524.85 2
Oct 08 20:12:19 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: +++ 0.524.86 (null)
Oct 08 20:12:19 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib: @num_updates=86
Oct 08 20:12:19 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: ++ /cib/status/node_state[@id='1']/lrm[@id='1']/lrm_resources:
Oct 08 20:12:19 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: ++
Oct 08 20:12:19 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: ++
Oct 08 20:12:19 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms01/crmd/19, version=0.524.87)
Oct 08 20:12:20 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: --- 0.524.87 2
Oct 08 20:12:20 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: +++ 0.524.88 (null)
Oct 08 20:12:20 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib: @num_updates=88
Oct 08 20:12:20 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: ++ /cib/status/node_state[@id='1']/lrm[@id='1']/lrm_resources:
Oct 08 20:12:20 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: ++
Oct 08 20:12:20 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms01/crmd/20, version=0.524.88)
Oct 08 20:12:20 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: --- 0.524.88 2
Oct 08 20:12:20 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: +++ 0.524.89 (null)
Oct 08 20:12:20 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib: @num_updates=89
Oct 08 20:12:20 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: ++ /cib/status/node_state[@id='1']/lrm[@id='1']/lrm_resources:
Oct 08 20:12:20 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: ++
Oct 08 20:12:20 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms01/crmd/21, version=0.524.89)
Oct 08 20:12:20 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: --- 0.524.89 2
Oct 08 20:12:20 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: +++ 0.524.90 (null)
Oct 08 20:12:20 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib: @num_updates=90
Oct 08 20:12:20 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib/status/node_state[@id='1']/lrm[@id='1']/lrm_resources/lrm_resource[@id='nco_itnm']/lrm_rsc_op[@id='nco_itnm_last_0']: @transition-magic=0:7;9:2:7:c2eb7813-bdec-4a6a-b84c-2918ad8d7ea1, @call-id=33, @rc-code=7, @op-status=0, @exec-time=400
Oct 08 20:12:20 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms01/crmd/22, version=0.524.90)
Oct 08 20:12:20 pplxnsms02 pacemaker-controld [2418] (process_graph_event) info: Transition 2 action 9 (nco_itnm_monitor_0 on pplxnsms01) confirmed: not running | rc=7 call-id=33
Oct 08 20:12:20 pplxnsms02 pacemaker-controld [2418] (te_rsc_command) notice: Initiating stop operation itm_vip_stop_0 on pplxnsms01 | action 19
Oct 08 20:12:20 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: --- 0.524.90 2
Oct 08 20:12:20 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: +++ 0.524.91 (null)
Oct 08 20:12:20 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib: @num_updates=91
Oct 08 20:12:20 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib/status/node_state[@id='1']/lrm[@id='1']/lrm_resources/lrm_resource[@id='itm_vip']/lrm_rsc_op[@id='itm_vip_last_0']: @operation_key=itm_vip_stop_0, @operation=stop, @transition-key=19:2:0:c2eb7813-bdec-4a6a-b84c-2918ad8d7ea1, @transition-magic=-1:193;19:2:0:c2eb7813-bdec-4a6a-b84c-2918ad8d7ea1, @call-id=-1, @rc-code=193, @op-status=-1, @last-rc-change=1728389540, @exec-time=0
Oct 08 20:12:20 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms01/crmd/23, version=0.524.91)
Oct 08 20:12:20 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: --- 0.524.91 2
Oct 08 20:12:20 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: +++ 0.524.92 (null)
Oct 08 20:12:20 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib: @num_updates=92
Oct 08 20:12:20 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib/status/node_state[@id='1']/lrm[@id='1']/lrm_resources/lrm_resource[@id='nco_omni']/lrm_rsc_op[@id='nco_omni_last_0']: @transition-magic=0:7;8:2:7:c2eb7813-bdec-4a6a-b84c-2918ad8d7ea1, @call-id=29, @rc-code=7, @op-status=0, @last-rc-change=1728389540, @exec-time=586
Oct 08 20:12:20 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms01/crmd/24, version=0.524.92)
Oct 08 20:12:20 pplxnsms02 pacemaker-controld [2418] (process_graph_event) info: Transition 2 action 8 (nco_omni_monitor_0 on pplxnsms01) confirmed: not running | rc=7 call-id=29
Oct 08 20:12:20 pplxnsms02 pacemaker-controld [2418] (te_rsc_command) notice: Initiating monitor operation siem_vip_monitor_0 on pplxnsms01 | action 11
Oct 08 20:12:20 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: --- 0.524.92 2
Oct 08 20:12:20 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: +++ 0.524.93 (null)
Oct 08 20:12:20 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib: @num_updates=93
Oct 08 20:12:20 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: ++ /cib/status/node_state[@id='1']/lrm[@id='1']/lrm_resources:
Oct 08 20:12:20 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: ++
Oct 08 20:12:20 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms01/crmd/25, version=0.524.93)
Oct 08 20:12:20 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: --- 0.524.93 2
Oct 08 20:12:20 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: +++ 0.524.94 (null)
Oct 08 20:12:20 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib: @num_updates=94
Oct 08 20:12:20 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib/status/node_state[@id='1']/lrm[@id='1']/lrm_resources/lrm_resource[@id='nco_cognos']/lrm_rsc_op[@id='nco_cognos_last_0']: @transition-magic=0:7;10:2:7:c2eb7813-bdec-4a6a-b84c-2918ad8d7ea1, @call-id=37, @rc-code=7, @op-status=0, @exec-time=343
Oct 08 20:12:20 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms01/crmd/26, version=0.524.94)
Oct 08 20:12:20 pplxnsms02 pacemaker-controld [2418] (process_graph_event) info: Transition 2 action 10 (nco_cognos_monitor_0 on pplxnsms01) confirmed: not running | rc=7 call-id=37
Oct 08 20:12:20 pplxnsms02 pacemaker-controld [2418] (te_rsc_command) notice: Initiating monitor operation siem_lvm_monitor_0 on pplxnsms01 | action 12
Oct 08 20:12:20 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: --- 0.524.94 2
Oct 08 20:12:20 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: +++ 0.524.95 (null)
Oct 08 20:12:20 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib: @num_updates=95
Oct 08 20:12:20 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: ++ /cib/status/node_state[@id='1']/lrm[@id='1']/lrm_resources:
Oct 08 20:12:20 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: ++
Oct 08 20:12:20 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms01/crmd/27, version=0.524.95)
Oct 08 20:12:20 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: --- 0.524.95 2
Oct 08 20:12:20 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: +++ 0.524.96 (null)
Oct 08 20:12:20 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib: @num_updates=96
Oct 08 20:12:20 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib/status/node_state[@id='1']/lrm[@id='1']/lrm_resources/lrm_resource[@id='siem_lvm']/lrm_rsc_op[@id='siem_lvm_last_0']: @transition-magic=0:7;12:2:7:c2eb7813-bdec-4a6a-b84c-2918ad8d7ea1, @call-id=46, @rc-code=7, @op-status=0, @exec-time=303
Oct 08 20:12:20 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms01/crmd/28, version=0.524.96)
Oct 08 20:12:20 pplxnsms02 pacemaker-controld [2418] (process_graph_event) info: Transition 2 action 12 (siem_lvm_monitor_0 on pplxnsms01) confirmed: not running | rc=7 call-id=46
Oct 08 20:12:20 pplxnsms02 pacemaker-controld [2418] (te_rsc_command) notice: Initiating monitor operation siem_fs_monitor_0 on pplxnsms01 | action 13
Oct 08 20:12:20 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: --- 0.524.96 2
Oct 08 20:12:20 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: +++ 0.524.97 (null)
Oct 08 20:12:20 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib: @num_updates=97
Oct 08 20:12:20 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: ++ /cib/status/node_state[@id='1']/lrm[@id='1']/lrm_resources:
Oct 08 20:12:20 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: ++
Oct 08 20:12:20 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms01/crmd/29, version=0.524.97)
Oct 08 20:12:21 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: --- 0.524.97 2
Oct 08 20:12:21 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: +++ 0.524.98 (null)
Oct 08 20:12:21 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib: @num_updates=98
Oct 08 20:12:21 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib/status/node_state[@id='1']/lrm[@id='1']/lrm_resources/lrm_resource[@id='siem_vip']/lrm_rsc_op[@id='siem_vip_last_0']: @transition-magic=0:7;11:2:7:c2eb7813-bdec-4a6a-b84c-2918ad8d7ea1, @call-id=42, @rc-code=7, @op-status=0, @exec-time=911
Oct 08 20:12:21 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms01/crmd/30, version=0.524.98)
Oct 08 20:12:21 pplxnsms02 pacemaker-controld [2418] (process_graph_event) info: Transition 2 action 11 (siem_vip_monitor_0 on pplxnsms01) confirmed: not running | rc=7 call-id=42
Oct 08 20:12:21 pplxnsms02 pacemaker-controld [2418] (te_rsc_command) notice: Initiating monitor operation siem_rsyslog_monitor_0 on pplxnsms01 | action 14
Oct 08 20:12:21 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: --- 0.524.98 2
Oct 08 20:12:21 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: +++ 0.524.99 (null)
Oct 08 20:12:21 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib: @num_updates=99
Oct 08 20:12:21 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: ++ /cib/status/node_state[@id='1']/lrm[@id='1']/lrm_resources:
Oct 08 20:12:21 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: ++
Oct 08 20:12:21 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms01/crmd/31, version=0.524.99)
Oct 08 20:12:21 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: --- 0.524.99 2
Oct 08 20:12:21 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: +++ 0.524.100 (null)
Oct 08 20:12:21 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib: @num_updates=100
Oct 08 20:12:21 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib/status/node_state[@id='1']/lrm[@id='1']/lrm_resources/lrm_resource[@id='siem_rsyslog']/lrm_rsc_op[@id='siem_rsyslog_last_0']: @transition-magic=0:7;14:2:7:c2eb7813-bdec-4a6a-b84c-2918ad8d7ea1, @call-id=54, @rc-code=7, @op-status=0, @exec-time=374
Oct 08 20:12:21 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms01/crmd/32, version=0.524.100)
Oct 08 20:12:21 pplxnsms02 pacemaker-controld [2418] (process_graph_event) info: Transition 2 action 14 (siem_rsyslog_monitor_0 on pplxnsms01) confirmed: not running | rc=7 call-id=54
Oct 08 20:12:21 pplxnsms02 pacemaker-controld [2418] (te_rsc_command) notice: Initiating start operation siem_rsyslog_start_0 locally on pplxnsms02 | action 47
Oct 08 20:12:21 pplxnsms02 pacemaker-controld [2418] (do_lrm_rsc_op) notice: Requesting local execution of start operation for siem_rsyslog on pplxnsms02 | transition_key=47:2:0:c2eb7813-bdec-4a6a-b84c-2918ad8d7ea1 op_key=siem_rsyslog_start_0
Oct 08 20:12:21 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/118)
Oct 08 20:12:21 pplxnsms02 pacemaker-execd [2415] (log_execute) info: executing - rsc:siem_rsyslog action:start call_id:84
Oct 08 20:12:21 pplxnsms02 pacemaker-controld [2418] (te_rsc_command) notice: Initiating monitor operation web_mariadb_monitor_0 on pplxnsms01 | action 15
Oct 08 20:12:21 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: --- 0.524.100 2
Oct 08 20:12:21 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: +++ 0.524.101 (null)
Oct 08 20:12:21 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib: @num_updates=101
Oct 08 20:12:21 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='siem_rsyslog']/lrm_rsc_op[@id='siem_rsyslog_last_0']: @operation_key=siem_rsyslog_start_0, @operation=start, @crm-debug-origin=do_update_resource, @transition-key=47:2:0:c2eb7813-bdec-4a6a-b84c-2918ad8d7ea1, @transition-magic=-1:193;47:2:0:c2eb7813-bdec-4a6a-b84c-2918ad8d7ea1, @call-id=-1, @rc-code=193, @op-status=-1, @last-rc-change=1728389541, @exe
Oct 08 20:12:21 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/118, version=0.524.101)
Oct 08 20:12:22 siemsyslog(siem_rsyslog)[8042]: INFO: siemsyslog started ...
Oct 08 20:12:22 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_start_0[8042] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 2972 1 0 20:11 ? 00:00:00 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:12:22 pplxnsms02 pacemaker-execd [2415] (log_finished) info: siem_rsyslog start (call 84, PID 8042) exited with status 0 (execution time 498ms)
Oct 08 20:12:22 pplxnsms02 pacemaker-controld [2418] (wait_for_sync_result) info: siemsyslog_meta-data_0[8073] exited with status 0
Oct 08 20:12:22 pplxnsms02 pacemaker-controld [2418] (log_executor_event) notice: Result of start operation for siem_rsyslog on pplxnsms02: ok | CIB update 119, graph action confirmed; call=84 key=siem_rsyslog_start_0 rc=0
Oct 08 20:12:22 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/119)
Oct 08 20:12:22 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: --- 0.524.101 2
Oct 08 20:12:22 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: +++ 0.524.102 (null)
Oct 08 20:12:22 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib: @num_updates=102
Oct 08 20:12:22 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='siem_rsyslog']/lrm_rsc_op[@id='siem_rsyslog_last_0']: @transition-magic=0:0;47:2:0:c2eb7813-bdec-4a6a-b84c-2918ad8d7ea1, @call-id=84, @rc-code=0, @op-status=0, @exec-time=498
Oct 08 20:12:22 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/119, version=0.524.102)
Oct 08 20:12:22 pplxnsms02 pacemaker-controld [2418] (process_graph_event) info: Transition 2 action 47 (siem_rsyslog_start_0 on pplxnsms02) confirmed: ok | rc=0 call-id=84
Oct 08 20:12:22 pplxnsms02 pacemaker-controld [2418] (te_rsc_command) notice: Initiating monitor operation siem_rsyslog_monitor_10000 locally on pplxnsms02 | action 48
Oct 08 20:12:22 pplxnsms02 pacemaker-controld [2418] (do_lrm_rsc_op) notice: Requesting local execution of monitor operation for siem_rsyslog on pplxnsms02 | transition_key=48:2:0:c2eb7813-bdec-4a6a-b84c-2918ad8d7ea1 op_key=siem_rsyslog_monitor_10000
Oct 08 20:12:22 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/120)
Oct 08 20:12:22 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: --- 0.524.102 2
Oct 08 20:12:22 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: +++ 0.524.103 (null)
Oct 08 20:12:22 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib: @num_updates=103
Oct 08 20:12:22 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: ++ /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='siem_rsyslog']:
Oct 08 20:12:26 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: ++
Oct 08 20:12:26 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms01/crmd/33, version=0.524.105)
Oct 08 20:12:26 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: --- 0.524.105 2
Oct 08 20:12:26 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: +++ 0.524.106 (null)
Oct 08 20:12:26 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib: @num_updates=106
Oct 08 20:12:26 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib/status/node_state[@id='1']/lrm[@id='1']/lrm_resources/lrm_resource[@id='itm_vip']/lrm_rsc_op[@id='itm_vip_last_0']: @transition-magic=0:0;19:2:0:c2eb7813-bdec-4a6a-b84c-2918ad8d7ea1, @call-id=38, @rc-code=0, @op-status=0, @exec-time=1833
Oct 08 20:12:26 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms01/crmd/34, version=0.524.106)
Oct 08 20:12:26 pplxnsms02 pacemaker-controld [2418] (process_graph_event) info: Transition 2 action 19 (itm_vip_stop_0 on pplxnsms01) confirmed: ok | rc=0 call-id=38
Oct 08 20:12:26 pplxnsms02 pacemaker-controld [2418] (te_rsc_command) notice: Initiating monitor operation web_matomo_monitor_0 on pplxnsms01 | action 16
Oct 08 20:12:26 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: --- 0.524.106 2
Oct 08 20:12:26 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: +++ 0.524.107 (null)
Oct 08 20:12:26 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib: @num_updates=107
Oct 08 20:12:26 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib/status/node_state[@id='1']/lrm[@id='1']/lrm_resources/lrm_resource[@id='siem_fs']/lrm_rsc_op[@id='siem_fs_last_0']: @transition-magic=0:7;13:2:7:c2eb7813-bdec-4a6a-b84c-2918ad8d7ea1, @call-id=50, @rc-code=7, @op-status=0, @exec-time=2006
Oct 08 20:12:26 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms01/crmd/35, version=0.524.107)
Oct 08 20:12:26 pplxnsms02 pacemaker-controld [2418] (process_graph_event) info: Transition 2 action 13 (siem_fs_monitor_0 on pplxnsms01) confirmed: not running | rc=7 call-id=50
Oct 08 20:12:26 pplxnsms02 pacemaker-controld [2418] (te_rsc_command) notice: Initiating monitor operation fence-sbd_monitor_0 on pplxnsms01 | action 17
Oct 08 20:12:26 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: --- 0.524.107 2
Oct 08 20:12:26 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: +++ 0.524.108 (null)
Oct 08 20:12:26 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib: @num_updates=108
Oct 08 20:12:26 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib/status/node_state[@id='1']/lrm[@id='1']/lrm_resources/lrm_resource[@id='web_mariadb']/lrm_rsc_op[@id='web_mariadb_last_0']: @transition-magic=0:7;15:2:7:c2eb7813-bdec-4a6a-b84c-2918ad8d7ea1, @call-id=58, @rc-code=7, @op-status=0, @last-rc-change=1728389543, @exec-time=1060
Oct 08 20:12:26 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms01/crmd/36, version=0.524.108)
Oct 08 20:12:26 pplxnsms02 pacemaker-controld [2418] (process_graph_event) info: Transition 2 action 15 (web_mariadb_monitor_0 on pplxnsms01) confirmed: not running | rc=7 call-id=58
Oct 08 20:12:26 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: --- 0.524.108 2
Oct 08 20:12:26 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: +++ 0.524.109 (null)
Oct 08 20:12:26 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib: @num_updates=109
Oct 08 20:12:26 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib/status/node_state[@id='1']/lrm[@id='1']/lrm_resources/lrm_resource[@id='nco_db2']/lrm_rsc_op[@id='nco_db2_last_0']: @transition-magic=0:7;7:2:7:c2eb7813-bdec-4a6a-b84c-2918ad8d7ea1, @call-id=25, @rc-code=7, @op-status=0, @exec-time=6300
Oct 08 20:12:26 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms01/crmd/37, version=0.524.109)
Oct 08 20:12:26 pplxnsms02 pacemaker-controld [2418] (process_graph_event) info: Transition 2 action 7 (nco_db2_monitor_0 on pplxnsms01) confirmed: not running | rc=7 call-id=25
Oct 08 20:12:26 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Forwarding cib_modify operation for section nodes to all (origin=local/crmd/124)
Oct 08 20:12:26 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/125)
Oct 08 20:12:26 pplxnsms02 pacemaker-controld [2418] (te_rsc_command) notice: Initiating start operation itm_vip_start_0 locally on pplxnsms02 | action 20
Oct 08 20:12:26 pplxnsms02 pacemaker-controld [2418] (do_lrm_rsc_op) notice: Requesting local execution of start operation for itm_vip on pplxnsms02 | transition_key=20:2:0:c2eb7813-bdec-4a6a-b84c-2918ad8d7ea1 op_key=itm_vip_start_0
Oct 08 20:12:26 pplxnsms02 pacemaker-execd [2415] (log_execute) info: executing - rsc:itm_vip action:start call_id:86
Oct 08 20:12:26 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Completed cib_modify operation for section nodes: OK (rc=0, origin=pplxnsms02/crmd/124, version=0.524.109)
Oct 08 20:12:26 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: --- 0.524.109 2
Oct 08 20:12:26 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: +++ 0.524.110 (null)
Oct 08 20:12:26 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib: @num_updates=110
Oct 08 20:12:26 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib/status/node_state[@id='2']: @crm-debug-origin=post_cache_update
Oct 08 20:12:26 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib/status/node_state[@id='1']: @crm-debug-origin=post_cache_update
Oct 08 20:12:26 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/125, version=0.524.110)
Oct 08 20:12:26 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/126)
Oct 08 20:12:26 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: --- 0.524.110 2
Oct 08 20:12:26 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: +++ 0.524.111 (null)
Oct 08 20:12:26 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib: @num_updates=111
Oct 08 20:12:26 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib/status/node_state[@id='2']: @crm-debug-origin=do_update_resource
Oct 08 20:12:26 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='itm_vip']/lrm_rsc_op[@id='itm_vip_last_0']: @operation_key=itm_vip_start_0, @operation=start, @transition-key=20:2:0:c2eb7813-bdec-4a6a-b84c-2918ad8d7ea1, @transition-magic=-1:193;20:2:0:c2eb7813-bdec-4a6a-b84c-2918ad8d7ea1, @call-id=-1, @rc-code=193, @op-status=-1, @last-rc-change=1728389546, @exec-time=0
Oct 08 20:12:26 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/126, version=0.524.111)
Oct 08 20:12:26 IPaddr2(itm_vip)[8101]: INFO: Adding inet address 192.168.133.136/24 with broadcast address 192.168.133.255 to device ens224
Oct 08 20:12:26 IPaddr2(itm_vip)[8101]: INFO: Bringing device ens224 up
Oct 08 20:12:26 IPaddr2(itm_vip)[8101]: INFO: /usr/libexec/heartbeat/send_arp -i 200 -r 5 -p /run/resource-agents/send_arp-192.168.133.136 ens224 192.168.133.136 auto not_used not_used
Oct 08 20:12:26 pplxnsms02 pacemaker-execd [2415] (log_finished) info: itm_vip start (call 86, PID 8101) exited with status 0 (execution time 127ms)
Oct 08 20:12:26 pplxnsms02 pacemaker-controld [2418] (wait_for_sync_result) info: IPaddr2_meta-data_0[8177] exited with status 0
Oct 08 20:12:26 pplxnsms02 pacemaker-controld [2418] (log_executor_event) notice: Result of start operation for itm_vip on pplxnsms02: ok | CIB update 127, graph action confirmed; call=86 key=itm_vip_start_0 rc=0
Oct 08 20:12:26 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/127)
Oct 08 20:12:26 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: --- 0.524.111 2
Oct 08 20:12:26 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: +++ 0.524.112 (null)
Oct 08 20:12:26 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib: @num_updates=112
Oct 08 20:12:26 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='itm_vip']/lrm_rsc_op[@id='itm_vip_last_0']: @transition-magic=0:0;20:2:0:c2eb7813-bdec-4a6a-b84c-2918ad8d7ea1, @call-id=86, @rc-code=0, @op-status=0, @exec-time=127
Oct 08 20:12:26 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/127, version=0.524.112)
Oct 08 20:12:26 pplxnsms02 pacemaker-controld [2418] (process_graph_event) info: Transition 2 action 20 (itm_vip_start_0 on pplxnsms02) confirmed: ok | rc=0 call-id=86
Oct 08 20:12:26 pplxnsms02 pacemaker-controld [2418] (te_rsc_command) notice: Initiating monitor operation itm_vip_monitor_10000 locally on pplxnsms02 | action 5
Oct 08 20:12:26 pplxnsms02 pacemaker-controld [2418] (do_lrm_rsc_op) notice: Requesting local execution of monitor operation for itm_vip on pplxnsms02 | transition_key=5:2:0:c2eb7813-bdec-4a6a-b84c-2918ad8d7ea1 op_key=itm_vip_monitor_10000
Oct 08 20:12:26 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/128)
Oct 08 20:12:26 pplxnsms02 pacemaker-controld [2418] (te_rsc_command) notice: Initiating start operation itm_lvm_start_0 locally on pplxnsms02 | action 22
Oct 08 20:12:26 pplxnsms02 pacemaker-controld [2418] (do_lrm_rsc_op) notice: Requesting local execution of start operation for itm_lvm on pplxnsms02 | transition_key=22:2:0:c2eb7813-bdec-4a6a-b84c-2918ad8d7ea1 op_key=itm_lvm_start_0
Oct 08 20:12:26 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: --- 0.524.112 2
Oct 08 20:12:26 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: +++ 0.524.113 (null)
Oct 08 20:12:26 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib: @num_updates=113
Oct 08 20:12:26 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='itm_vip']/lrm_rsc_op[@id='itm_vip_monitor_10000']: @crm-debug-origin=do_update_resource, @transition-key=5:2:0:c2eb7813-bdec-4a6a-b84c-2918ad8d7ea1, @transition-magic=-1:193;5:2:0:c2eb7813-bdec-4a6a-b84c-2918ad8d7ea1, @call-id=-1, @rc-code=193, @op-status=-1, @last-rc-change=1728389546, @exec-time=0
Oct 08 20:12:26 pplxnsms02 pacemaker-execd [2415] (log_execute) info: executing - rsc:itm_lvm action:start call_id:88
Oct 08 20:12:26 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/128, version=0.524.113)
Oct 08 20:12:26 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/129)
Oct 08 20:12:26 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: --- 0.524.113 2
Oct 08 20:12:26 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: +++ 0.524.114 (null)
Oct 08 20:12:26 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib: @num_updates=114
Oct 08 20:12:26 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='itm_lvm']/lrm_rsc_op[@id='itm_lvm_last_0']: @operation_key=itm_lvm_start_0, @operation=start, @transition-key=22:2:0:c2eb7813-bdec-4a6a-b84c-2918ad8d7ea1, @transition-magic=-1:193;22:2:0:c2eb7813-bdec-4a6a-b84c-2918ad8d7ea1, @call-id=-1, @rc-code=193, @op-status=-1, @last-rc-change=1728389546, @exec-time=0
Oct 08 20:12:26 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/129, version=0.524.114)
Oct 08 20:12:26 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: --- 0.524.114 2
Oct 08 20:12:26 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: +++ 0.524.115 (null)
Oct 08 20:12:26 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib: @num_updates=115
Oct 08 20:12:26 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib/status/node_state[@id='1']: @crm-debug-origin=do_update_resource
Oct 08 20:12:26 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: ++ /cib/status/node_state[@id='1']/lrm[@id='1']/lrm_resources:
Oct 08 20:12:26 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: ++
Oct 08 20:12:26 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms01/crmd/38, version=0.524.115)
Oct 08 20:12:26 pplxnsms02 pacemaker-controld [2418] (log_executor_event) notice: Result of monitor operation for itm_vip on pplxnsms02: ok | CIB update 130, graph action unconfirmed; call=87 key=itm_vip_monitor_10000 rc=0
Oct 08 20:12:26 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/130)
Oct 08 20:12:26 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: --- 0.524.115 2
Oct 08 20:12:26 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: +++ 0.524.116 (null)
Oct 08 20:12:26 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib: @num_updates=116
Oct 08 20:12:26 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='itm_vip']/lrm_rsc_op[@id='itm_vip_monitor_10000']: @transition-magic=0:0;5:2:0:c2eb7813-bdec-4a6a-b84c-2918ad8d7ea1, @call-id=87, @rc-code=0, @op-status=0, @exec-time=107
Oct 08 20:12:26 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/130, version=0.524.116)
Oct 08 20:12:26 pplxnsms02 pacemaker-controld [2418] (process_graph_event) info: Transition 2 action 5 (itm_vip_monitor_10000 on pplxnsms02) confirmed: ok | rc=0 call-id=87
Oct 08 20:12:27 LVM-activate(itm_lvm)[8182]: INFO: Activating vgsan
Oct 08 20:12:27 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: --- 0.524.116 2
Oct 08 20:12:27 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: +++ 0.524.117 (null)
Oct 08 20:12:27 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib: @num_updates=117
Oct 08 20:12:27 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: ++ /cib/status/node_state[@id='1']/lrm[@id='1']/lrm_resources:
Oct 08 20:12:27 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: ++
Oct 08 20:12:27 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms01/crmd/39, version=0.524.117)
Oct 08 20:12:27 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: --- 0.524.117 2
Oct 08 20:12:27 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: +++ 0.524.118 (null)
Oct 08 20:12:27 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib: @num_updates=118
Oct 08 20:12:27 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib/status/node_state[@id='1']/lrm[@id='1']/lrm_resources/lrm_resource[@id='web_matomo']/lrm_rsc_op[@id='web_matomo_last_0']: @transition-magic=0:7;16:2:7:c2eb7813-bdec-4a6a-b84c-2918ad8d7ea1, @call-id=62, @rc-code=7, @op-status=0, @last-rc-change=1728389547, @exec-time=244
Oct 08 20:12:27 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms01/crmd/40, version=0.524.118)
Oct 08 20:12:27 pplxnsms02 pacemaker-controld [2418] (process_graph_event) info: Transition 2 action 16 (web_matomo_monitor_0 on pplxnsms01) confirmed: not running | rc=7 call-id=62
Oct 08 20:12:27 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: --- 0.524.118 2
Oct 08 20:12:27 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: +++ 0.524.119 (null)
Oct 08 20:12:27 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib: @num_updates=119
Oct 08 20:12:27 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib/status/node_state[@id='1']/lrm[@id='1']/lrm_resources/lrm_resource[@id='fence-sbd']/lrm_rsc_op[@id='fence-sbd_last_0']: @transition-magic=0:7;17:2:7:c2eb7813-bdec-4a6a-b84c-2918ad8d7ea1, @call-id=66, @rc-code=7, @op-status=0, @exec-time=4
Oct 08 20:12:27 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms01/crmd/41, version=0.524.119)
Oct 08 20:12:27 pplxnsms02 pacemaker-controld [2418] (process_graph_event) info: Transition 2 action 17 (fence-sbd_monitor_0 on pplxnsms01) confirmed: not running | rc=7 call-id=66
Oct 08 20:12:27 pplxnsms02 pacemaker-controld [2418] (te_rsc_command) notice: Initiating start operation fence-sbd_start_0 locally on pplxnsms02 | action 53
Oct 08 20:12:27 pplxnsms02 pacemaker-controld [2418] (do_lrm_rsc_op) notice: Requesting local execution of start operation for fence-sbd on pplxnsms02 | transition_key=53:2:0:c2eb7813-bdec-4a6a-b84c-2918ad8d7ea1 op_key=fence-sbd_start_0
Oct 08 20:12:27 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/131)
Oct 08 20:12:27 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: --- 0.524.119 2
Oct 08 20:12:27 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: +++ 0.524.120 (null)
Oct 08 20:12:27 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib: @num_updates=120
Oct 08 20:12:27 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='fence-sbd']/lrm_rsc_op[@id='fence-sbd_last_0']: @operation_key=fence-sbd_start_0, @operation=start, @crm-debug-origin=do_update_resource, @transition-key=53:2:0:c2eb7813-bdec-4a6a-b84c-2918ad8d7ea1, @transition-magic=-1:193;53:2:0:c2eb7813-bdec-4a6a-b84c-2918ad8d7ea1, @call-id=-1, @rc-code=193, @op-status=-1, @last-rc-change=1728389547, @exec-time=0
Oct 08 20:12:27 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/131, version=0.524.120)
Oct 08 20:12:27 pplxnsms02 pacemaker-execd [2415] (log_execute) info: executing - rsc:fence-sbd action:start call_id:89
Oct 08 20:12:27 LVM-activate(itm_lvm)[8182]: INFO: vgsan: activated successfully.
Oct 08 20:12:27 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: itm_lvm_start_0[8182] error output [ Volume Group system ID is already "pplxnsms02". ]
Oct 08 20:12:27 pplxnsms02 pacemaker-execd [2415] (log_finished) info: itm_lvm start (call 88, PID 8182) exited with status 0 (execution time 527ms)
Oct 08 20:12:27 pplxnsms02 pacemaker-controld [2418] (wait_for_sync_result) info: LVM-activate_meta-data_0[8332] exited with status 0
Oct 08 20:12:27 pplxnsms02 pacemaker-controld [2418] (log_executor_event) notice: Result of start operation for itm_lvm on pplxnsms02: ok | CIB update 132, graph action confirmed; call=88 key=itm_lvm_start_0 rc=0
Oct 08 20:12:27 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/132)
Oct 08 20:12:27 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: --- 0.524.120 2
Oct 08 20:12:27 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: +++ 0.524.121 (null)
Oct 08 20:12:27 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib: @num_updates=121
Oct 08 20:12:27 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='itm_lvm']/lrm_rsc_op[@id='itm_lvm_last_0']: @transition-magic=0:0;22:2:0:c2eb7813-bdec-4a6a-b84c-2918ad8d7ea1, @call-id=88, @rc-code=0, @op-status=0, @exec-time=527
Oct 08 20:12:27 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/132, version=0.524.121)
Oct 08 20:12:27 pplxnsms02 pacemaker-controld [2418] (process_graph_event) info: Transition 2 action 22 (itm_lvm_start_0 on pplxnsms02) confirmed: ok | rc=0 call-id=88
Oct 08 20:12:27 pplxnsms02 pacemaker-controld [2418] (te_rsc_command) notice: Initiating monitor operation itm_lvm_monitor_30000 locally on pplxnsms02 | action 3
Oct 08 20:12:27 pplxnsms02 pacemaker-controld [2418] (do_lrm_rsc_op) notice: Requesting local execution of monitor operation for itm_lvm on pplxnsms02 | transition_key=3:2:0:c2eb7813-bdec-4a6a-b84c-2918ad8d7ea1 op_key=itm_lvm_monitor_30000
Oct 08 20:12:27 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/133)
Oct 08 20:12:27 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: --- 0.524.121 2
Oct 08 20:12:27 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: +++ 0.524.122 (null)
Oct 08 20:12:27 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib: @num_updates=122
Oct 08 20:12:27 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='itm_lvm']/lrm_rsc_op[@id='itm_lvm_monitor_30000']: @crm-debug-origin=do_update_resource, @transition-key=3:2:0:c2eb7813-bdec-4a6a-b84c-2918ad8d7ea1, @transition-magic=-1:193;3:2:0:c2eb7813-bdec-4a6a-b84c-2918ad8d7ea1, @call-id=-1, @rc-code=193, @op-status=-1, @last-rc-change=1728389547, @exec-time=0
Oct 08 20:12:27 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/133, version=0.524.122)
Oct 08 20:12:27 pplxnsms02 pacemaker-controld [2418] (log_executor_event) notice: Result of monitor operation for itm_lvm on pplxnsms02: ok | CIB update 134, graph action unconfirmed; call=90 key=itm_lvm_monitor_30000 rc=0
Oct 08 20:12:27 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/134)
Oct 08 20:12:27 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: --- 0.524.122 2
Oct 08 20:12:27 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: +++ 0.524.123 (null)
Oct 08 20:12:27 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib: @num_updates=123
Oct 08 20:12:27 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='itm_lvm']/lrm_rsc_op[@id='itm_lvm_monitor_30000']: @transition-magic=0:0;3:2:0:c2eb7813-bdec-4a6a-b84c-2918ad8d7ea1, @call-id=90, @rc-code=0, @op-status=0, @exec-time=23
Oct 08 20:12:27 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/134, version=0.524.123)
Oct 08 20:12:27 pplxnsms02 pacemaker-controld [2418] (process_graph_event) info: Transition 2 action 3 (itm_lvm_monitor_30000 on pplxnsms02) confirmed: ok | rc=0 call-id=90
Oct 08 20:12:27 pplxnsms02 pacemaker-controld [2418] (te_rsc_command) notice: Initiating start operation itm_fs_start_0 locally on pplxnsms02 | action 24
Oct 08 20:12:27 pplxnsms02 pacemaker-controld [2418] (do_lrm_rsc_op) notice: Requesting local execution of start operation for itm_fs on pplxnsms02 | transition_key=24:2:0:c2eb7813-bdec-4a6a-b84c-2918ad8d7ea1 op_key=itm_fs_start_0
Oct 08 20:12:27 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/135)
Oct 08 20:12:27 pplxnsms02 pacemaker-execd [2415] (log_execute) info: executing - rsc:itm_fs action:start call_id:91
Oct 08 20:12:27 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: --- 0.524.123 2
Oct 08 20:12:27 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: +++ 0.524.124 (null)
Oct 08 20:12:27 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib: @num_updates=124
Oct 08 20:12:27 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='itm_fs']/lrm_rsc_op[@id='itm_fs_last_0']: @operation_key=itm_fs_start_0, @operation=start, @transition-key=24:2:0:c2eb7813-bdec-4a6a-b84c-2918ad8d7ea1, @transition-magic=-1:193;24:2:0:c2eb7813-bdec-4a6a-b84c-2918ad8d7ea1, @call-id=-1, @rc-code=193, @op-status=-1, @last-rc-change=1728389547, @exec-time=0
Oct 08 20:12:27 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/135, version=0.524.124)
Oct 08 20:12:27 Filesystem(itm_fs)[8348]: INFO: Running start for /dev/vgsan/lv_tivoli on /san/tivoli
Oct 08 20:12:27 pplxnsms02 pacemaker-execd [2415] (log_finished) info: fence-sbd start (call 89) exited with status 0 (execution time 217ms)
Oct 08 20:12:27 pplxnsms02 pacemaker-controld [2418] (wait_for_sync_result) info: fence_sbd_metadata_1[8448] exited with status 0
Oct 08 20:12:27 pplxnsms02 pacemaker-controld [2418] (log_executor_event) notice: Result of start operation for fence-sbd on pplxnsms02: ok | CIB update 136, graph action confirmed; call=89 key=fence-sbd_start_0 rc=0
Oct 08 20:12:27 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/136)
Oct 08 20:12:27 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: --- 0.524.124 2
Oct 08 20:12:27 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: +++ 0.524.125 (null)
Oct 08 20:12:27 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib: @num_updates=125
Oct 08 20:12:27 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='fence-sbd']/lrm_rsc_op[@id='fence-sbd_last_0']: @transition-magic=0:0;53:2:0:c2eb7813-bdec-4a6a-b84c-2918ad8d7ea1, @call-id=89, @rc-code=0, @op-status=0, @exec-time=217
Oct 08 20:12:27 pplxnsms02 pacemaker-controld [2418] (process_graph_event) info: Transition 2 action 53 (fence-sbd_start_0 on pplxnsms02) confirmed: ok | rc=0 call-id=89
Oct 08 20:12:27 pplxnsms02 pacemaker-controld [2418] (te_rsc_command) notice: Initiating monitor operation fence-sbd_monitor_60000 locally on pplxnsms02 | action 54
Oct 08 20:12:27 pplxnsms02 pacemaker-controld [2418] (do_lrm_rsc_op) notice: Requesting local execution of monitor operation for fence-sbd on pplxnsms02 | transition_key=54:2:0:c2eb7813-bdec-4a6a-b84c-2918ad8d7ea1 op_key=fence-sbd_monitor_60000
Oct 08 20:12:27 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/136, version=0.524.125)
Oct 08 20:12:27 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/137)
Oct 08 20:12:27 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: --- 0.524.125 2
Oct 08 20:12:27 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: +++ 0.524.126 (null)
Oct 08 20:12:27 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib: @num_updates=126
Oct 08 20:12:27 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: ++ /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='fence-sbd']: S_POLICY_ENGINE | input=I_PE_CALC cause=C_FSA_INTERNAL origin=notify_crmd
Oct 08 20:15:52 pplxnsms02 pacemaker-attrd [2416] (attrd_peer_update) notice: Setting fail-count-nco_itnm#start_0[pplxnsms02]: (unset) -> INFINITY | from pplxnsms02
Oct 08 20:15:52 pplxnsms02 pacemaker-attrd [2416] (write_attribute) info: Sent CIB request 4 with 1 change for fail-count-nco_itnm#start_0 (id n/a, set n/a)
Oct 08 20:15:52 pplxnsms02 pacemaker-attrd [2416] (attrd_peer_update) notice: Setting last-failure-nco_itnm#start_0[pplxnsms02]: (unset) -> 1728389752 | from pplxnsms02
Oct 08 20:15:52 pplxnsms02 pacemaker-attrd [2416] (write_attribute) info: Sent CIB request 5 with 1 change for last-failure-nco_itnm#start_0 (id n/a, set n/a)
Oct 08 20:15:52 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/attrd/4)
Oct 08 20:15:52 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/attrd/5)
Oct 08 20:15:52 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: --- 0.524.148 2
Oct 08 20:15:52 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: +++ 0.524.149 (null)
Oct 08 20:15:52 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib: @num_updates=149
Oct 08 20:15:52 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: ++ /cib/status/node_state[@id='2']:
Oct 08 20:15:52 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: ++
Oct 08 20:15:52 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: ++
Oct 08 20:15:52 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: ++
Oct 08 20:15:52 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: ++
Oct 08 20:15:52 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/attrd/4, version=0.524.149)
Oct 08 20:15:52 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: --- 0.524.149 2
Oct 08 20:15:52 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: +++ 0.524.150 (null)
Oct 08 20:15:52 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib: @num_updates=150
Oct 08 20:15:52 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: ++ /cib/status/node_state[@id='2']/transient_attributes[@id='2']/instance_attributes[@id='status-2']:
Oct 08 20:15:52 pplxnsms02 pacemaker-attrd [2416] (attrd_cib_callback) info: CIB update 4 result for fail-count-nco_itnm#start_0: OK | rc=0
Oct 08 20:15:52 pplxnsms02 pacemaker-attrd [2416] (attrd_cib_callback) info: * fail-count-nco_itnm#start_0[pplxnsms02]=INFINITY
Oct 08 20:15:52 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/attrd/5, version=0.524.150)
Oct 08 20:15:52 pplxnsms02 pacemaker-attrd [2416] (attrd_cib_callback) info: CIB update 5 result for last-failure-nco_itnm#start_0: OK | rc=0
Oct 08 20:15:52 pplxnsms02 pacemaker-attrd [2416] (attrd_cib_callback) info: * last-failure-nco_itnm#start_0[pplxnsms02]=1728389752
Oct 08 20:15:52 pplxnsms02 pacemaker-controld [2418] (abort_transition_graph) info: Transition 2 aborted by transient_attributes.2 'create': Transient attribute change | cib=0.524.149 source=abort_unless_down:314 path=/cib/status/node_state[@id='2'] complete=true
Oct 08 20:15:52 pplxnsms02 pacemaker-controld [2418] (abort_transition_graph) info: Transition 2 aborted by status-2-last-failure-nco_itnm.start_0 doing create last-failure-nco_itnm#start_0=1728389752: Transient attribute change | cib=0.524.150 source=abort_unless_down:314 path=/cib/status/node_state[@id='2']/transient_attributes[@id='2']/instance_attributes[@id='status-2'] complete=true
Oct 08 20:15:52 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 08 20:15:52 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) notice: On loss of quorum: Ignore
Oct 08 20:15:52 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 08 20:15:52 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms02 is online
Oct 08 20:15:52 pplxnsms02 pacemaker-schedulerd[2417] (unpack_transient_attributes) info: Node pplxnsms01 is in standby-mode
Oct 08 20:15:52 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 08 20:15:52 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms01 is standby
Oct 08 20:15:52 pplxnsms02 pacemaker-schedulerd[2417] (unpack_rsc_op_failure) warning: Unexpected result (error) was recorded for start of nco_itnm on pplxnsms02 at Oct 8 20:15:42 2024 | rc=1 id=nco_itnm_last_failure_0
Oct 08 20:15:52 pplxnsms02 pacemaker-schedulerd[2417] (unpack_rsc_op_failure) warning: Unexpected result (error) was recorded for start of nco_itnm on pplxnsms02 at Oct 8 20:15:42 2024 | rc=1 id=nco_itnm_last_0
Oct 08 20:15:52 pplxnsms02 pacemaker-schedulerd[2417] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Oct 8 20:12:15 2024
Oct 08 20:15:52 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 08 20:15:52 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 08 20:15:52 pplxnsms02 pacemaker-schedulerd[2417] (RecurringOp) info: Start recurring monitor (300s) for nco_itnm on pplxnsms02
Oct 08 20:15:52 pplxnsms02 pacemaker-schedulerd[2417] (RecurringOp) info: Start recurring monitor (10s) for nco_cognos on pplxnsms02
Oct 08 20:15:52 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 08 20:15:52 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 08 20:15:52 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 08 20:15:52 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 08 20:15:52 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 08 20:15:52 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 08 20:15:52 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 08 20:15:52 pplxnsms02 pacemaker-schedulerd[2417] (log_list_item) notice: Actions: Recover nco_itnm ( pplxnsms02 )
Oct 08 20:15:52 pplxnsms02 pacemaker-schedulerd[2417] (log_list_item) notice: Actions: Start nco_cognos ( pplxnsms02 )
Oct 08 20:15:52 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_vip (Started pplxnsms02)
Oct 08 20:15:52 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms02)
Oct 08 20:15:52 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_fs (Started pplxnsms02)
Oct 08 20:15:52 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms02)
Oct 08 20:15:52 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 08 20:15:52 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 08 20:15:52 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms02)
Oct 08 20:15:52 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__log_transition_summary) notice: Calculated transition 3, saving inputs in /var/lib/pacemaker/pengine/pe-input-999.bz2
Oct 08 20:15:52 pplxnsms02 pacemaker-controld [2418] (handle_response) info: pe_calc calculation pe_calc-dc-1728389752-91 is obsolete
Oct 08 20:15:52 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 08 20:15:52 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) notice: On loss of quorum: Ignore
Oct 08 20:15:52 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 08 20:15:52 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms02 is online
Oct 08 20:15:52 pplxnsms02 pacemaker-schedulerd[2417] (unpack_transient_attributes) info: Node pplxnsms01 is in standby-mode
Oct 08 20:15:52 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 08 20:15:52 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms01 is standby
Oct 08 20:15:52 pplxnsms02 pacemaker-schedulerd[2417] (unpack_rsc_op_failure) warning: Unexpected result (error) was recorded for start of nco_itnm on pplxnsms02 at Oct 8 20:15:42 2024 | rc=1 id=nco_itnm_last_failure_0
Oct 08 20:15:52 pplxnsms02 pacemaker-schedulerd[2417] (unpack_rsc_op_failure) warning: Unexpected result (error) was recorded for start of nco_itnm on pplxnsms02 at Oct 8 20:15:42 2024 | rc=1 id=nco_itnm_last_0
Oct 08 20:15:52 pplxnsms02 pacemaker-schedulerd[2417] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Oct 8 20:12:15 2024
Oct 08 20:15:52 pplxnsms02 pacemaker-schedulerd[2417] (pe_get_failcount) info: nco_itnm has failed INFINITY times on pplxnsms02
Oct 08 20:15:52 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__threshold_reached) warning: nco_itnm cannot run on pplxnsms02 due to reaching migration threshold (clean up resource to allow again)| failures=1000000 migration-threshold=1000000
Oct 08 20:15:52 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_merge_weights) info: itm_vip: Rolling back optional scores from nco_itnm
Oct 08 20:15:52 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_merge_weights) info: itm_lvm: Rolling back optional scores from nco_itnm
Oct 08 20:15:52 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_merge_weights) info: itm_fs: Rolling back optional scores from nco_itnm
Oct 08 20:15:52 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_merge_weights) info: itm_fs2: Rolling back optional scores from nco_itnm
Oct 08 20:15:52 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_merge_weights) info: itm_fs3: Rolling back optional scores from nco_itnm
Oct 08 20:15:52 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_merge_weights) info: nco_db2: Rolling back optional scores from nco_itnm
Oct 08 20:15:52 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_merge_weights) info: nco_omni: Rolling back optional scores from nco_itnm
Oct 08 20:15:52 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_merge_weights) info: nco_itnm: Rolling back optional scores from nco_cognos
Oct 08 20:15:52 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource nco_itnm cannot run anywhere
Oct 08 20:15:52 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource nco_cognos cannot run anywhere
Oct 08 20:15:52 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 08 20:15:52 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 08 20:15:52 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 08 20:15:52 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 08 20:15:52 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 08 20:15:52 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 08 20:15:52 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 08 20:15:52 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 08 20:15:52 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 08 20:15:52 pplxnsms02 pacemaker-schedulerd[2417] (log_list_item) notice: Actions: Stop nco_itnm ( pplxnsms02 ) due to node availability
Oct 08 20:15:52 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_cognos (Stopped)
Oct 08 20:15:52 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_vip (Started pplxnsms02)
Oct 08 20:15:52 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms02)
Oct 08 20:15:52 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_fs (Started pplxnsms02)
Oct 08 20:15:52 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms02)
Oct 08 20:15:52 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 08 20:15:52 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 08 20:15:52 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms02)
Oct 08 20:15:52 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__log_transition_summary) notice: Calculated transition 4, saving inputs in /var/lib/pacemaker/pengine/pe-input-1000.bz2
Oct 08 20:15:52 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 08 20:15:52 pplxnsms02 pacemaker-controld [2418] (do_te_invoke) info: Processing graph 4 (ref=pe_calc-dc-1728389752-92) derived from /var/lib/pacemaker/pengine/pe-input-1000.bz2
Oct 08 20:15:52 pplxnsms02 pacemaker-controld [2418] (te_rsc_command) notice: Initiating stop operation nco_itnm_stop_0 locally on pplxnsms02 | action 13
Oct 08 20:15:52 pplxnsms02 pacemaker-controld [2418] (do_lrm_rsc_op) notice: Requesting local execution of stop operation for nco_itnm on pplxnsms02 | transition_key=13:4:0:c2eb7813-bdec-4a6a-b84c-2918ad8d7ea1 op_key=nco_itnm_stop_0
Oct 08 20:15:52 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/163)
Oct 08 20:15:52 pplxnsms02 pacemaker-execd [2415] (log_execute) info: executing - rsc:nco_itnm action:stop call_id:103
Oct 08 20:15:52 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: --- 0.524.150 2
Oct 08 20:15:52 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: +++ 0.524.151 (null)
Oct 08 20:15:52 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib: @num_updates=151
Oct 08 20:15:52 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='nco_itnm']/lrm_rsc_op[@id='nco_itnm_last_0']: @operation_key=nco_itnm_stop_0, @operation=stop, @transition-key=13:4:0:c2eb7813-bdec-4a6a-b84c-2918ad8d7ea1, @transition-magic=-1:193;13:4:0:c2eb7813-bdec-4a6a-b84c-2918ad8d7ea1, @call-id=-1, @rc-code=193, @op-status=-1, @last-rc-change=1728389752, @exec-time=0
Oct 08 20:15:52 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/163, version=0.524.151)
Oct 08 20:15:52 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: nco_itnm_stop_0[29045] error output [ ls: cannot access '/run/resource-agents/itnm-nco_itnm.state': No such file or directory ]
Oct 08 20:15:52 pplxnsms02 pacemaker-execd [2415] (log_finished) info: nco_itnm stop (call 103, PID 29045) exited with status 0 (execution time 635ms)
Oct 08 20:15:52 pplxnsms02 pacemaker-controld [2418] (log_executor_event) notice: Result of stop operation for nco_itnm on pplxnsms02: ok | CIB update 164, graph action confirmed; call=103 key=nco_itnm_stop_0 rc=0
Oct 08 20:15:52 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/164)
Oct 08 20:15:52 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: --- 0.524.151 2
Oct 08 20:15:52 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: +++ 0.524.152 (null)
Oct 08 20:15:52 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib: @num_updates=152
Oct 08 20:15:52 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='nco_itnm']/lrm_rsc_op[@id='nco_itnm_last_0']: @transition-magic=0:0;13:4:0:c2eb7813-bdec-4a6a-b84c-2918ad8d7ea1, @call-id=103, @rc-code=0, @op-status=0, @exec-time=635
Oct 08 20:15:52 pplxnsms02 pacemaker-controld [2418] (process_graph_event) info: Transition 4 action 13 (nco_itnm_stop_0 on pplxnsms02) confirmed: ok | rc=0 call-id=103
Oct 08 20:15:52 pplxnsms02 pacemaker-controld [2418] (pcmk__execute_graph) notice: Transition 4 (Complete=3, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-1000.bz2): Complete
Oct 08 20:15:52 pplxnsms02 pacemaker-controld [2418] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 08 20:15:52 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 08 20:15:52 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/164, version=0.524.152)
Oct 08 20:15:53 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[29295] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 1 20:12 ? 00:00:04 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:15:57 pplxnsms02 pacemaker-based [2413] (cib_process_ping) info: Reporting our current digest to pplxnsms02: 0275790496071999f8a2a8bcf698287e for 0.524.152 (0x55cd0e8c6740 0)
Oct 08 20:15:58 pplxnsms02 pacemaker-controld [2418] (throttle_send_command) info: New throttle mode: low load (was medium)
Oct 08 20:16:03 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[29909] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 1 20:12 ? 00:00:04 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:16:13 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[32208] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 1 20:12 ? 00:00:04 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:16:23 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[32396] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 1 20:12 ? 00:00:04 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:16:28 pplxnsms02 pacemaker-controld [2418] (throttle_send_command) info: New throttle mode: negligible load (was low)
Oct 08 20:16:33 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[33442] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:05 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:16:43 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[33897] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:05 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:16:54 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[34272] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:05 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:17:04 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[35848] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:05 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:17:14 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[37263] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:05 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:17:24 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[37831] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:06 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:17:34 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[39288] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:06 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:17:44 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[39606] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:06 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:17:54 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[40842] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:06 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:18:04 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[41532] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:06 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:18:14 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[43019] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:07 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:18:24 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[44092] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:07 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:18:34 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[44502] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:07 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:18:44 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[45397] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:07 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:18:54 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[45993] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 1 20:12 ? 00:00:07 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:19:04 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[46541] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 1 20:12 ? 00:00:08 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:19:14 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[48848] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 1 20:12 ? 00:00:08 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:19:24 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[49037] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 1 20:12 ? 00:00:08 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:19:34 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[49627] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 1 20:12 ? 00:00:08 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:19:44 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[50557] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 1 20:12 ? 00:00:08 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:19:54 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[50931] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 1 20:12 ? 00:00:08 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:20:05 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[52318] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 1 20:12 ? 00:00:09 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:20:15 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[53763] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 1 20:12 ? 00:00:09 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:20:25 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[53959] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 1 20:12 ? 00:00:09 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:20:35 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[55254] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 1 20:12 ? 00:00:09 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:20:45 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[55474] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 1 20:12 ? 00:00:10 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:20:55 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[56496] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:10 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:21:05 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[57313] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:10 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:21:15 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[58729] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:10 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:21:25 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[59785] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:10 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:21:35 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[60189] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:11 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:21:45 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[60897] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:11 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:21:55 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[61674] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:11 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:22:05 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[62382] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:11 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:22:15 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[64682] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:12 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:22:25 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[64878] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:12 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:22:35 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[65458] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:12 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:22:45 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[66377] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:12 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:22:55 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[66751] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:12 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:23:05 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[68155] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:13 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:23:15 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[69597] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:13 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:23:25 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[69771] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:13 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:23:36 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[71144] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:13 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:23:46 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[71368] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:13 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:23:56 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[72408] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:14 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:24:06 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[73205] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:14 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:24:16 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[74621] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:14 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:24:26 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[75712] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:14 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:24:36 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[76115] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:15 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:24:46 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[76816] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:15 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:24:56 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[77581] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:15 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:25:06 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[78129] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:15 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:25:16 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[80414] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:15 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:25:26 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[80626] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:16 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:25:36 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[81041] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:16 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:25:46 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[82134] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:16 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:25:56 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[82509] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:16 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:26:06 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[83758] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:17 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:26:16 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[85334] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:17 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:26:26 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[85531] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:17 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:26:36 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[86837] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:17 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:26:47 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[87057] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:18 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:26:57 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[88205] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:18 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:27:07 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[90136] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:18 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:27:17 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[90516] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:18 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:27:27 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[91595] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:18 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:27:37 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[92003] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:19 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:27:47 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[92415] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:19 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:27:57 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[93580] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:19 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:28:07 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[95152] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:19 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:28:17 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[96399] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:19 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:28:27 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[96623] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:20 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:28:37 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[97049] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:20 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:28:47 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[98160] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:20 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:28:57 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[98648] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:20 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:29:07 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[100698] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:21 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:29:17 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[101392] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:21 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:29:27 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[101589] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:21 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:29:38 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[102952] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:21 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:29:48 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[103188] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:21 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:29:58 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[104090] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:22 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:30:08 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[106089] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:22 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:30:18 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[106497] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:22 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:30:28 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[107577] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:22 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:30:38 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[108006] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:23 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:30:48 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[108233] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:23 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:30:52 pplxnsms02 pacemaker-controld [2418] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 08 20:30:52 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 08 20:30:52 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 08 20:30:52 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 08 20:30:52 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) notice: On loss of quorum: Ignore
Oct 08 20:30:52 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 08 20:30:52 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms02 is online
Oct 08 20:30:52 pplxnsms02 pacemaker-schedulerd[2417] (unpack_transient_attributes) info: Node pplxnsms01 is in standby-mode
Oct 08 20:30:52 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 08 20:30:52 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms01 is standby
Oct 08 20:30:52 pplxnsms02 pacemaker-schedulerd[2417] (unpack_rsc_op_failure) warning: Unexpected result (error) was recorded for start of nco_itnm on pplxnsms02 at Oct 8 20:15:42 2024 | rc=1 id=nco_itnm_last_failure_0
Oct 08 20:30:52 pplxnsms02 pacemaker-schedulerd[2417] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Oct 8 20:12:15 2024
Oct 08 20:30:52 pplxnsms02 pacemaker-schedulerd[2417] (pe_get_failcount) info: nco_itnm has failed INFINITY times on pplxnsms02
Oct 08 20:30:52 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__threshold_reached) warning: nco_itnm cannot run on pplxnsms02 due to reaching migration threshold (clean up resource to allow again)| failures=1000000 migration-threshold=1000000
Oct 08 20:30:52 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_merge_weights) info: itm_vip: Rolling back optional scores from nco_itnm
Oct 08 20:30:52 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_merge_weights) info: itm_lvm: Rolling back optional scores from nco_itnm
Oct 08 20:30:52 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_merge_weights) info: itm_fs: Rolling back optional scores from nco_itnm
Oct 08 20:30:52 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_merge_weights) info: itm_fs2: Rolling back optional scores from nco_itnm
Oct 08 20:30:52 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_merge_weights) info: itm_fs3: Rolling back optional scores from nco_itnm
Oct 08 20:30:52 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_merge_weights) info: nco_db2: Rolling back optional scores from nco_itnm
Oct 08 20:30:52 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_merge_weights) info: nco_omni: Rolling back optional scores from nco_itnm
Oct 08 20:30:52 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_merge_weights) info: nco_itnm: Rolling back optional scores from nco_cognos
Oct 08 20:30:52 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource nco_itnm cannot run anywhere
Oct 08 20:30:52 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource nco_cognos cannot run anywhere
Oct 08 20:30:52 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 08 20:30:52 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 08 20:30:52 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 08 20:30:52 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 08 20:30:52 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 08 20:30:52 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 08 20:30:52 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 08 20:30:52 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 08 20:30:52 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 08 20:30:52 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_itnm (Stopped)
Oct 08 20:30:52 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_cognos (Stopped)
Oct 08 20:30:52 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_vip (Started pplxnsms02)
Oct 08 20:30:52 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms02)
Oct 08 20:30:52 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_fs (Started pplxnsms02)
Oct 08 20:30:52 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms02)
Oct 08 20:30:52 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 08 20:30:52 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 08 20:30:52 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms02)
Oct 08 20:30:52 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__log_transition_summary) notice: Calculated transition 5, saving inputs in /var/lib/pacemaker/pengine/pe-input-1001.bz2
Oct 08 20:30:52 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 08 20:30:52 pplxnsms02 pacemaker-controld [2418] (do_te_invoke) info: Processing graph 5 (ref=pe_calc-dc-1728390652-96) derived from /var/lib/pacemaker/pengine/pe-input-1001.bz2
Oct 08 20:30:52 pplxnsms02 pacemaker-controld [2418] (pcmk__execute_graph) notice: Transition 5 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-1001.bz2): Complete
Oct 08 20:30:52 pplxnsms02 pacemaker-controld [2418] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 08 20:30:52 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 08 20:30:58 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[109924] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:23 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:31:08 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[111145] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:23 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:31:18 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[112121] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:23 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:31:28 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[112612] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:24 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:31:38 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[113009] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:24 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:31:48 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[114107] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:24 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:31:58 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[115109] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:24 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:32:08 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[116615] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:24 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:32:18 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[117510] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:25 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:32:29 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[117710] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:25 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:32:39 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[118976] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:25 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:32:49 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[119226] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:25 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:32:59 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[120292] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:26 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:33:09 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[122094] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:26 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:33:19 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[122476] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:26 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:33:29 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[123332] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:26 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:33:39 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[123941] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:26 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:33:49 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[124167] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:27 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:33:59 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[126227] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:27 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:34:09 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[126998] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:27 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:34:19 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[127848] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:27 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:34:29 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[128484] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:28 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:34:39 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[128880] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:28 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:34:49 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[129985] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:28 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:34:59 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[131367] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:28 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:35:09 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[132117] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:28 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:35:19 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[133202] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:29 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:35:30 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[133405] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:29 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:35:40 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[134599] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:29 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:35:50 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[134899] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:29 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:36:00 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[136471] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:29 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:36:10 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[137798] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:30 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:36:20 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[138179] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:30 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:36:30 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[138945] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:30 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:36:40 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[139672] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:31 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:36:50 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[139892] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:31 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:37:00 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[142473] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:31 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:37:10 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[142893] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:31 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:37:20 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[143608] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:31 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:37:30 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[144346] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:32 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:37:40 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[144748] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:32 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:37:50 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[145848] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:32 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:38:00 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[147639] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:32 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:38:10 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[147840] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:33 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:38:20 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[149077] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:33 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:38:30 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[149278] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:33 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:38:41 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[150334] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:33 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:38:51 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[150761] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:33 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:39:01 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[152577] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:34 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:39:11 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[153648] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:34 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:39:21 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[154029] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:34 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:39:31 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[154707] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:34 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:39:41 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[155525] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:35 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:39:51 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[155745] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:35 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:40:01 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[158378] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:35 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:40:11 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[158573] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:35 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:40:21 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[159134] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:35 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:40:31 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[160042] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:36 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:40:41 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[160438] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:36 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:40:51 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[161521] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:36 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:41:01 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[163323] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:36 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:41:11 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[163509] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:37 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:41:21 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[164768] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:37 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:41:31 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[164971] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:37 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:41:41 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[166046] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:37 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:41:52 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[166513] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:37 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:42:02 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[168529] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:38 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:42:12 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[169605] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:38 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:42:22 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[169987] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:38 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:42:32 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[170655] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:38 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:42:42 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[171471] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:39 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:42:52 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[171691] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:39 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:43:02 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[174307] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:39 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:43:12 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[174519] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:39 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:43:22 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[174900] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:39 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:43:32 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[175975] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:40 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:43:42 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[176372] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:40 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:43:52 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[177239] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:40 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:44:02 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[179222] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:40 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:44:12 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[179408] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:41 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:44:22 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[180667] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:41 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:44:32 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[180869] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:41 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:44:42 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[181730] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:41 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:44:52 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[182359] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:42 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:45:02 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[184172] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:42 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:45:13 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[185237] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:42 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:45:23 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[185618] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:42 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:45:33 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[186014] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:43 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:45:43 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[187108] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:43 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:45:52 pplxnsms02 pacemaker-controld [2418] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 08 20:45:52 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 08 20:45:52 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 08 20:45:52 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 08 20:45:52 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) notice: On loss of quorum: Ignore
Oct 08 20:45:52 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 08 20:45:52 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms02 is online
Oct 08 20:45:52 pplxnsms02 pacemaker-schedulerd[2417] (unpack_transient_attributes) info: Node pplxnsms01 is in standby-mode
Oct 08 20:45:52 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 08 20:45:52 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms01 is standby
Oct 08 20:45:52 pplxnsms02 pacemaker-schedulerd[2417] (unpack_rsc_op_failure) warning: Unexpected result (error) was recorded for start of nco_itnm on pplxnsms02 at Oct 8 20:15:42 2024 | rc=1 id=nco_itnm_last_failure_0
Oct 08 20:45:52 pplxnsms02 pacemaker-schedulerd[2417] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Oct 8 20:12:15 2024
Oct 08 20:45:52 pplxnsms02 pacemaker-schedulerd[2417] (pe_get_failcount) info: nco_itnm has failed INFINITY times on pplxnsms02
Oct 08 20:45:52 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__threshold_reached) warning: nco_itnm cannot run on pplxnsms02 due to reaching migration threshold (clean up resource to allow again)| failures=1000000 migration-threshold=1000000
Oct 08 20:45:52 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_merge_weights) info: itm_vip: Rolling back optional scores from nco_itnm
Oct 08 20:45:52 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_merge_weights) info: itm_lvm: Rolling back optional scores from nco_itnm
Oct 08 20:45:52 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_merge_weights) info: itm_fs: Rolling back optional scores from nco_itnm
Oct 08 20:45:52 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_merge_weights) info: itm_fs2: Rolling back optional scores from nco_itnm
Oct 08 20:45:52 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_merge_weights) info: itm_fs3: Rolling back optional scores from nco_itnm
Oct 08 20:45:52 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_merge_weights) info: nco_db2: Rolling back optional scores from nco_itnm
Oct 08 20:45:52 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_merge_weights) info: nco_omni: Rolling back optional scores from nco_itnm
Oct 08 20:45:52 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_merge_weights) info: nco_itnm: Rolling back optional scores from nco_cognos
Oct 08 20:45:52 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource nco_itnm cannot run anywhere
Oct 08 20:45:52 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource nco_cognos cannot run anywhere
Oct 08 20:45:52 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 08 20:45:52 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 08 20:45:52 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_vip (Started pplxnsms02)
Oct 08 20:45:52 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms02)
Oct 08 20:45:52 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs (Started pplxnsms02)
Oct 08 20:45:52 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms02)
Oct 08 20:45:52 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms02)
Oct 08 20:45:52 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms02)
Oct 08 20:45:52 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_omni (Started pplxnsms02)
Oct 08 20:45:52 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_itnm (Stopped)
Oct 08 20:45:52 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_cognos (Stopped)
Oct 08 20:45:52 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_vip (Started pplxnsms02)
Oct 08 20:45:52 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms02)
Oct 08 20:45:52 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_fs (Started pplxnsms02)
Oct 08 20:45:52 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms02)
Oct 08 20:45:52 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 08 20:45:52 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 08 20:45:52 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms02)
Oct 08 20:45:52 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__log_transition_summary) notice: Calculated transition 6, saving inputs in /var/lib/pacemaker/pengine/pe-input-1001.bz2
Oct 08 20:45:52 pplxnsms02 pacemaker-schedulerd[2417] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 08 20:45:52 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 08 20:45:52 pplxnsms02 pacemaker-controld [2418] (do_te_invoke) info: Processing graph 6 (ref=pe_calc-dc-1728391552-97) derived from /var/lib/pacemaker/pengine/pe-input-1001.bz2
Oct 08 20:45:52 pplxnsms02 pacemaker-controld [2418] (pcmk__execute_graph) notice: Transition 6 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-1001.bz2): Complete
Oct 08 20:45:52 pplxnsms02 pacemaker-controld [2418] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 08 20:45:52 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 08 20:45:53 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[187329] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:43 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:46:03 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[190005] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:43 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:46:13 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[190221] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:44 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:46:23 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[190602] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:44 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:46:33 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[191695] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:44 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:46:43 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[192091] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:45 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:46:53 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[192967] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:45 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:47:03 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[195108] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:45 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:47:13 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[195294] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:45 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:47:23 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[196567] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:45 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:47:33 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[196768] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:46 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:47:43 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[197641] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:46 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:47:53 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[198264] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:46 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:48:03 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[200077] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:47 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:48:13 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[201152] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:47 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:48:24 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[201534] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:47 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:48:34 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[201910] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:47 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:48:44 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[203004] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:47 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:48:54 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[203224] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:48 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:49:04 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[205812] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:48 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:49:14 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[206052] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:48 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:49:24 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[206433] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:48 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:49:34 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[207527] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:49 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:49:44 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[207924] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:49 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:49:54 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[208744] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:49 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:50:04 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[210810] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:49 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:50:14 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[210999] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:50 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:50:24 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[212277] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:50 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:50:34 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[212481] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:50 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:50:44 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[213212] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:50 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:50:54 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[213997] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:50 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:51:04 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[215810] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:51 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:51:14 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[216869] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:51 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:51:24 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[217273] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:51 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:51:34 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[217477] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:51 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:51:45 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[218744] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:52 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:51:55 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[218958] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:52 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:52:05 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[221780] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:52 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:52:15 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[222190] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:52 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:52:25 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[222565] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:52 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:52:35 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[223661] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:53 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:52:45 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[224069] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:53 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:52:55 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[224837] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:53 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:53:05 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[226930] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:53 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:53:15 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[227122] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:54 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:53:25 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[228381] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:54 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:53:35 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[228583] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:54 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:53:45 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[229366] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:54 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:53:55 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[230084] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:54 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:54:05 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[231854] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:55 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:54:15 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[232877] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:55 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:54:25 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[233281] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:55 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:54:35 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[233487] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:55 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:54:45 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[234770] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:56 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:54:56 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[234984] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:56 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:55:06 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[237464] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:56 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:55:16 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[237888] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:56 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:55:26 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[238273] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:56 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:55:36 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[239338] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:57 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:55:46 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[239740] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:57 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:55:56 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[240450] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:57 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:56:06 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[242591] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:57 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:56:16 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[242784] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:57 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:56:26 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[244059] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:58 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:56:36 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[244251] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:58 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:56:46 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[244884] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:58 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:56:56 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[245739] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:58 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:57:06 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[247667] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:59 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:57:16 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[248702] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:59 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:57:26 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[249104] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:59 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:57:36 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[249302] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:59 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:57:46 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[250588] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:00:59 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:57:56 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[250802] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:01:00 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:58:06 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[253275] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:01:00 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:58:17 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[253694] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:01:00 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:58:27 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[254077] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:01:00 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:58:37 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[255144] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:01:00 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:58:47 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[255532] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:01:01 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:58:57 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[256297] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:01:01 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:59:07 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[258434] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:01:01 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:59:17 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[258780] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:01:01 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:59:27 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[260027] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:01:02 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:59:37 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[260242] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:01:02 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:59:47 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[260797] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:01:02 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 20:59:57 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_monitor_10000[261787] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 8057 1 2 20:12 ? 00:01:02 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 21:00:04 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: --- 0.524.152 2
Oct 08 21:00:04 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: +++ 0.525.0 8535f4e25ee2e1e52ac71090361f9572
Oct 08 21:00:04 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: -- /cib/configuration/nodes/node[@id='1']/instance_attributes[@id='nodes-1']/nvpair[@id='nodes-1-standby']
Oct 08 21:00:04 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib: @epoch=525, @num_updates=0
Oct 08 21:00:04 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Completed cib_apply_diff operation for section 'all': OK (rc=0, origin=pplxnsms01/cibadmin/2, version=0.525.0)
Oct 08 21:00:04 pplxnsms02 pacemaker-controld [2418] (abort_transition_graph) info: Transition 6 aborted by deletion of nvpair[@id='nodes-1-standby']: Configuration change | cib=0.525.0 source=te_update_diff_v2:475 path=/cib/configuration/nodes/node[@id='1']/instance_attributes[@id='nodes-1']/nvpair[@id='nodes-1-standby'] complete=true
Oct 08 21:00:04 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_FSA_INTERNAL origin=abort_transition_graph
Oct 08 21:00:04 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 08 21:00:04 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) notice: On loss of quorum: Ignore
Oct 08 21:00:04 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 08 21:00:04 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms02 is online
Oct 08 21:00:04 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 08 21:00:04 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms01 is online
Oct 08 21:00:04 pplxnsms02 pacemaker-schedulerd[2417] (unpack_rsc_op_failure) warning: Unexpected result (error) was recorded for start of nco_itnm on pplxnsms02 at Oct 8 20:15:42 2024 | rc=1 id=nco_itnm_last_failure_0
Oct 08 21:00:04 pplxnsms02 pacemaker-schedulerd[2417] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Oct 8 20:12:15 2024
Oct 08 21:00:04 pplxnsms02 pacemaker-based [2413] (cib_file_backup) info: Archived previous version as /var/lib/pacemaker/cib/cib-54.raw
Oct 08 21:00:04 pplxnsms02 pacemaker-schedulerd[2417] (pe_get_failcount) info: nco_itnm has failed INFINITY times on pplxnsms02
Oct 08 21:00:04 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__threshold_reached) warning: nco_itnm cannot run on pplxnsms02 due to reaching migration threshold (clean up resource to allow again)| failures=1000000 migration-threshold=1000000
Oct 08 21:00:04 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 08 21:00:04 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 08 21:00:04 pplxnsms02 pacemaker-schedulerd[2417] (RecurringOp) info: Start recurring monitor (10s) for itm_vip on pplxnsms01
Oct 08 21:00:04 pplxnsms02 pacemaker-schedulerd[2417] (RecurringOp) info: Start recurring monitor (30s) for itm_lvm on pplxnsms01
Oct 08 21:00:04 pplxnsms02 pacemaker-schedulerd[2417] (RecurringOp) info: Start recurring monitor (20s) for itm_fs on pplxnsms01
Oct 08 21:00:04 pplxnsms02 pacemaker-schedulerd[2417] (RecurringOp) info: Start recurring monitor (20s) for itm_fs2 on pplxnsms01
Oct 08 21:00:04 pplxnsms02 pacemaker-schedulerd[2417] (RecurringOp) info: Start recurring monitor (20s) for itm_fs3 on pplxnsms01
Oct 08 21:00:04 pplxnsms02 pacemaker-schedulerd[2417] (RecurringOp) info: Start recurring monitor (20s) for nco_db2 on pplxnsms01
Oct 08 21:00:04 pplxnsms02 pacemaker-schedulerd[2417] (RecurringOp) info: Start recurring monitor (60s) for nco_omni on pplxnsms01
Oct 08 21:00:04 pplxnsms02 pacemaker-schedulerd[2417] (RecurringOp) info: Start recurring monitor (300s) for nco_itnm on pplxnsms01
Oct 08 21:00:04 pplxnsms02 pacemaker-schedulerd[2417] (RecurringOp) info: Start recurring monitor (10s) for nco_cognos on pplxnsms01
Oct 08 21:00:04 pplxnsms02 pacemaker-schedulerd[2417] (RecurringOp) info: Start recurring monitor (10s) for siem_vip on pplxnsms01
Oct 08 21:00:04 pplxnsms02 pacemaker-schedulerd[2417] (RecurringOp) info: Start recurring monitor (30s) for siem_lvm on pplxnsms01
Oct 08 21:00:04 pplxnsms02 pacemaker-schedulerd[2417] (RecurringOp) info: Start recurring monitor (20s) for siem_fs on pplxnsms01
Oct 08 21:00:04 pplxnsms02 pacemaker-schedulerd[2417] (RecurringOp) info: Start recurring monitor (10s) for siem_rsyslog on pplxnsms01
Oct 08 21:00:04 pplxnsms02 pacemaker-schedulerd[2417] (log_list_item) notice: Actions: Move itm_vip ( pplxnsms02 -> pplxnsms01 )
Oct 08 21:00:04 pplxnsms02 pacemaker-schedulerd[2417] (log_list_item) notice: Actions: Move itm_lvm ( pplxnsms02 -> pplxnsms01 )
Oct 08 21:00:04 pplxnsms02 pacemaker-schedulerd[2417] (log_list_item) notice: Actions: Move itm_fs ( pplxnsms02 -> pplxnsms01 )
Oct 08 21:00:04 pplxnsms02 pacemaker-schedulerd[2417] (log_list_item) notice: Actions: Move itm_fs2 ( pplxnsms02 -> pplxnsms01 )
Oct 08 21:00:04 pplxnsms02 pacemaker-schedulerd[2417] (log_list_item) notice: Actions: Move itm_fs3 ( pplxnsms02 -> pplxnsms01 )
Oct 08 21:00:04 pplxnsms02 pacemaker-schedulerd[2417] (log_list_item) notice: Actions: Move nco_db2 ( pplxnsms02 -> pplxnsms01 )
Oct 08 21:00:04 pplxnsms02 pacemaker-schedulerd[2417] (log_list_item) notice: Actions: Move nco_omni ( pplxnsms02 -> pplxnsms01 )
Oct 08 21:00:04 pplxnsms02 pacemaker-schedulerd[2417] (log_list_item) notice: Actions: Start nco_itnm ( pplxnsms01 )
Oct 08 21:00:04 pplxnsms02 pacemaker-schedulerd[2417] (log_list_item) notice: Actions: Start nco_cognos ( pplxnsms01 )
Oct 08 21:00:04 pplxnsms02 pacemaker-schedulerd[2417] (log_list_item) notice: Actions: Move siem_vip ( pplxnsms02 -> pplxnsms01 )
Oct 08 21:00:04 pplxnsms02 pacemaker-schedulerd[2417] (log_list_item) notice: Actions: Move siem_lvm ( pplxnsms02 -> pplxnsms01 )
Oct 08 21:00:04 pplxnsms02 pacemaker-schedulerd[2417] (log_list_item) notice: Actions: Move siem_fs ( pplxnsms02 -> pplxnsms01 )
Oct 08 21:00:04 pplxnsms02 pacemaker-schedulerd[2417] (log_list_item) notice: Actions: Move siem_rsyslog ( pplxnsms02 -> pplxnsms01 )
Oct 08 21:00:04 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 08 21:00:04 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 08 21:00:04 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms02)
Oct 08 21:00:04 pplxnsms02 pacemaker-based [2413] (cib_file_write_with_digest) info: Wrote version 0.525.0 of the CIB to disk (digest: fb3c30651040b43582d1d67aaccc05b5)
Oct 08 21:00:04 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__log_transition_summary) notice: Calculated transition 7, saving inputs in /var/lib/pacemaker/pengine/pe-input-1002.bz2
Oct 08 21:00:04 pplxnsms02 pacemaker-based [2413] (cib_file_write_with_digest) info: Reading cluster configuration file /var/lib/pacemaker/cib/cib.kq3oOS (digest: /var/lib/pacemaker/cib/cib.d7JUk0)
Oct 08 21:00:04 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 08 21:00:04 pplxnsms02 pacemaker-controld [2418] (do_te_invoke) info: Processing graph 7 (ref=pe_calc-dc-1728392404-98) derived from /var/lib/pacemaker/pengine/pe-input-1002.bz2
Oct 08 21:00:04 pplxnsms02 pacemaker-controld [2418] (te_rsc_command) notice: Initiating stop operation nco_omni_stop_0 locally on pplxnsms02 | action 31
Oct 08 21:00:04 pplxnsms02 pacemaker-execd [2415] (cancel_recurring_action) info: Cancelling ocf operation nco_omni_monitor_60000
Oct 08 21:00:04 pplxnsms02 pacemaker-controld [2418] (do_lrm_rsc_op) notice: Requesting local execution of stop operation for nco_omni on pplxnsms02 | transition_key=31:7:0:c2eb7813-bdec-4a6a-b84c-2918ad8d7ea1 op_key=nco_omni_stop_0
Oct 08 21:00:04 pplxnsms02 pacemaker-execd [2415] (log_execute) info: executing - rsc:nco_omni action:stop call_id:105
Oct 08 21:00:04 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/168)
Oct 08 21:00:04 pplxnsms02 pacemaker-controld [2418] (te_rsc_command) notice: Initiating stop operation siem_rsyslog_stop_0 locally on pplxnsms02 | action 51
Oct 08 21:00:04 pplxnsms02 pacemaker-execd [2415] (cancel_recurring_action) info: Cancelling ocf operation siem_rsyslog_monitor_10000
Oct 08 21:00:04 pplxnsms02 pacemaker-controld [2418] (do_lrm_rsc_op) notice: Requesting local execution of stop operation for siem_rsyslog on pplxnsms02 | transition_key=51:7:0:c2eb7813-bdec-4a6a-b84c-2918ad8d7ea1 op_key=siem_rsyslog_stop_0
Oct 08 21:00:04 pplxnsms02 pacemaker-execd [2415] (log_execute) info: executing - rsc:siem_rsyslog action:stop call_id:107
Oct 08 21:00:04 pplxnsms02 pacemaker-controld [2418] (log_executor_event) info: Result of monitor operation for nco_omni on pplxnsms02: Cancelled | graph action confirmed; call=101 key=nco_omni_monitor_60000
Oct 08 21:00:04 pplxnsms02 pacemaker-controld [2418] (log_executor_event) info: Result of monitor operation for siem_rsyslog on pplxnsms02: Cancelled | graph action confirmed; call=85 key=siem_rsyslog_monitor_10000
Oct 08 21:00:04 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: --- 0.525.0 2
Oct 08 21:00:04 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: +++ 0.525.1 (null)
Oct 08 21:00:04 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib: @num_updates=1
Oct 08 21:00:04 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='nco_omni']/lrm_rsc_op[@id='nco_omni_last_0']: @operation_key=nco_omni_stop_0, @operation=stop, @transition-key=31:7:0:c2eb7813-bdec-4a6a-b84c-2918ad8d7ea1, @transition-magic=-1:193;31:7:0:c2eb7813-bdec-4a6a-b84c-2918ad8d7ea1, @call-id=-1, @rc-code=193, @op-status=-1, @last-rc-change=1728392404, @exec-time=0
Oct 08 21:00:04 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/168, version=0.525.1)
Oct 08 21:00:04 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/169)
Oct 08 21:00:04 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: --- 0.525.1 2
Oct 08 21:00:04 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: +++ 0.525.2 (null)
Oct 08 21:00:04 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib: @num_updates=2
Oct 08 21:00:04 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='siem_rsyslog']/lrm_rsc_op[@id='siem_rsyslog_last_0']: @operation_key=siem_rsyslog_stop_0, @operation=stop, @transition-key=51:7:0:c2eb7813-bdec-4a6a-b84c-2918ad8d7ea1, @transition-magic=-1:193;51:7:0:c2eb7813-bdec-4a6a-b84c-2918ad8d7ea1, @call-id=-1, @rc-code=193, @op-status=-1, @last-rc-change=1728392404, @exec-time=0
Oct 08 21:00:04 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/169, version=0.525.2)
Oct 08 21:00:05 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_stop_0[263245] error output [ ls: cannot access '/run/resource-agents/siemsyslog-siem_rsyslog.state': No such file or directory ]
Oct 08 21:00:05 pplxnsms02 pacemaker-execd [2415] (log_op_output) info: siem_rsyslog_stop_0[263245] error output [ /usr/lib/ocf/resource.d/heartbeat/siemsyslog: line 171: [: root 263346 1 0 21:00 ? 00:00:00 /usr/sbin/rsyslogd -n: integer expression expected ]
Oct 08 21:00:05 pplxnsms02 pacemaker-execd [2415] (log_finished) info: siem_rsyslog stop (call 107, PID 263245) exited with status 0 (execution time 631ms)
Oct 08 21:00:05 pplxnsms02 pacemaker-controld [2418] (log_executor_event) notice: Result of stop operation for siem_rsyslog on pplxnsms02: ok | CIB update 170, graph action confirmed; call=107 key=siem_rsyslog_stop_0 rc=0
Oct 08 21:00:05 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/170)
Oct 08 21:00:05 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: --- 0.525.2 2
Oct 08 21:00:05 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: +++ 0.525.3 (null)
Oct 08 21:00:05 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib: @num_updates=3
Oct 08 21:00:05 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='siem_rsyslog']/lrm_rsc_op[@id='siem_rsyslog_last_0']: @transition-magic=0:0;51:7:0:c2eb7813-bdec-4a6a-b84c-2918ad8d7ea1, @call-id=107, @rc-code=0, @op-status=0, @exec-time=631
Oct 08 21:00:05 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/170, version=0.525.3)
Oct 08 21:00:05 pplxnsms02 pacemaker-controld [2418] (process_graph_event) info: Transition 7 action 51 (siem_rsyslog_stop_0 on pplxnsms02) confirmed: ok | rc=0 call-id=107
Oct 08 21:00:05 pplxnsms02 pacemaker-controld [2418] (te_rsc_command) notice: Initiating stop operation siem_fs_stop_0 locally on pplxnsms02 | action 48
Oct 08 21:00:05 pplxnsms02 pacemaker-execd [2415] (cancel_recurring_action) info: Cancelling ocf operation siem_fs_monitor_20000
Oct 08 21:00:05 pplxnsms02 pacemaker-controld [2418] (do_lrm_rsc_op) notice: Requesting local execution of stop operation for siem_fs on pplxnsms02 | transition_key=48:7:0:c2eb7813-bdec-4a6a-b84c-2918ad8d7ea1 op_key=siem_fs_stop_0
Oct 08 21:00:05 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/171)
Oct 08 21:00:05 pplxnsms02 pacemaker-execd [2415] (log_execute) info: executing - rsc:siem_fs action:stop call_id:109
Oct 08 21:00:05 pplxnsms02 pacemaker-controld [2418] (log_executor_event) info: Result of monitor operation for siem_fs on pplxnsms02: Cancelled | graph action confirmed; call=76 key=siem_fs_monitor_20000
Oct 08 21:00:05 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: --- 0.525.3 2
Oct 08 21:00:05 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: +++ 0.525.4 (null)
Oct 08 21:00:05 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib: @num_updates=4
Oct 08 21:00:05 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='siem_fs']/lrm_rsc_op[@id='siem_fs_last_0']: @operation_key=siem_fs_stop_0, @operation=stop, @crm-debug-origin=do_update_resource, @transition-key=48:7:0:c2eb7813-bdec-4a6a-b84c-2918ad8d7ea1, @transition-magic=-1:193;48:7:0:c2eb7813-bdec-4a6a-b84c-2918ad8d7ea1, @call-id=-1, @rc-code=193, @op-status=-1, @last-rc-change=1728392405, @exec-time=0
Oct 08 21:00:05 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/171, version=0.525.4)
Oct 08 21:00:05 Filesystem(siem_fs)[263365]: INFO: Running stop for /dev/vgslog/lv_log01 on /siemlog
Oct 08 21:00:05 Filesystem(siem_fs)[263365]: INFO: Trying to unmount /siemlog
Oct 08 21:00:05 Filesystem(siem_fs)[263365]: INFO: unmounted /siemlog successfully
Oct 08 21:00:05 pplxnsms02 pacemaker-execd [2415] (log_finished) info: siem_fs stop (call 109, PID 263365) exited with status 0 (execution time 528ms)
Oct 08 21:00:05 pplxnsms02 pacemaker-controld [2418] (log_executor_event) notice: Result of stop operation for siem_fs on pplxnsms02: ok | CIB update 172, graph action confirmed; call=109 key=siem_fs_stop_0 rc=0
Oct 08 21:00:05 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/172)
Oct 08 21:00:05 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: --- 0.525.4 2
Oct 08 21:00:05 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: +++ 0.525.5 (null)
Oct 08 21:00:05 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib: @num_updates=5
Oct 08 21:00:05 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='siem_fs']/lrm_rsc_op[@id='siem_fs_last_0']: @transition-magic=0:0;48:7:0:c2eb7813-bdec-4a6a-b84c-2918ad8d7ea1, @call-id=109, @rc-code=0, @op-status=0, @exec-time=528
Oct 08 21:00:05 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/172, version=0.525.5)
Oct 08 21:00:05 pplxnsms02 pacemaker-controld [2418] (process_graph_event) info: Transition 7 action 48 (siem_fs_stop_0 on pplxnsms02) confirmed: ok | rc=0 call-id=109
Oct 08 21:00:05 pplxnsms02 pacemaker-controld [2418] (te_rsc_command) notice: Initiating stop operation siem_lvm_stop_0 locally on pplxnsms02 | action 45
Oct 08 21:00:05 pplxnsms02 pacemaker-execd [2415] (cancel_recurring_action) info: Cancelling ocf operation siem_lvm_monitor_30000
Oct 08 21:00:05 pplxnsms02 pacemaker-controld [2418] (do_lrm_rsc_op) notice: Requesting local execution of stop operation for siem_lvm on pplxnsms02 | transition_key=45:7:0:c2eb7813-bdec-4a6a-b84c-2918ad8d7ea1 op_key=siem_lvm_stop_0
Oct 08 21:00:05 pplxnsms02 pacemaker-execd [2415] (log_execute) info: executing - rsc:siem_lvm action:stop call_id:111
Oct 08 21:00:05 pplxnsms02 pacemaker-controld [2418] (log_executor_event) info: Result of monitor operation for siem_lvm on pplxnsms02: Cancelled | graph action confirmed; call=72 key=siem_lvm_monitor_30000
Oct 08 21:00:05 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/173)
Oct 08 21:00:05 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: --- 0.525.5 2
Oct 08 21:00:05 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: +++ 0.525.6 (null)
Oct 08 21:00:05 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib: @num_updates=6
Oct 08 21:00:05 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='siem_lvm']/lrm_rsc_op[@id='siem_lvm_last_0']: @operation_key=siem_lvm_stop_0, @operation=stop, @crm-debug-origin=do_update_resource, @transition-key=45:7:0:c2eb7813-bdec-4a6a-b84c-2918ad8d7ea1, @transition-magic=-1:193;45:7:0:c2eb7813-bdec-4a6a-b84c-2918ad8d7ea1, @call-id=-1, @rc-code=193, @op-status=-1, @last-rc-change=1728392405, @exec-time=0
Oct 08 21:00:05 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/173, version=0.525.6)
Oct 08 21:00:05 LVM-activate(siem_lvm)[263544]: INFO: Deactivating vgslog
Oct 08 21:00:05 LVM-activate(siem_lvm)[263544]: INFO: vgslog: deactivated successfully.
Oct 08 21:00:05 pplxnsms02 pacemaker-execd [2415] (log_finished) info: siem_lvm stop (call 111, PID 263544) exited with status 0 (execution time 140ms)
Oct 08 21:00:05 pplxnsms02 pacemaker-controld [2418] (log_executor_event) notice: Result of stop operation for siem_lvm on pplxnsms02: ok | CIB update 174, graph action confirmed; call=111 key=siem_lvm_stop_0 rc=0
Oct 08 21:00:05 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/174)
Oct 08 21:00:05 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: --- 0.525.6 2
Oct 08 21:00:05 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: +++ 0.525.7 (null)
Oct 08 21:00:05 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib: @num_updates=7
Oct 08 21:00:05 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='siem_lvm']/lrm_rsc_op[@id='siem_lvm_last_0']: @transition-magic=0:0;45:7:0:c2eb7813-bdec-4a6a-b84c-2918ad8d7ea1, @call-id=111, @rc-code=0, @op-status=0, @exec-time=140
Oct 08 21:00:05 pplxnsms02 pacemaker-controld [2418] (process_graph_event) info: Transition 7 action 45 (siem_lvm_stop_0 on pplxnsms02) confirmed: ok | rc=0 call-id=111
Oct 08 21:00:05 pplxnsms02 pacemaker-controld [2418] (te_rsc_command) notice: Initiating stop operation siem_vip_stop_0 locally on pplxnsms02 | action 42
Oct 08 21:00:05 pplxnsms02 pacemaker-execd [2415] (cancel_recurring_action) info: Cancelling ocf operation siem_vip_monitor_10000
Oct 08 21:00:05 pplxnsms02 pacemaker-controld [2418] (do_lrm_rsc_op) notice: Requesting local execution of stop operation for siem_vip on pplxnsms02 | transition_key=42:7:0:c2eb7813-bdec-4a6a-b84c-2918ad8d7ea1 op_key=siem_vip_stop_0
Oct 08 21:00:05 pplxnsms02 pacemaker-execd [2415] (log_execute) info: executing - rsc:siem_vip action:stop call_id:113
Oct 08 21:00:05 pplxnsms02 pacemaker-controld [2418] (log_executor_event) info: Result of monitor operation for siem_vip on pplxnsms02: Cancelled | graph action confirmed; call=70 key=siem_vip_monitor_10000
Oct 08 21:00:05 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/174, version=0.525.7)
Oct 08 21:00:05 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/175)
Oct 08 21:00:05 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: --- 0.525.7 2
Oct 08 21:00:05 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: +++ 0.525.8 (null)
Oct 08 21:00:05 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib: @num_updates=8
Oct 08 21:00:05 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='siem_vip']/lrm_rsc_op[@id='siem_vip_last_0']: @operation_key=siem_vip_stop_0, @operation=stop, @crm-debug-origin=do_update_resource, @transition-key=42:7:0:c2eb7813-bdec-4a6a-b84c-2918ad8d7ea1, @transition-magic=-1:193;42:7:0:c2eb7813-bdec-4a6a-b84c-2918ad8d7ea1, @call-id=-1, @rc-code=193, @op-status=-1, @last-rc-change=1728392405, @exec-time=0
Oct 08 21:00:05 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/175, version=0.525.8)
Oct 08 21:00:05 IPaddr2(siem_vip)[263600]: INFO: IP status = ok, IP_CIP=
Oct 08 21:00:05 pplxnsms02 pacemaker-execd [2415] (log_finished) info: siem_vip stop (call 113, PID 263600) exited with status 0 (execution time 80ms)
Oct 08 21:00:05 pplxnsms02 pacemaker-controld [2418] (log_executor_event) notice: Result of stop operation for siem_vip on pplxnsms02: ok | CIB update 176, graph action confirmed; call=113 key=siem_vip_stop_0 rc=0
Oct 08 21:00:05 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/176)
Oct 08 21:00:05 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: --- 0.525.8 2
Oct 08 21:00:05 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: +++ 0.525.9 (null)
Oct 08 21:00:05 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib: @num_updates=9
Oct 08 21:00:05 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='siem_vip']/lrm_rsc_op[@id='siem_vip_last_0']: @transition-magic=0:0;42:7:0:c2eb7813-bdec-4a6a-b84c-2918ad8d7ea1, @call-id=113, @rc-code=0, @op-status=0, @exec-time=80
Oct 08 21:00:05 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms02/crmd/176, version=0.525.9)
Oct 08 21:00:05 pplxnsms02 pacemaker-controld [2418] (process_graph_event) info: Transition 7 action 42 (siem_vip_stop_0 on pplxnsms02) confirmed: ok | rc=0 call-id=113
Oct 08 21:00:05 pplxnsms02 pacemaker-controld [2418] (te_rsc_command) notice: Initiating start operation siem_vip_start_0 on pplxnsms01 | action 43
Oct 08 21:00:05 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: --- 0.525.9 2
Oct 08 21:00:05 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: +++ 0.525.10 (null)
Oct 08 21:00:05 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib: @num_updates=10
Oct 08 21:00:05 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib/status/node_state[@id='1']/lrm[@id='1']/lrm_resources/lrm_resource[@id='siem_vip']/lrm_rsc_op[@id='siem_vip_last_0']: @operation_key=siem_vip_start_0, @operation=start, @transition-key=43:7:0:c2eb7813-bdec-4a6a-b84c-2918ad8d7ea1, @transition-magic=-1:193;43:7:0:c2eb7813-bdec-4a6a-b84c-2918ad8d7ea1, @call-id=-1, @rc-code=193, @op-status=-1, @last-rc-change=1728392405, @exec-time=0
Oct 08 21:00:05 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms01/crmd/42, version=0.525.10)
Oct 08 21:00:06 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: --- 0.525.10 2
Oct 08 21:00:06 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: +++ 0.525.11 (null)
Oct 08 21:00:06 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib: @num_updates=11
Oct 08 21:00:06 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib/status/node_state[@id='1']/lrm[@id='1']/lrm_resources/lrm_resource[@id='siem_vip']/lrm_rsc_op[@id='siem_vip_last_0']: @transition-magic=0:0;43:7:0:c2eb7813-bdec-4a6a-b84c-2918ad8d7ea1, @call-id=67, @rc-code=0, @op-status=0, @exec-time=689
Oct 08 21:00:06 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms01/crmd/43, version=0.525.11)
Oct 08 21:00:06 pplxnsms02 pacemaker-controld [2418] (process_graph_event) info: Transition 7 action 43 (siem_vip_start_0 on pplxnsms01) confirmed: ok | rc=0 call-id=67
Oct 08 21:00:06 pplxnsms02 pacemaker-controld [2418] (te_rsc_command) notice: Initiating monitor operation siem_vip_monitor_10000 on pplxnsms01 | action 44
Oct 08 21:00:06 pplxnsms02 pacemaker-controld [2418] (te_rsc_command) notice: Initiating start operation siem_lvm_start_0 on pplxnsms01 | action 46
Oct 08 21:00:06 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: --- 0.525.11 2
Oct 08 21:00:06 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: +++ 0.525.12 (null)
Oct 08 21:00:06 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib: @num_updates=12
Oct 08 21:00:06 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: ++ /cib/status/node_state[@id='1']/lrm[@id='1']/lrm_resources/lrm_resource[@id='siem_vip']:
Oct 08 21:01:50 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Completed cib_apply_diff operation for section 'all': OK (rc=0, origin=pplxnsms01/cibadmin/2, version=0.526.0)
Oct 08 21:01:50 pplxnsms02 pacemaker-controld [2418] (abort_transition_graph) notice: Transition 7 aborted by nco_itnm-meta_attributes-target-role doing create target-role=Stopped: Configuration change | cib=0.526.0 source=te_update_diff_v2:475 path=/cib/configuration/resources/group[@id='rg01']/primitive[@id='nco_itnm']/meta_attributes[@id='nco_itnm-meta_attributes'] complete=false
Oct 08 21:01:50 pplxnsms02 pacemaker-fenced [2414] (update_cib_stonith_devices_v2) info: Updating device list from CIB: create meta_attributes[@id='nco_itnm-meta_attributes']
Oct 08 21:01:50 pplxnsms02 pacemaker-fenced [2414] (cib_devices_update) info: Updating devices to version 0.526.0
Oct 08 21:01:50 pplxnsms02 pacemaker-fenced [2414] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 08 21:01:50 pplxnsms02 pacemaker-fenced [2414] (unpack_config) notice: On loss of quorum: Ignore
Oct 08 21:01:50 pplxnsms02 pacemaker-based [2413] (cib_file_backup) info: Archived previous version as /var/lib/pacemaker/cib/cib-55.raw
Oct 08 21:01:50 pplxnsms02 pacemaker-based [2413] (cib_file_write_with_digest) info: Wrote version 0.526.0 of the CIB to disk (digest: 7cbf64d91b0b98bfabcc28c28c88babd)
Oct 08 21:01:50 pplxnsms02 pacemaker-based [2413] (cib_file_write_with_digest) info: Reading cluster configuration file /var/lib/pacemaker/cib/cib.1rOibo (digest: /var/lib/pacemaker/cib/cib.ocaHmk)
Oct 08 21:01:53 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: --- 0.526.0 2
Oct 08 21:01:53 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: +++ 0.526.1 (null)
Oct 08 21:01:53 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib: @num_updates=1
Oct 08 21:01:53 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib/status/node_state[@id='1']/lrm[@id='1']/lrm_resources/lrm_resource[@id='nco_db2']/lrm_rsc_op[@id='nco_db2_monitor_20000']: @transition-magic=0:0;30:7:0:c2eb7813-bdec-4a6a-b84c-2918ad8d7ea1, @call-id=86, @rc-code=0, @op-status=0, @exec-time=6261
Oct 08 21:01:53 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms01/crmd/82, version=0.526.1)
Oct 08 21:01:53 pplxnsms02 pacemaker-controld [2418] (process_graph_event) info: Transition 7 action 30 (nco_db2_monitor_20000 on pplxnsms01) confirmed: ok | rc=0 call-id=86
Oct 08 21:01:58 pplxnsms02 pacemaker-based [2413] (cib_process_ping) info: Reporting our current digest to pplxnsms02: d69c223b1b76108d88e1a65cdcec4f4b for 0.526.1 (0x55cd0e8c4230 0)
Oct 08 21:03:51 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: --- 0.526.1 2
Oct 08 21:03:51 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: +++ 0.526.2 (null)
Oct 08 21:03:51 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib: @num_updates=2
Oct 08 21:03:51 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib/status/node_state[@id='1']/lrm[@id='1']/lrm_resources/lrm_resource[@id='nco_omni']/lrm_rsc_op[@id='nco_omni_last_0']: @transition-magic=0:0;32:7:0:c2eb7813-bdec-4a6a-b84c-2918ad8d7ea1, @call-id=87, @rc-code=0, @op-status=0, @exec-time=124283
Oct 08 21:03:51 pplxnsms02 pacemaker-based [2413] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=pplxnsms01/crmd/83, version=0.526.2)
Oct 08 21:03:51 pplxnsms02 pacemaker-controld [2418] (process_graph_event) info: Transition 7 action 32 (nco_omni_start_0 on pplxnsms01) confirmed: ok | rc=0 call-id=87
Oct 08 21:03:51 pplxnsms02 pacemaker-controld [2418] (pcmk__execute_graph) notice: Transition 7 (Complete=38, Pending=0, Fired=0, Skipped=2, Incomplete=6, Source=/var/lib/pacemaker/pengine/pe-input-1002.bz2): Stopped
Oct 08 21:03:51 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_FSA_INTERNAL origin=notify_crmd
Oct 08 21:03:51 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 08 21:03:51 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) notice: On loss of quorum: Ignore
Oct 08 21:03:51 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 08 21:03:51 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms02 is online
Oct 08 21:03:51 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 08 21:03:51 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms01 is online
Oct 08 21:03:51 pplxnsms02 pacemaker-schedulerd[2417] (unpack_rsc_op_failure) warning: Unexpected result (error) was recorded for start of nco_itnm on pplxnsms02 at Oct 8 20:15:42 2024 | rc=1 id=nco_itnm_last_failure_0
Oct 08 21:03:51 pplxnsms02 pacemaker-schedulerd[2417] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Oct 8 20:12:15 2024
Oct 08 21:03:51 pplxnsms02 pacemaker-schedulerd[2417] (pe_get_failcount) info: nco_itnm has failed INFINITY times on pplxnsms02
Oct 08 21:03:51 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__threshold_reached) warning: nco_itnm cannot run on pplxnsms02 due to reaching migration threshold (clean up resource to allow again)| failures=1000000 migration-threshold=1000000
Oct 08 21:03:51 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource nco_itnm cannot run anywhere
Oct 08 21:03:51 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource nco_cognos cannot run anywhere
Oct 08 21:03:51 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 08 21:03:51 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 08 21:03:51 pplxnsms02 pacemaker-schedulerd[2417] (RecurringOp) info: Start recurring monitor (60s) for nco_omni on pplxnsms01
Oct 08 21:03:51 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_vip (Started pplxnsms01)
Oct 08 21:03:51 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms01)
Oct 08 21:03:51 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs (Started pplxnsms01)
Oct 08 21:03:51 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms01)
Oct 08 21:03:51 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms01)
Oct 08 21:03:51 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms01)
Oct 08 21:03:51 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_omni (Started pplxnsms01)
Oct 08 21:03:51 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_itnm (Stopped)
Oct 08 21:03:51 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_cognos (Stopped)
Oct 08 21:03:51 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 08 21:03:51 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 08 21:03:51 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 08 21:03:51 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 08 21:03:51 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 08 21:03:51 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 08 21:03:51 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms02)
Oct 08 21:03:51 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__log_transition_summary) notice: Calculated transition 8, saving inputs in /var/lib/pacemaker/pengine/pe-input-1003.bz2
Oct 08 21:03:51 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 08 21:03:51 pplxnsms02 pacemaker-controld [2418] (do_te_invoke) info: Processing graph 8 (ref=pe_calc-dc-1728392631-131) derived from /var/lib/pacemaker/pengine/pe-input-1003.bz2
Oct 08 21:03:51 pplxnsms02 pacemaker-controld [2418] (te_rsc_command) notice: Initiating monitor operation nco_omni_monitor_60000 on pplxnsms01 | action 26
Oct 08 21:03:51 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: --- 0.526.2 2
Oct 08 21:03:51 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: Diff: +++ 0.526.3 (null)
Oct 08 21:03:51 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: + /cib: @num_updates=3
Oct 08 21:03:51 pplxnsms02 pacemaker-based [2413] (cib_perform_op) info: ++ /cib/status/node_state[@id='1']/lrm[@id='1']/lrm_resources/lrm_resource[@id='nco_omni']: S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 08 21:26:41 pplxnsms02 pacemaker-based [2413] (cib_process_ping) info: Reporting our current digest to pplxnsms02: cd5c757656a31141624fb3cf06c6f4ef for 0.527.8 (0x55cd0ebb28b0 0)
Oct 08 21:41:36 pplxnsms02 pacemaker-controld [2418] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 08 21:41:36 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 08 21:41:36 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 08 21:41:36 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 08 21:41:36 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) notice: On loss of quorum: Ignore
Oct 08 21:41:36 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 08 21:41:36 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms02 is online
Oct 08 21:41:36 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 08 21:41:36 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms01 is online
Oct 08 21:41:36 pplxnsms02 pacemaker-schedulerd[2417] (unpack_rsc_op_failure) warning: Unexpected result (error) was recorded for start of nco_itnm on pplxnsms02 at Oct 8 20:15:42 2024 | rc=1 id=nco_itnm_last_failure_0
Oct 08 21:41:36 pplxnsms02 pacemaker-schedulerd[2417] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Oct 8 20:12:15 2024
Oct 08 21:41:36 pplxnsms02 pacemaker-schedulerd[2417] (pe_get_failcount) info: nco_itnm has failed INFINITY times on pplxnsms02
Oct 08 21:41:36 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__threshold_reached) warning: nco_itnm cannot run on pplxnsms02 due to reaching migration threshold (clean up resource to allow again)| failures=1000000 migration-threshold=1000000
Oct 08 21:41:36 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 08 21:41:36 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 08 21:41:36 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_vip (Started pplxnsms01)
Oct 08 21:41:36 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms01)
Oct 08 21:41:36 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs (Started pplxnsms01)
Oct 08 21:41:36 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms01)
Oct 08 21:41:36 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms01)
Oct 08 21:41:36 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms01)
Oct 08 21:41:36 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_omni (Started pplxnsms01)
Oct 08 21:41:36 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms01)
Oct 08 21:41:36 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms01)
Oct 08 21:41:36 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 08 21:41:36 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 08 21:41:36 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 08 21:41:36 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 08 21:41:36 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 08 21:41:36 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 08 21:41:36 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms02)
Oct 08 21:41:36 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__log_transition_summary) notice: Calculated transition 11, saving inputs in /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 08 21:41:36 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 08 21:41:36 pplxnsms02 pacemaker-controld [2418] (do_te_invoke) info: Processing graph 11 (ref=pe_calc-dc-1728394896-139) derived from /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 08 21:41:36 pplxnsms02 pacemaker-controld [2418] (pcmk__execute_graph) notice: Transition 11 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-1006.bz2): Complete
Oct 08 21:41:36 pplxnsms02 pacemaker-controld [2418] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 08 21:41:36 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 08 21:56:36 pplxnsms02 pacemaker-controld [2418] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 08 21:56:36 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 08 21:56:36 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 08 21:56:36 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 08 21:56:36 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) notice: On loss of quorum: Ignore
Oct 08 21:56:36 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 08 21:56:36 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms02 is online
Oct 08 21:56:36 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 08 21:56:36 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms01 is online
Oct 08 21:56:36 pplxnsms02 pacemaker-schedulerd[2417] (unpack_rsc_op_failure) warning: Unexpected result (error) was recorded for start of nco_itnm on pplxnsms02 at Oct 8 20:15:42 2024 | rc=1 id=nco_itnm_last_failure_0
Oct 08 21:56:36 pplxnsms02 pacemaker-schedulerd[2417] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Oct 8 20:12:15 2024
Oct 08 21:56:36 pplxnsms02 pacemaker-schedulerd[2417] (pe_get_failcount) info: nco_itnm has failed INFINITY times on pplxnsms02
Oct 08 21:56:36 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__threshold_reached) warning: nco_itnm cannot run on pplxnsms02 due to reaching migration threshold (clean up resource to allow again)| failures=1000000 migration-threshold=1000000
Oct 08 21:56:36 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 08 21:56:36 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 08 21:56:36 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_vip (Started pplxnsms01)
Oct 08 21:56:36 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms01)
Oct 08 21:56:36 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs (Started pplxnsms01)
Oct 08 21:56:36 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms01)
Oct 08 21:56:36 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms01)
Oct 08 21:56:36 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms01)
Oct 08 21:56:36 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_omni (Started pplxnsms01)
Oct 08 21:56:36 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms01)
Oct 08 21:56:36 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms01)
Oct 08 21:56:36 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 08 21:56:36 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 08 21:56:36 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 08 21:56:36 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 08 21:56:36 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 08 21:56:36 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 08 21:56:36 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms02)
Oct 08 21:56:36 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__log_transition_summary) notice: Calculated transition 12, saving inputs in /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 08 21:56:36 pplxnsms02 pacemaker-schedulerd[2417] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 08 21:56:36 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 08 21:56:36 pplxnsms02 pacemaker-controld [2418] (do_te_invoke) info: Processing graph 12 (ref=pe_calc-dc-1728395796-140) derived from /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 08 21:56:36 pplxnsms02 pacemaker-controld [2418] (pcmk__execute_graph) notice: Transition 12 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-1006.bz2): Complete
Oct 08 21:56:36 pplxnsms02 pacemaker-controld [2418] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 08 21:56:36 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 08 22:11:36 pplxnsms02 pacemaker-controld [2418] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 08 22:11:36 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 08 22:11:36 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 08 22:11:36 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 08 22:11:36 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) notice: On loss of quorum: Ignore
Oct 08 22:11:36 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 08 22:11:36 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms02 is online
Oct 08 22:11:36 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 08 22:11:36 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms01 is online
Oct 08 22:11:36 pplxnsms02 pacemaker-schedulerd[2417] (unpack_rsc_op_failure) warning: Unexpected result (error) was recorded for start of nco_itnm on pplxnsms02 at Oct 8 20:15:42 2024 | rc=1 id=nco_itnm_last_failure_0
Oct 08 22:11:36 pplxnsms02 pacemaker-schedulerd[2417] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Oct 8 20:12:15 2024
Oct 08 22:11:36 pplxnsms02 pacemaker-schedulerd[2417] (pe_get_failcount) info: nco_itnm has failed INFINITY times on pplxnsms02
Oct 08 22:11:36 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__threshold_reached) warning: nco_itnm cannot run on pplxnsms02 due to reaching migration threshold (clean up resource to allow again)| failures=1000000 migration-threshold=1000000
Oct 08 22:11:36 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 08 22:11:36 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 08 22:11:36 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_vip (Started pplxnsms01)
Oct 08 22:11:36 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms01)
Oct 08 22:11:36 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs (Started pplxnsms01)
Oct 08 22:11:36 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms01)
Oct 08 22:11:36 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms01)
Oct 08 22:11:36 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms01)
Oct 08 22:11:36 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_omni (Started pplxnsms01)
Oct 08 22:11:36 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms01)
Oct 08 22:11:36 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms01)
Oct 08 22:11:36 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 08 22:11:36 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 08 22:11:36 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 08 22:11:36 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 08 22:11:36 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 08 22:11:36 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 08 22:11:36 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms02)
Oct 08 22:11:36 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__log_transition_summary) notice: Calculated transition 13, saving inputs in /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 08 22:11:36 pplxnsms02 pacemaker-schedulerd[2417] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 08 22:11:36 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 08 22:11:36 pplxnsms02 pacemaker-controld [2418] (do_te_invoke) info: Processing graph 13 (ref=pe_calc-dc-1728396696-141) derived from /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 08 22:11:36 pplxnsms02 pacemaker-controld [2418] (pcmk__execute_graph) notice: Transition 13 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-1006.bz2): Complete
Oct 08 22:11:36 pplxnsms02 pacemaker-controld [2418] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 08 22:11:36 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 08 22:26:36 pplxnsms02 pacemaker-controld [2418] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 08 22:26:36 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 08 22:26:36 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 08 22:26:36 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 08 22:26:36 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) notice: On loss of quorum: Ignore
Oct 08 22:26:36 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 08 22:26:36 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms02 is online
Oct 08 22:26:36 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 08 22:26:36 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms01 is online
Oct 08 22:26:36 pplxnsms02 pacemaker-schedulerd[2417] (unpack_rsc_op_failure) warning: Unexpected result (error) was recorded for start of nco_itnm on pplxnsms02 at Oct 8 20:15:42 2024 | rc=1 id=nco_itnm_last_failure_0
Oct 08 22:26:36 pplxnsms02 pacemaker-schedulerd[2417] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Oct 8 20:12:15 2024
Oct 08 22:26:36 pplxnsms02 pacemaker-schedulerd[2417] (pe_get_failcount) info: nco_itnm has failed INFINITY times on pplxnsms02
Oct 08 22:26:36 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__threshold_reached) warning: nco_itnm cannot run on pplxnsms02 due to reaching migration threshold (clean up resource to allow again)| failures=1000000 migration-threshold=1000000
Oct 08 22:26:36 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 08 22:26:36 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 08 22:26:36 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_vip (Started pplxnsms01)
Oct 08 22:26:36 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms01)
Oct 08 22:26:36 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs (Started pplxnsms01)
Oct 08 22:26:36 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms01)
Oct 08 22:26:36 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms01)
Oct 08 22:26:36 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms01)
Oct 08 22:26:36 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_omni (Started pplxnsms01)
Oct 08 22:26:36 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms01)
Oct 08 22:26:36 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms01)
Oct 08 22:26:36 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 08 22:26:36 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 08 22:26:36 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 08 22:26:36 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 08 22:26:36 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 08 22:26:36 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 08 22:26:36 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms02)
Oct 08 22:26:36 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__log_transition_summary) notice: Calculated transition 14, saving inputs in /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 08 22:26:36 pplxnsms02 pacemaker-schedulerd[2417] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 08 22:26:36 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 08 22:26:36 pplxnsms02 pacemaker-controld [2418] (do_te_invoke) info: Processing graph 14 (ref=pe_calc-dc-1728397596-142) derived from /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 08 22:26:36 pplxnsms02 pacemaker-controld [2418] (pcmk__execute_graph) notice: Transition 14 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-1006.bz2): Complete
Oct 08 22:26:36 pplxnsms02 pacemaker-controld [2418] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 08 22:26:36 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 08 22:41:36 pplxnsms02 pacemaker-controld [2418] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 08 22:41:36 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 08 22:41:36 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 08 22:41:36 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 08 22:41:36 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) notice: On loss of quorum: Ignore
Oct 08 22:41:36 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 08 22:41:36 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms02 is online
Oct 08 22:41:36 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 08 22:41:36 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms01 is online
Oct 08 22:41:36 pplxnsms02 pacemaker-schedulerd[2417] (unpack_rsc_op_failure) warning: Unexpected result (error) was recorded for start of nco_itnm on pplxnsms02 at Oct 8 20:15:42 2024 | rc=1 id=nco_itnm_last_failure_0
Oct 08 22:41:36 pplxnsms02 pacemaker-schedulerd[2417] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Oct 8 20:12:15 2024
Oct 08 22:41:36 pplxnsms02 pacemaker-schedulerd[2417] (pe_get_failcount) info: nco_itnm has failed INFINITY times on pplxnsms02
Oct 08 22:41:36 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__threshold_reached) warning: nco_itnm cannot run on pplxnsms02 due to reaching migration threshold (clean up resource to allow again)| failures=1000000 migration-threshold=1000000
Oct 08 22:41:36 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 08 22:41:36 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 08 22:41:36 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_vip (Started pplxnsms01)
Oct 08 22:41:36 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms01)
Oct 08 22:41:36 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs (Started pplxnsms01)
Oct 08 22:41:36 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms01)
Oct 08 22:41:36 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms01)
Oct 08 22:41:36 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms01)
Oct 08 22:41:36 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_omni (Started pplxnsms01)
Oct 08 22:41:36 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms01)
Oct 08 22:41:36 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms01)
Oct 08 22:41:36 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 08 22:41:36 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 08 22:41:36 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 08 22:41:36 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 08 22:41:36 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 08 22:41:36 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 08 22:41:36 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms02)
Oct 08 22:41:36 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__log_transition_summary) notice: Calculated transition 15, saving inputs in /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 08 22:41:36 pplxnsms02 pacemaker-schedulerd[2417] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 08 22:41:36 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 08 22:41:36 pplxnsms02 pacemaker-controld [2418] (do_te_invoke) info: Processing graph 15 (ref=pe_calc-dc-1728398496-143) derived from /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 08 22:41:36 pplxnsms02 pacemaker-controld [2418] (pcmk__execute_graph) notice: Transition 15 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-1006.bz2): Complete
Oct 08 22:41:36 pplxnsms02 pacemaker-controld [2418] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 08 22:41:36 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 08 22:56:36 pplxnsms02 pacemaker-controld [2418] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 08 22:56:36 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 08 22:56:36 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 08 22:56:36 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 08 22:56:36 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) notice: On loss of quorum: Ignore
Oct 08 22:56:36 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 08 22:56:36 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms02 is online
Oct 08 22:56:36 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 08 22:56:36 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms01 is online
Oct 08 22:56:36 pplxnsms02 pacemaker-schedulerd[2417] (unpack_rsc_op_failure) warning: Unexpected result (error) was recorded for start of nco_itnm on pplxnsms02 at Oct 8 20:15:42 2024 | rc=1 id=nco_itnm_last_failure_0
Oct 08 22:56:36 pplxnsms02 pacemaker-schedulerd[2417] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Oct 8 20:12:15 2024
Oct 08 22:56:36 pplxnsms02 pacemaker-schedulerd[2417] (pe_get_failcount) info: nco_itnm has failed INFINITY times on pplxnsms02
Oct 08 22:56:36 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__threshold_reached) warning: nco_itnm cannot run on pplxnsms02 due to reaching migration threshold (clean up resource to allow again)| failures=1000000 migration-threshold=1000000
Oct 08 22:56:36 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 08 22:56:36 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 08 22:56:36 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_vip (Started pplxnsms01)
Oct 08 22:56:36 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms01)
Oct 08 22:56:36 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs (Started pplxnsms01)
Oct 08 22:56:36 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms01)
Oct 08 22:56:36 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms01)
Oct 08 22:56:36 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms01)
Oct 08 22:56:36 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_omni (Started pplxnsms01)
Oct 08 22:56:36 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms01)
Oct 08 22:56:36 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms01)
Oct 08 22:56:36 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 08 22:56:36 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 08 22:56:36 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 08 22:56:36 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 08 22:56:36 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 08 22:56:36 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 08 22:56:36 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms02)
Oct 08 22:56:36 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__log_transition_summary) notice: Calculated transition 16, saving inputs in /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 08 22:56:36 pplxnsms02 pacemaker-schedulerd[2417] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 08 22:56:36 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 08 22:56:36 pplxnsms02 pacemaker-controld [2418] (do_te_invoke) info: Processing graph 16 (ref=pe_calc-dc-1728399396-144) derived from /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 08 22:56:36 pplxnsms02 pacemaker-controld [2418] (pcmk__execute_graph) notice: Transition 16 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-1006.bz2): Complete
Oct 08 22:56:36 pplxnsms02 pacemaker-controld [2418] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 08 22:56:36 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 08 23:11:36 pplxnsms02 pacemaker-controld [2418] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 08 23:11:36 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 08 23:11:36 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 08 23:11:36 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 08 23:11:36 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) notice: On loss of quorum: Ignore
Oct 08 23:11:36 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 08 23:11:36 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms02 is online
Oct 08 23:11:36 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 08 23:11:36 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms01 is online
Oct 08 23:11:36 pplxnsms02 pacemaker-schedulerd[2417] (unpack_rsc_op_failure) warning: Unexpected result (error) was recorded for start of nco_itnm on pplxnsms02 at Oct 8 20:15:42 2024 | rc=1 id=nco_itnm_last_failure_0
Oct 08 23:11:36 pplxnsms02 pacemaker-schedulerd[2417] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Oct 8 20:12:15 2024
Oct 08 23:11:36 pplxnsms02 pacemaker-schedulerd[2417] (pe_get_failcount) info: nco_itnm has failed INFINITY times on pplxnsms02
Oct 08 23:11:36 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__threshold_reached) warning: nco_itnm cannot run on pplxnsms02 due to reaching migration threshold (clean up resource to allow again)| failures=1000000 migration-threshold=1000000
Oct 08 23:11:36 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 08 23:11:36 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 08 23:11:36 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_vip (Started pplxnsms01)
Oct 08 23:11:36 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms01)
Oct 08 23:11:36 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs (Started pplxnsms01)
Oct 08 23:11:36 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms01)
Oct 08 23:11:36 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms01)
Oct 08 23:11:36 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms01)
Oct 08 23:11:36 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_omni (Started pplxnsms01)
Oct 08 23:11:36 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms01)
Oct 08 23:11:36 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms01)
Oct 08 23:11:36 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 08 23:11:36 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 08 23:11:36 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 08 23:11:36 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 08 23:11:36 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 08 23:11:36 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 08 23:11:36 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms02)
Oct 08 23:11:36 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__log_transition_summary) notice: Calculated transition 17, saving inputs in /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 08 23:11:36 pplxnsms02 pacemaker-schedulerd[2417] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 08 23:11:36 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 08 23:11:36 pplxnsms02 pacemaker-controld [2418] (do_te_invoke) info: Processing graph 17 (ref=pe_calc-dc-1728400296-145) derived from /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 08 23:11:36 pplxnsms02 pacemaker-controld [2418] (pcmk__execute_graph) notice: Transition 17 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-1006.bz2): Complete
Oct 08 23:11:36 pplxnsms02 pacemaker-controld [2418] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 08 23:11:36 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 08 23:26:36 pplxnsms02 pacemaker-controld [2418] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 08 23:26:36 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 08 23:26:36 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 08 23:26:36 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 08 23:26:36 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) notice: On loss of quorum: Ignore
Oct 08 23:26:36 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 08 23:26:36 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms02 is online
Oct 08 23:26:36 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 08 23:26:36 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms01 is online
Oct 08 23:26:36 pplxnsms02 pacemaker-schedulerd[2417] (unpack_rsc_op_failure) warning: Unexpected result (error) was recorded for start of nco_itnm on pplxnsms02 at Oct 8 20:15:42 2024 | rc=1 id=nco_itnm_last_failure_0
Oct 08 23:26:36 pplxnsms02 pacemaker-schedulerd[2417] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Oct 8 20:12:15 2024
Oct 08 23:26:36 pplxnsms02 pacemaker-schedulerd[2417] (pe_get_failcount) info: nco_itnm has failed INFINITY times on pplxnsms02
Oct 08 23:26:36 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__threshold_reached) warning: nco_itnm cannot run on pplxnsms02 due to reaching migration threshold (clean up resource to allow again)| failures=1000000 migration-threshold=1000000
Oct 08 23:26:36 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 08 23:26:36 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 08 23:26:36 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_vip (Started pplxnsms01)
Oct 08 23:26:36 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms01)
Oct 08 23:26:36 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs (Started pplxnsms01)
Oct 08 23:26:36 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms01)
Oct 08 23:26:36 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms01)
Oct 08 23:26:36 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms01)
Oct 08 23:26:36 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_omni (Started pplxnsms01)
Oct 08 23:26:36 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms01)
Oct 08 23:26:36 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms01)
Oct 08 23:26:36 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 08 23:26:36 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 08 23:26:36 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 08 23:26:36 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 08 23:26:36 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 08 23:26:36 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 08 23:26:36 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms02)
Oct 08 23:26:36 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__log_transition_summary) notice: Calculated transition 18, saving inputs in /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 08 23:26:36 pplxnsms02 pacemaker-schedulerd[2417] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 08 23:26:36 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 08 23:26:36 pplxnsms02 pacemaker-controld [2418] (do_te_invoke) info: Processing graph 18 (ref=pe_calc-dc-1728401196-146) derived from /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 08 23:26:36 pplxnsms02 pacemaker-controld [2418] (pcmk__execute_graph) notice: Transition 18 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-1006.bz2): Complete
Oct 08 23:26:36 pplxnsms02 pacemaker-controld [2418] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 08 23:26:36 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 08 23:41:36 pplxnsms02 pacemaker-controld [2418] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 08 23:41:36 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 08 23:41:36 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 08 23:41:36 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 08 23:41:36 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) notice: On loss of quorum: Ignore
Oct 08 23:41:36 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 08 23:41:36 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms02 is online
Oct 08 23:41:36 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 08 23:41:36 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms01 is online
Oct 08 23:41:36 pplxnsms02 pacemaker-schedulerd[2417] (unpack_rsc_op_failure) warning: Unexpected result (error) was recorded for start of nco_itnm on pplxnsms02 at Oct 8 20:15:42 2024 | rc=1 id=nco_itnm_last_failure_0
Oct 08 23:41:36 pplxnsms02 pacemaker-schedulerd[2417] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Oct 8 20:12:15 2024
Oct 08 23:41:36 pplxnsms02 pacemaker-schedulerd[2417] (pe_get_failcount) info: nco_itnm has failed INFINITY times on pplxnsms02
Oct 08 23:41:36 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__threshold_reached) warning: nco_itnm cannot run on pplxnsms02 due to reaching migration threshold (clean up resource to allow again)| failures=1000000 migration-threshold=1000000
Oct 08 23:41:36 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 08 23:41:36 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 08 23:41:36 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_vip (Started pplxnsms01)
Oct 08 23:41:36 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms01)
Oct 08 23:41:36 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs (Started pplxnsms01)
Oct 08 23:41:36 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms01)
Oct 08 23:41:36 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms01)
Oct 08 23:41:36 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms01)
Oct 08 23:41:36 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_omni (Started pplxnsms01)
Oct 08 23:41:36 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms01)
Oct 08 23:41:36 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms01)
Oct 08 23:41:36 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 08 23:41:36 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 08 23:41:36 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 08 23:41:36 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 08 23:41:36 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 08 23:41:36 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 08 23:41:36 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms02)
Oct 08 23:41:36 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__log_transition_summary) notice: Calculated transition 19, saving inputs in /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 08 23:41:36 pplxnsms02 pacemaker-schedulerd[2417] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 08 23:41:36 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 08 23:41:36 pplxnsms02 pacemaker-controld [2418] (do_te_invoke) info: Processing graph 19 (ref=pe_calc-dc-1728402096-147) derived from /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 08 23:41:36 pplxnsms02 pacemaker-controld [2418] (pcmk__execute_graph) notice: Transition 19 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-1006.bz2): Complete
Oct 08 23:41:36 pplxnsms02 pacemaker-controld [2418] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 08 23:41:36 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 08 23:56:36 pplxnsms02 pacemaker-controld [2418] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 08 23:56:36 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 08 23:56:36 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 08 23:56:36 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 08 23:56:36 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) notice: On loss of quorum: Ignore
Oct 08 23:56:36 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 08 23:56:36 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms02 is online
Oct 08 23:56:36 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 08 23:56:36 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms01 is online
Oct 08 23:56:36 pplxnsms02 pacemaker-schedulerd[2417] (unpack_rsc_op_failure) warning: Unexpected result (error) was recorded for start of nco_itnm on pplxnsms02 at Oct 8 20:15:42 2024 | rc=1 id=nco_itnm_last_failure_0
Oct 08 23:56:36 pplxnsms02 pacemaker-schedulerd[2417] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Oct 8 20:12:15 2024
Oct 08 23:56:36 pplxnsms02 pacemaker-schedulerd[2417] (pe_get_failcount) info: nco_itnm has failed INFINITY times on pplxnsms02
Oct 08 23:56:36 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__threshold_reached) warning: nco_itnm cannot run on pplxnsms02 due to reaching migration threshold (clean up resource to allow again)| failures=1000000 migration-threshold=1000000
Oct 08 23:56:36 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 08 23:56:36 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 08 23:56:36 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_vip (Started pplxnsms01)
Oct 08 23:56:36 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms01)
Oct 08 23:56:36 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs (Started pplxnsms01)
Oct 08 23:56:36 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms01)
Oct 08 23:56:36 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms01)
Oct 08 23:56:36 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms01)
Oct 08 23:56:36 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_omni (Started pplxnsms01)
Oct 08 23:56:36 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms01)
Oct 08 23:56:36 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms01)
Oct 08 23:56:36 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 08 23:56:36 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 08 23:56:36 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 08 23:56:36 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 08 23:56:36 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 08 23:56:36 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 08 23:56:36 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms02)
Oct 08 23:56:36 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__log_transition_summary) notice: Calculated transition 20, saving inputs in /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 08 23:56:36 pplxnsms02 pacemaker-schedulerd[2417] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 08 23:56:36 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 08 23:56:36 pplxnsms02 pacemaker-controld [2418] (do_te_invoke) info: Processing graph 20 (ref=pe_calc-dc-1728402996-148) derived from /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 08 23:56:36 pplxnsms02 pacemaker-controld [2418] (pcmk__execute_graph) notice: Transition 20 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-1006.bz2): Complete
Oct 08 23:56:36 pplxnsms02 pacemaker-controld [2418] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 08 23:56:36 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 09 00:11:36 pplxnsms02 pacemaker-controld [2418] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 09 00:11:36 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 09 00:11:36 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 09 00:11:36 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 09 00:11:36 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) notice: On loss of quorum: Ignore
Oct 09 00:11:36 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 09 00:11:36 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms02 is online
Oct 09 00:11:36 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 09 00:11:36 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms01 is online
Oct 09 00:11:36 pplxnsms02 pacemaker-schedulerd[2417] (unpack_rsc_op_failure) warning: Unexpected result (error) was recorded for start of nco_itnm on pplxnsms02 at Oct 8 20:15:42 2024 | rc=1 id=nco_itnm_last_failure_0
Oct 09 00:11:36 pplxnsms02 pacemaker-schedulerd[2417] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Oct 8 20:12:15 2024
Oct 09 00:11:36 pplxnsms02 pacemaker-schedulerd[2417] (pe_get_failcount) info: nco_itnm has failed INFINITY times on pplxnsms02
Oct 09 00:11:36 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__threshold_reached) warning: nco_itnm cannot run on pplxnsms02 due to reaching migration threshold (clean up resource to allow again)| failures=1000000 migration-threshold=1000000
Oct 09 00:11:36 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 09 00:11:36 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 09 00:11:36 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_vip (Started pplxnsms01)
Oct 09 00:11:36 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms01)
Oct 09 00:11:36 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs (Started pplxnsms01)
Oct 09 00:11:36 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms01)
Oct 09 00:11:36 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms01)
Oct 09 00:11:36 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms01)
Oct 09 00:11:36 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_omni (Started pplxnsms01)
Oct 09 00:11:36 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms01)
Oct 09 00:11:36 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms01)
Oct 09 00:11:36 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 09 00:11:36 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 09 00:11:36 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 09 00:11:36 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 09 00:11:36 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 09 00:11:36 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 09 00:11:36 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms02)
Oct 09 00:11:36 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__log_transition_summary) notice: Calculated transition 21, saving inputs in /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 00:11:36 pplxnsms02 pacemaker-schedulerd[2417] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 09 00:11:36 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 09 00:11:36 pplxnsms02 pacemaker-controld [2418] (do_te_invoke) info: Processing graph 21 (ref=pe_calc-dc-1728403896-149) derived from /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 00:11:36 pplxnsms02 pacemaker-controld [2418] (pcmk__execute_graph) notice: Transition 21 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-1006.bz2): Complete
Oct 09 00:11:36 pplxnsms02 pacemaker-controld [2418] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 09 00:11:36 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 09 00:26:36 pplxnsms02 pacemaker-controld [2418] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 09 00:26:36 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 09 00:26:36 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 09 00:26:37 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 09 00:26:37 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) notice: On loss of quorum: Ignore
Oct 09 00:26:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 09 00:26:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms02 is online
Oct 09 00:26:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 09 00:26:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms01 is online
Oct 09 00:26:37 pplxnsms02 pacemaker-schedulerd[2417] (unpack_rsc_op_failure) warning: Unexpected result (error) was recorded for start of nco_itnm on pplxnsms02 at Oct 8 20:15:42 2024 | rc=1 id=nco_itnm_last_failure_0
Oct 09 00:26:37 pplxnsms02 pacemaker-schedulerd[2417] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Oct 8 20:12:15 2024
Oct 09 00:26:37 pplxnsms02 pacemaker-schedulerd[2417] (pe_get_failcount) info: nco_itnm has failed INFINITY times on pplxnsms02
Oct 09 00:26:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__threshold_reached) warning: nco_itnm cannot run on pplxnsms02 due to reaching migration threshold (clean up resource to allow again)| failures=1000000 migration-threshold=1000000
Oct 09 00:26:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 09 00:26:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 09 00:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_vip (Started pplxnsms01)
Oct 09 00:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms01)
Oct 09 00:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs (Started pplxnsms01)
Oct 09 00:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms01)
Oct 09 00:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms01)
Oct 09 00:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms01)
Oct 09 00:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_omni (Started pplxnsms01)
Oct 09 00:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms01)
Oct 09 00:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms01)
Oct 09 00:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 09 00:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 09 00:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 09 00:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 09 00:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 09 00:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 09 00:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms02)
Oct 09 00:26:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__log_transition_summary) notice: Calculated transition 22, saving inputs in /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 00:26:37 pplxnsms02 pacemaker-schedulerd[2417] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 09 00:26:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 09 00:26:37 pplxnsms02 pacemaker-controld [2418] (do_te_invoke) info: Processing graph 22 (ref=pe_calc-dc-1728404796-150) derived from /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 00:26:37 pplxnsms02 pacemaker-controld [2418] (pcmk__execute_graph) notice: Transition 22 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-1006.bz2): Complete
Oct 09 00:26:37 pplxnsms02 pacemaker-controld [2418] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 09 00:26:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 09 00:41:37 pplxnsms02 pacemaker-controld [2418] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 09 00:41:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 09 00:41:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 09 00:41:37 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 09 00:41:37 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) notice: On loss of quorum: Ignore
Oct 09 00:41:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 09 00:41:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms02 is online
Oct 09 00:41:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 09 00:41:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms01 is online
Oct 09 00:41:37 pplxnsms02 pacemaker-schedulerd[2417] (unpack_rsc_op_failure) warning: Unexpected result (error) was recorded for start of nco_itnm on pplxnsms02 at Oct 8 20:15:42 2024 | rc=1 id=nco_itnm_last_failure_0
Oct 09 00:41:37 pplxnsms02 pacemaker-schedulerd[2417] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Oct 8 20:12:15 2024
Oct 09 00:41:37 pplxnsms02 pacemaker-schedulerd[2417] (pe_get_failcount) info: nco_itnm has failed INFINITY times on pplxnsms02
Oct 09 00:41:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__threshold_reached) warning: nco_itnm cannot run on pplxnsms02 due to reaching migration threshold (clean up resource to allow again)| failures=1000000 migration-threshold=1000000
Oct 09 00:41:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 09 00:41:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 09 00:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_vip (Started pplxnsms01)
Oct 09 00:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms01)
Oct 09 00:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs (Started pplxnsms01)
Oct 09 00:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms01)
Oct 09 00:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms01)
Oct 09 00:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms01)
Oct 09 00:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_omni (Started pplxnsms01)
Oct 09 00:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms01)
Oct 09 00:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms01)
Oct 09 00:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 09 00:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 09 00:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 09 00:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 09 00:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 09 00:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 09 00:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms02)
Oct 09 00:41:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__log_transition_summary) notice: Calculated transition 23, saving inputs in /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 00:41:37 pplxnsms02 pacemaker-schedulerd[2417] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 09 00:41:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 09 00:41:37 pplxnsms02 pacemaker-controld [2418] (do_te_invoke) info: Processing graph 23 (ref=pe_calc-dc-1728405697-151) derived from /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 00:41:37 pplxnsms02 pacemaker-controld [2418] (pcmk__execute_graph) notice: Transition 23 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-1006.bz2): Complete
Oct 09 00:41:37 pplxnsms02 pacemaker-controld [2418] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 09 00:41:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 09 00:56:37 pplxnsms02 pacemaker-controld [2418] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 09 00:56:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 09 00:56:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 09 00:56:37 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 09 00:56:37 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) notice: On loss of quorum: Ignore
Oct 09 00:56:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 09 00:56:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms02 is online
Oct 09 00:56:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 09 00:56:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms01 is online
Oct 09 00:56:37 pplxnsms02 pacemaker-schedulerd[2417] (unpack_rsc_op_failure) warning: Unexpected result (error) was recorded for start of nco_itnm on pplxnsms02 at Oct 8 20:15:42 2024 | rc=1 id=nco_itnm_last_failure_0
Oct 09 00:56:37 pplxnsms02 pacemaker-schedulerd[2417] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Oct 8 20:12:15 2024
Oct 09 00:56:37 pplxnsms02 pacemaker-schedulerd[2417] (pe_get_failcount) info: nco_itnm has failed INFINITY times on pplxnsms02
Oct 09 00:56:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__threshold_reached) warning: nco_itnm cannot run on pplxnsms02 due to reaching migration threshold (clean up resource to allow again)| failures=1000000 migration-threshold=1000000
Oct 09 00:56:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 09 00:56:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 09 00:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_vip (Started pplxnsms01)
Oct 09 00:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms01)
Oct 09 00:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs (Started pplxnsms01)
Oct 09 00:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms01)
Oct 09 00:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms01)
Oct 09 00:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms01)
Oct 09 00:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_omni (Started pplxnsms01)
Oct 09 00:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms01)
Oct 09 00:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms01)
Oct 09 00:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 09 00:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 09 00:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 09 00:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 09 00:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 09 00:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 09 00:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms02)
Oct 09 00:56:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__log_transition_summary) notice: Calculated transition 24, saving inputs in /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 00:56:37 pplxnsms02 pacemaker-schedulerd[2417] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 09 00:56:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 09 00:56:37 pplxnsms02 pacemaker-controld [2418] (do_te_invoke) info: Processing graph 24 (ref=pe_calc-dc-1728406597-152) derived from /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 00:56:37 pplxnsms02 pacemaker-controld [2418] (pcmk__execute_graph) notice: Transition 24 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-1006.bz2): Complete
Oct 09 00:56:37 pplxnsms02 pacemaker-controld [2418] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 09 00:56:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 09 01:11:37 pplxnsms02 pacemaker-controld [2418] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 09 01:11:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 09 01:11:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 09 01:11:37 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 09 01:11:37 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) notice: On loss of quorum: Ignore
Oct 09 01:11:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 09 01:11:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms02 is online
Oct 09 01:11:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 09 01:11:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms01 is online
Oct 09 01:11:37 pplxnsms02 pacemaker-schedulerd[2417] (unpack_rsc_op_failure) warning: Unexpected result (error) was recorded for start of nco_itnm on pplxnsms02 at Oct 8 20:15:42 2024 | rc=1 id=nco_itnm_last_failure_0
Oct 09 01:11:37 pplxnsms02 pacemaker-schedulerd[2417] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Oct 8 20:12:15 2024
Oct 09 01:11:37 pplxnsms02 pacemaker-schedulerd[2417] (pe_get_failcount) info: nco_itnm has failed INFINITY times on pplxnsms02
Oct 09 01:11:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__threshold_reached) warning: nco_itnm cannot run on pplxnsms02 due to reaching migration threshold (clean up resource to allow again)| failures=1000000 migration-threshold=1000000
Oct 09 01:11:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 09 01:11:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 09 01:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_vip (Started pplxnsms01)
Oct 09 01:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms01)
Oct 09 01:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs (Started pplxnsms01)
Oct 09 01:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms01)
Oct 09 01:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms01)
Oct 09 01:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms01)
Oct 09 01:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_omni (Started pplxnsms01)
Oct 09 01:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms01)
Oct 09 01:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms01)
Oct 09 01:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 09 01:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 09 01:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 09 01:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 09 01:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 09 01:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 09 01:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms02)
Oct 09 01:11:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__log_transition_summary) notice: Calculated transition 25, saving inputs in /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 01:11:37 pplxnsms02 pacemaker-schedulerd[2417] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 09 01:11:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 09 01:11:37 pplxnsms02 pacemaker-controld [2418] (do_te_invoke) info: Processing graph 25 (ref=pe_calc-dc-1728407497-153) derived from /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 01:11:37 pplxnsms02 pacemaker-controld [2418] (pcmk__execute_graph) notice: Transition 25 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-1006.bz2): Complete
Oct 09 01:11:37 pplxnsms02 pacemaker-controld [2418] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 09 01:11:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 09 01:26:37 pplxnsms02 pacemaker-controld [2418] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 09 01:26:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 09 01:26:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 09 01:26:37 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 09 01:26:37 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) notice: On loss of quorum: Ignore
Oct 09 01:26:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 09 01:26:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms02 is online
Oct 09 01:26:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 09 01:26:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms01 is online
Oct 09 01:26:37 pplxnsms02 pacemaker-schedulerd[2417] (unpack_rsc_op_failure) warning: Unexpected result (error) was recorded for start of nco_itnm on pplxnsms02 at Oct 8 20:15:42 2024 | rc=1 id=nco_itnm_last_failure_0
Oct 09 01:26:37 pplxnsms02 pacemaker-schedulerd[2417] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Oct 8 20:12:15 2024
Oct 09 01:26:37 pplxnsms02 pacemaker-schedulerd[2417] (pe_get_failcount) info: nco_itnm has failed INFINITY times on pplxnsms02
Oct 09 01:26:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__threshold_reached) warning: nco_itnm cannot run on pplxnsms02 due to reaching migration threshold (clean up resource to allow again)| failures=1000000 migration-threshold=1000000
Oct 09 01:26:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 09 01:26:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 09 01:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_vip (Started pplxnsms01)
Oct 09 01:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms01)
Oct 09 01:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs (Started pplxnsms01)
Oct 09 01:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms01)
Oct 09 01:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms01)
Oct 09 01:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms01)
Oct 09 01:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_omni (Started pplxnsms01)
Oct 09 01:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms01)
Oct 09 01:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms01)
Oct 09 01:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 09 01:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 09 01:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 09 01:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 09 01:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 09 01:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 09 01:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms02)
Oct 09 01:26:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__log_transition_summary) notice: Calculated transition 26, saving inputs in /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 01:26:37 pplxnsms02 pacemaker-schedulerd[2417] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 09 01:26:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 09 01:26:37 pplxnsms02 pacemaker-controld [2418] (do_te_invoke) info: Processing graph 26 (ref=pe_calc-dc-1728408397-154) derived from /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 01:26:37 pplxnsms02 pacemaker-controld [2418] (pcmk__execute_graph) notice: Transition 26 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-1006.bz2): Complete
Oct 09 01:26:37 pplxnsms02 pacemaker-controld [2418] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 09 01:26:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 09 01:41:37 pplxnsms02 pacemaker-controld [2418] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 09 01:41:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 09 01:41:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 09 01:41:37 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 09 01:41:37 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) notice: On loss of quorum: Ignore
Oct 09 01:41:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 09 01:41:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms02 is online
Oct 09 01:41:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 09 01:41:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms01 is online
Oct 09 01:41:37 pplxnsms02 pacemaker-schedulerd[2417] (unpack_rsc_op_failure) warning: Unexpected result (error) was recorded for start of nco_itnm on pplxnsms02 at Oct 8 20:15:42 2024 | rc=1 id=nco_itnm_last_failure_0
Oct 09 01:41:37 pplxnsms02 pacemaker-schedulerd[2417] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Oct 8 20:12:15 2024
Oct 09 01:41:37 pplxnsms02 pacemaker-schedulerd[2417] (pe_get_failcount) info: nco_itnm has failed INFINITY times on pplxnsms02
Oct 09 01:41:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__threshold_reached) warning: nco_itnm cannot run on pplxnsms02 due to reaching migration threshold (clean up resource to allow again)| failures=1000000 migration-threshold=1000000
Oct 09 01:41:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 09 01:41:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 09 01:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_vip (Started pplxnsms01)
Oct 09 01:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms01)
Oct 09 01:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs (Started pplxnsms01)
Oct 09 01:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms01)
Oct 09 01:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms01)
Oct 09 01:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms01)
Oct 09 01:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_omni (Started pplxnsms01)
Oct 09 01:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms01)
Oct 09 01:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms01)
Oct 09 01:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 09 01:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 09 01:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 09 01:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 09 01:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 09 01:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 09 01:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms02)
Oct 09 01:41:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__log_transition_summary) notice: Calculated transition 27, saving inputs in /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 01:41:37 pplxnsms02 pacemaker-schedulerd[2417] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 09 01:41:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 09 01:41:37 pplxnsms02 pacemaker-controld [2418] (do_te_invoke) info: Processing graph 27 (ref=pe_calc-dc-1728409297-155) derived from /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 01:41:37 pplxnsms02 pacemaker-controld [2418] (pcmk__execute_graph) notice: Transition 27 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-1006.bz2): Complete
Oct 09 01:41:37 pplxnsms02 pacemaker-controld [2418] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 09 01:41:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 09 01:56:37 pplxnsms02 pacemaker-controld [2418] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 09 01:56:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 09 01:56:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 09 01:56:37 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 09 01:56:37 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) notice: On loss of quorum: Ignore
Oct 09 01:56:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 09 01:56:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms02 is online
Oct 09 01:56:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 09 01:56:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms01 is online
Oct 09 01:56:37 pplxnsms02 pacemaker-schedulerd[2417] (unpack_rsc_op_failure) warning: Unexpected result (error) was recorded for start of nco_itnm on pplxnsms02 at Oct 8 20:15:42 2024 | rc=1 id=nco_itnm_last_failure_0
Oct 09 01:56:37 pplxnsms02 pacemaker-schedulerd[2417] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Oct 8 20:12:15 2024
Oct 09 01:56:37 pplxnsms02 pacemaker-schedulerd[2417] (pe_get_failcount) info: nco_itnm has failed INFINITY times on pplxnsms02
Oct 09 01:56:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__threshold_reached) warning: nco_itnm cannot run on pplxnsms02 due to reaching migration threshold (clean up resource to allow again)| failures=1000000 migration-threshold=1000000
Oct 09 01:56:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 09 01:56:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 09 01:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_vip (Started pplxnsms01)
Oct 09 01:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms01)
Oct 09 01:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs (Started pplxnsms01)
Oct 09 01:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms01)
Oct 09 01:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms01)
Oct 09 01:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms01)
Oct 09 01:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_omni (Started pplxnsms01)
Oct 09 01:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms01)
Oct 09 01:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms01)
Oct 09 01:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 09 01:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 09 01:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 09 01:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 09 01:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 09 01:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 09 01:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms02)
Oct 09 01:56:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__log_transition_summary) notice: Calculated transition 28, saving inputs in /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 01:56:37 pplxnsms02 pacemaker-schedulerd[2417] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 09 01:56:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 09 01:56:37 pplxnsms02 pacemaker-controld [2418] (do_te_invoke) info: Processing graph 28 (ref=pe_calc-dc-1728410197-156) derived from /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 01:56:37 pplxnsms02 pacemaker-controld [2418] (pcmk__execute_graph) notice: Transition 28 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-1006.bz2): Complete
Oct 09 01:56:37 pplxnsms02 pacemaker-controld [2418] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 09 01:56:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 09 02:11:37 pplxnsms02 pacemaker-controld [2418] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 09 02:11:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 09 02:11:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 09 02:11:37 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 09 02:11:37 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) notice: On loss of quorum: Ignore
Oct 09 02:11:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 09 02:11:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms02 is online
Oct 09 02:11:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 09 02:11:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms01 is online
Oct 09 02:11:37 pplxnsms02 pacemaker-schedulerd[2417] (unpack_rsc_op_failure) warning: Unexpected result (error) was recorded for start of nco_itnm on pplxnsms02 at Oct 8 20:15:42 2024 | rc=1 id=nco_itnm_last_failure_0
Oct 09 02:11:37 pplxnsms02 pacemaker-schedulerd[2417] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Oct 8 20:12:15 2024
Oct 09 02:11:37 pplxnsms02 pacemaker-schedulerd[2417] (pe_get_failcount) info: nco_itnm has failed INFINITY times on pplxnsms02
Oct 09 02:11:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__threshold_reached) warning: nco_itnm cannot run on pplxnsms02 due to reaching migration threshold (clean up resource to allow again)| failures=1000000 migration-threshold=1000000
Oct 09 02:11:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 09 02:11:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 09 02:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_vip (Started pplxnsms01)
Oct 09 02:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms01)
Oct 09 02:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs (Started pplxnsms01)
Oct 09 02:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms01)
Oct 09 02:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms01)
Oct 09 02:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms01)
Oct 09 02:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_omni (Started pplxnsms01)
Oct 09 02:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms01)
Oct 09 02:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms01)
Oct 09 02:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 09 02:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 09 02:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 09 02:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 09 02:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 09 02:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 09 02:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms02)
Oct 09 02:11:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__log_transition_summary) notice: Calculated transition 29, saving inputs in /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 02:11:37 pplxnsms02 pacemaker-schedulerd[2417] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 09 02:11:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 09 02:11:37 pplxnsms02 pacemaker-controld [2418] (do_te_invoke) info: Processing graph 29 (ref=pe_calc-dc-1728411097-157) derived from /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 02:11:37 pplxnsms02 pacemaker-controld [2418] (pcmk__execute_graph) notice: Transition 29 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-1006.bz2): Complete
Oct 09 02:11:37 pplxnsms02 pacemaker-controld [2418] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 09 02:11:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 09 02:26:37 pplxnsms02 pacemaker-controld [2418] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 09 02:26:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 09 02:26:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 09 02:26:37 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 09 02:26:37 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) notice: On loss of quorum: Ignore
Oct 09 02:26:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 09 02:26:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms02 is online
Oct 09 02:26:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 09 02:26:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms01 is online
Oct 09 02:26:37 pplxnsms02 pacemaker-schedulerd[2417] (unpack_rsc_op_failure) warning: Unexpected result (error) was recorded for start of nco_itnm on pplxnsms02 at Oct 8 20:15:42 2024 | rc=1 id=nco_itnm_last_failure_0
Oct 09 02:26:37 pplxnsms02 pacemaker-schedulerd[2417] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Oct 8 20:12:15 2024
Oct 09 02:26:37 pplxnsms02 pacemaker-schedulerd[2417] (pe_get_failcount) info: nco_itnm has failed INFINITY times on pplxnsms02
Oct 09 02:26:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__threshold_reached) warning: nco_itnm cannot run on pplxnsms02 due to reaching migration threshold (clean up resource to allow again)| failures=1000000 migration-threshold=1000000
Oct 09 02:26:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 09 02:26:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 09 02:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_vip (Started pplxnsms01)
Oct 09 02:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms01)
Oct 09 02:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs (Started pplxnsms01)
Oct 09 02:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms01)
Oct 09 02:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms01)
Oct 09 02:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms01)
Oct 09 02:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_omni (Started pplxnsms01)
Oct 09 02:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms01)
Oct 09 02:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms01)
Oct 09 02:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 09 02:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 09 02:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 09 02:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 09 02:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 09 02:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 09 02:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms02)
Oct 09 02:26:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__log_transition_summary) notice: Calculated transition 30, saving inputs in /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 02:26:37 pplxnsms02 pacemaker-schedulerd[2417] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 09 02:26:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 09 02:26:37 pplxnsms02 pacemaker-controld [2418] (do_te_invoke) info: Processing graph 30 (ref=pe_calc-dc-1728411997-158) derived from /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 02:26:37 pplxnsms02 pacemaker-controld [2418] (pcmk__execute_graph) notice: Transition 30 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-1006.bz2): Complete
Oct 09 02:26:37 pplxnsms02 pacemaker-controld [2418] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 09 02:26:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 09 02:41:37 pplxnsms02 pacemaker-controld [2418] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 09 02:41:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 09 02:41:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 09 02:41:37 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 09 02:41:37 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) notice: On loss of quorum: Ignore
Oct 09 02:41:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 09 02:41:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms02 is online
Oct 09 02:41:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 09 02:41:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms01 is online
Oct 09 02:41:37 pplxnsms02 pacemaker-schedulerd[2417] (unpack_rsc_op_failure) warning: Unexpected result (error) was recorded for start of nco_itnm on pplxnsms02 at Oct 8 20:15:42 2024 | rc=1 id=nco_itnm_last_failure_0
Oct 09 02:41:37 pplxnsms02 pacemaker-schedulerd[2417] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Oct 8 20:12:15 2024
Oct 09 02:41:37 pplxnsms02 pacemaker-schedulerd[2417] (pe_get_failcount) info: nco_itnm has failed INFINITY times on pplxnsms02
Oct 09 02:41:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__threshold_reached) warning: nco_itnm cannot run on pplxnsms02 due to reaching migration threshold (clean up resource to allow again)| failures=1000000 migration-threshold=1000000
Oct 09 02:41:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 09 02:41:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 09 02:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_vip (Started pplxnsms01)
Oct 09 02:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms01)
Oct 09 02:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs (Started pplxnsms01)
Oct 09 02:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms01)
Oct 09 02:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms01)
Oct 09 02:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms01)
Oct 09 02:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_omni (Started pplxnsms01)
Oct 09 02:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms01)
Oct 09 02:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms01)
Oct 09 02:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 09 02:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 09 02:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 09 02:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 09 02:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 09 02:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 09 02:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms02)
Oct 09 02:41:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__log_transition_summary) notice: Calculated transition 31, saving inputs in /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 02:41:37 pplxnsms02 pacemaker-schedulerd[2417] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 09 02:41:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 09 02:41:37 pplxnsms02 pacemaker-controld [2418] (do_te_invoke) info: Processing graph 31 (ref=pe_calc-dc-1728412897-159) derived from /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 02:41:37 pplxnsms02 pacemaker-controld [2418] (pcmk__execute_graph) notice: Transition 31 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-1006.bz2): Complete
Oct 09 02:41:37 pplxnsms02 pacemaker-controld [2418] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 09 02:41:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 09 02:56:37 pplxnsms02 pacemaker-controld [2418] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 09 02:56:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 09 02:56:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 09 02:56:37 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 09 02:56:37 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) notice: On loss of quorum: Ignore
Oct 09 02:56:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 09 02:56:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms02 is online
Oct 09 02:56:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 09 02:56:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms01 is online
Oct 09 02:56:37 pplxnsms02 pacemaker-schedulerd[2417] (unpack_rsc_op_failure) warning: Unexpected result (error) was recorded for start of nco_itnm on pplxnsms02 at Oct 8 20:15:42 2024 | rc=1 id=nco_itnm_last_failure_0
Oct 09 02:56:37 pplxnsms02 pacemaker-schedulerd[2417] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Oct 8 20:12:15 2024
Oct 09 02:56:37 pplxnsms02 pacemaker-schedulerd[2417] (pe_get_failcount) info: nco_itnm has failed INFINITY times on pplxnsms02
Oct 09 02:56:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__threshold_reached) warning: nco_itnm cannot run on pplxnsms02 due to reaching migration threshold (clean up resource to allow again)| failures=1000000 migration-threshold=1000000
Oct 09 02:56:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 09 02:56:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 09 02:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_vip (Started pplxnsms01)
Oct 09 02:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms01)
Oct 09 02:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs (Started pplxnsms01)
Oct 09 02:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms01)
Oct 09 02:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms01)
Oct 09 02:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms01)
Oct 09 02:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_omni (Started pplxnsms01)
Oct 09 02:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms01)
Oct 09 02:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms01)
Oct 09 02:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 09 02:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 09 02:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 09 02:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 09 02:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 09 02:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 09 02:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms02)
Oct 09 02:56:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__log_transition_summary) notice: Calculated transition 32, saving inputs in /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 02:56:37 pplxnsms02 pacemaker-schedulerd[2417] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 09 02:56:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 09 02:56:37 pplxnsms02 pacemaker-controld [2418] (do_te_invoke) info: Processing graph 32 (ref=pe_calc-dc-1728413797-160) derived from /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 02:56:37 pplxnsms02 pacemaker-controld [2418] (pcmk__execute_graph) notice: Transition 32 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-1006.bz2): Complete
Oct 09 02:56:37 pplxnsms02 pacemaker-controld [2418] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 09 02:56:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 09 03:11:37 pplxnsms02 pacemaker-controld [2418] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 09 03:11:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 09 03:11:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 09 03:11:37 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 09 03:11:37 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) notice: On loss of quorum: Ignore
Oct 09 03:11:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 09 03:11:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms02 is online
Oct 09 03:11:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 09 03:11:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms01 is online
Oct 09 03:11:37 pplxnsms02 pacemaker-schedulerd[2417] (unpack_rsc_op_failure) warning: Unexpected result (error) was recorded for start of nco_itnm on pplxnsms02 at Oct 8 20:15:42 2024 | rc=1 id=nco_itnm_last_failure_0
Oct 09 03:11:37 pplxnsms02 pacemaker-schedulerd[2417] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Oct 8 20:12:15 2024
Oct 09 03:11:37 pplxnsms02 pacemaker-schedulerd[2417] (pe_get_failcount) info: nco_itnm has failed INFINITY times on pplxnsms02
Oct 09 03:11:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__threshold_reached) warning: nco_itnm cannot run on pplxnsms02 due to reaching migration threshold (clean up resource to allow again)| failures=1000000 migration-threshold=1000000
Oct 09 03:11:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 09 03:11:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 09 03:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_vip (Started pplxnsms01)
Oct 09 03:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms01)
Oct 09 03:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs (Started pplxnsms01)
Oct 09 03:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms01)
Oct 09 03:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms01)
Oct 09 03:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms01)
Oct 09 03:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_omni (Started pplxnsms01)
Oct 09 03:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms01)
Oct 09 03:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms01)
Oct 09 03:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 09 03:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 09 03:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 09 03:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 09 03:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 09 03:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 09 03:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms02)
Oct 09 03:11:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__log_transition_summary) notice: Calculated transition 33, saving inputs in /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 03:11:37 pplxnsms02 pacemaker-schedulerd[2417] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 09 03:11:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 09 03:11:37 pplxnsms02 pacemaker-controld [2418] (do_te_invoke) info: Processing graph 33 (ref=pe_calc-dc-1728414697-161) derived from /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 03:11:37 pplxnsms02 pacemaker-controld [2418] (pcmk__execute_graph) notice: Transition 33 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-1006.bz2): Complete
Oct 09 03:11:37 pplxnsms02 pacemaker-controld [2418] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 09 03:11:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 09 03:26:37 pplxnsms02 pacemaker-controld [2418] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 09 03:26:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 09 03:26:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 09 03:26:37 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 09 03:26:37 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) notice: On loss of quorum: Ignore
Oct 09 03:26:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 09 03:26:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms02 is online
Oct 09 03:26:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 09 03:26:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms01 is online
Oct 09 03:26:37 pplxnsms02 pacemaker-schedulerd[2417] (unpack_rsc_op_failure) warning: Unexpected result (error) was recorded for start of nco_itnm on pplxnsms02 at Oct 8 20:15:42 2024 | rc=1 id=nco_itnm_last_failure_0
Oct 09 03:26:37 pplxnsms02 pacemaker-schedulerd[2417] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Oct 8 20:12:15 2024
Oct 09 03:26:37 pplxnsms02 pacemaker-schedulerd[2417] (pe_get_failcount) info: nco_itnm has failed INFINITY times on pplxnsms02
Oct 09 03:26:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__threshold_reached) warning: nco_itnm cannot run on pplxnsms02 due to reaching migration threshold (clean up resource to allow again)| failures=1000000 migration-threshold=1000000
Oct 09 03:26:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 09 03:26:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 09 03:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_vip (Started pplxnsms01)
Oct 09 03:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms01)
Oct 09 03:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs (Started pplxnsms01)
Oct 09 03:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms01)
Oct 09 03:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms01)
Oct 09 03:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms01)
Oct 09 03:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_omni (Started pplxnsms01)
Oct 09 03:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms01)
Oct 09 03:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms01)
Oct 09 03:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 09 03:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 09 03:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 09 03:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 09 03:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 09 03:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 09 03:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms02)
Oct 09 03:26:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__log_transition_summary) notice: Calculated transition 34, saving inputs in /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 03:26:37 pplxnsms02 pacemaker-schedulerd[2417] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 09 03:26:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 09 03:26:37 pplxnsms02 pacemaker-controld [2418] (do_te_invoke) info: Processing graph 34 (ref=pe_calc-dc-1728415597-162) derived from /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 03:26:37 pplxnsms02 pacemaker-controld [2418] (pcmk__execute_graph) notice: Transition 34 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-1006.bz2): Complete
Oct 09 03:26:37 pplxnsms02 pacemaker-controld [2418] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 09 03:26:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 09 03:41:37 pplxnsms02 pacemaker-controld [2418] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 09 03:41:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 09 03:41:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 09 03:41:37 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 09 03:41:37 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) notice: On loss of quorum: Ignore
Oct 09 03:41:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 09 03:41:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms02 is online
Oct 09 03:41:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 09 03:41:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms01 is online
Oct 09 03:41:37 pplxnsms02 pacemaker-schedulerd[2417] (unpack_rsc_op_failure) warning: Unexpected result (error) was recorded for start of nco_itnm on pplxnsms02 at Oct 8 20:15:42 2024 | rc=1 id=nco_itnm_last_failure_0
Oct 09 03:41:37 pplxnsms02 pacemaker-schedulerd[2417] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Oct 8 20:12:15 2024
Oct 09 03:41:37 pplxnsms02 pacemaker-schedulerd[2417] (pe_get_failcount) info: nco_itnm has failed INFINITY times on pplxnsms02
Oct 09 03:41:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__threshold_reached) warning: nco_itnm cannot run on pplxnsms02 due to reaching migration threshold (clean up resource to allow again)| failures=1000000 migration-threshold=1000000
Oct 09 03:41:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 09 03:41:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 09 03:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_vip (Started pplxnsms01)
Oct 09 03:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms01)
Oct 09 03:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs (Started pplxnsms01)
Oct 09 03:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms01)
Oct 09 03:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms01)
Oct 09 03:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms01)
Oct 09 03:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_omni (Started pplxnsms01)
Oct 09 03:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms01)
Oct 09 03:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms01)
Oct 09 03:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 09 03:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 09 03:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 09 03:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 09 03:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 09 03:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 09 03:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms02)
Oct 09 03:41:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__log_transition_summary) notice: Calculated transition 35, saving inputs in /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 03:41:37 pplxnsms02 pacemaker-schedulerd[2417] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 09 03:41:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 09 03:41:37 pplxnsms02 pacemaker-controld [2418] (do_te_invoke) info: Processing graph 35 (ref=pe_calc-dc-1728416497-163) derived from /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 03:41:37 pplxnsms02 pacemaker-controld [2418] (pcmk__execute_graph) notice: Transition 35 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-1006.bz2): Complete
Oct 09 03:41:37 pplxnsms02 pacemaker-controld [2418] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 09 03:41:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 09 03:56:37 pplxnsms02 pacemaker-controld [2418] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 09 03:56:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 09 03:56:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 09 03:56:37 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 09 03:56:37 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) notice: On loss of quorum: Ignore
Oct 09 03:56:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 09 03:56:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms02 is online
Oct 09 03:56:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 09 03:56:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms01 is online
Oct 09 03:56:37 pplxnsms02 pacemaker-schedulerd[2417] (unpack_rsc_op_failure) warning: Unexpected result (error) was recorded for start of nco_itnm on pplxnsms02 at Oct 8 20:15:42 2024 | rc=1 id=nco_itnm_last_failure_0
Oct 09 03:56:37 pplxnsms02 pacemaker-schedulerd[2417] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Oct 8 20:12:15 2024
Oct 09 03:56:37 pplxnsms02 pacemaker-schedulerd[2417] (pe_get_failcount) info: nco_itnm has failed INFINITY times on pplxnsms02
Oct 09 03:56:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__threshold_reached) warning: nco_itnm cannot run on pplxnsms02 due to reaching migration threshold (clean up resource to allow again)| failures=1000000 migration-threshold=1000000
Oct 09 03:56:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 09 03:56:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 09 03:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_vip (Started pplxnsms01)
Oct 09 03:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms01)
Oct 09 03:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs (Started pplxnsms01)
Oct 09 03:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms01)
Oct 09 03:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms01)
Oct 09 03:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms01)
Oct 09 03:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_omni (Started pplxnsms01)
Oct 09 03:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms01)
Oct 09 03:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms01)
Oct 09 03:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 09 03:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 09 03:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 09 03:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 09 03:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 09 03:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 09 03:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms02)
Oct 09 03:56:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__log_transition_summary) notice: Calculated transition 36, saving inputs in /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 03:56:37 pplxnsms02 pacemaker-schedulerd[2417] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 09 03:56:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 09 03:56:37 pplxnsms02 pacemaker-controld [2418] (do_te_invoke) info: Processing graph 36 (ref=pe_calc-dc-1728417397-164) derived from /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 03:56:37 pplxnsms02 pacemaker-controld [2418] (pcmk__execute_graph) notice: Transition 36 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-1006.bz2): Complete
Oct 09 03:56:37 pplxnsms02 pacemaker-controld [2418] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 09 03:56:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 09 04:11:37 pplxnsms02 pacemaker-controld [2418] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 09 04:11:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 09 04:11:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 09 04:11:37 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 09 04:11:37 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) notice: On loss of quorum: Ignore
Oct 09 04:11:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 09 04:11:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms02 is online
Oct 09 04:11:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 09 04:11:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms01 is online
Oct 09 04:11:37 pplxnsms02 pacemaker-schedulerd[2417] (unpack_rsc_op_failure) warning: Unexpected result (error) was recorded for start of nco_itnm on pplxnsms02 at Oct 8 20:15:42 2024 | rc=1 id=nco_itnm_last_failure_0
Oct 09 04:11:37 pplxnsms02 pacemaker-schedulerd[2417] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Oct 8 20:12:15 2024
Oct 09 04:11:37 pplxnsms02 pacemaker-schedulerd[2417] (pe_get_failcount) info: nco_itnm has failed INFINITY times on pplxnsms02
Oct 09 04:11:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__threshold_reached) warning: nco_itnm cannot run on pplxnsms02 due to reaching migration threshold (clean up resource to allow again)| failures=1000000 migration-threshold=1000000
Oct 09 04:11:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 09 04:11:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 09 04:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_vip (Started pplxnsms01)
Oct 09 04:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms01)
Oct 09 04:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs (Started pplxnsms01)
Oct 09 04:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms01)
Oct 09 04:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms01)
Oct 09 04:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms01)
Oct 09 04:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_omni (Started pplxnsms01)
Oct 09 04:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms01)
Oct 09 04:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms01)
Oct 09 04:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 09 04:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 09 04:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 09 04:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 09 04:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 09 04:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 09 04:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms02)
Oct 09 04:11:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__log_transition_summary) notice: Calculated transition 37, saving inputs in /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 04:11:37 pplxnsms02 pacemaker-schedulerd[2417] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 09 04:11:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 09 04:11:37 pplxnsms02 pacemaker-controld [2418] (do_te_invoke) info: Processing graph 37 (ref=pe_calc-dc-1728418297-165) derived from /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 04:11:37 pplxnsms02 pacemaker-controld [2418] (pcmk__execute_graph) notice: Transition 37 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-1006.bz2): Complete
Oct 09 04:11:37 pplxnsms02 pacemaker-controld [2418] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 09 04:11:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 09 04:26:37 pplxnsms02 pacemaker-controld [2418] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 09 04:26:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 09 04:26:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 09 04:26:37 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 09 04:26:37 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) notice: On loss of quorum: Ignore
Oct 09 04:26:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 09 04:26:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms02 is online
Oct 09 04:26:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 09 04:26:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms01 is online
Oct 09 04:26:37 pplxnsms02 pacemaker-schedulerd[2417] (unpack_rsc_op_failure) warning: Unexpected result (error) was recorded for start of nco_itnm on pplxnsms02 at Oct 8 20:15:42 2024 | rc=1 id=nco_itnm_last_failure_0
Oct 09 04:26:37 pplxnsms02 pacemaker-schedulerd[2417] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Oct 8 20:12:15 2024
Oct 09 04:26:37 pplxnsms02 pacemaker-schedulerd[2417] (pe_get_failcount) info: nco_itnm has failed INFINITY times on pplxnsms02
Oct 09 04:26:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__threshold_reached) warning: nco_itnm cannot run on pplxnsms02 due to reaching migration threshold (clean up resource to allow again)| failures=1000000 migration-threshold=1000000
Oct 09 04:26:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 09 04:26:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 09 04:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_vip (Started pplxnsms01)
Oct 09 04:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms01)
Oct 09 04:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs (Started pplxnsms01)
Oct 09 04:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms01)
Oct 09 04:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms01)
Oct 09 04:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms01)
Oct 09 04:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_omni (Started pplxnsms01)
Oct 09 04:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms01)
Oct 09 04:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms01)
Oct 09 04:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 09 04:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 09 04:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 09 04:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 09 04:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 09 04:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 09 04:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms02)
Oct 09 04:26:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__log_transition_summary) notice: Calculated transition 38, saving inputs in /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 04:26:37 pplxnsms02 pacemaker-schedulerd[2417] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 09 04:26:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 09 04:26:37 pplxnsms02 pacemaker-controld [2418] (do_te_invoke) info: Processing graph 38 (ref=pe_calc-dc-1728419197-166) derived from /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 04:26:37 pplxnsms02 pacemaker-controld [2418] (pcmk__execute_graph) notice: Transition 38 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-1006.bz2): Complete
Oct 09 04:26:37 pplxnsms02 pacemaker-controld [2418] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 09 04:26:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 09 04:41:37 pplxnsms02 pacemaker-controld [2418] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 09 04:41:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 09 04:41:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 09 04:41:37 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 09 04:41:37 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) notice: On loss of quorum: Ignore
Oct 09 04:41:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 09 04:41:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms02 is online
Oct 09 04:41:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 09 04:41:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms01 is online
Oct 09 04:41:37 pplxnsms02 pacemaker-schedulerd[2417] (unpack_rsc_op_failure) warning: Unexpected result (error) was recorded for start of nco_itnm on pplxnsms02 at Oct 8 20:15:42 2024 | rc=1 id=nco_itnm_last_failure_0
Oct 09 04:41:37 pplxnsms02 pacemaker-schedulerd[2417] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Oct 8 20:12:15 2024
Oct 09 04:41:37 pplxnsms02 pacemaker-schedulerd[2417] (pe_get_failcount) info: nco_itnm has failed INFINITY times on pplxnsms02
Oct 09 04:41:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__threshold_reached) warning: nco_itnm cannot run on pplxnsms02 due to reaching migration threshold (clean up resource to allow again)| failures=1000000 migration-threshold=1000000
Oct 09 04:41:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 09 04:41:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 09 04:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_vip (Started pplxnsms01)
Oct 09 04:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms01)
Oct 09 04:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs (Started pplxnsms01)
Oct 09 04:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms01)
Oct 09 04:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms01)
Oct 09 04:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms01)
Oct 09 04:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_omni (Started pplxnsms01)
Oct 09 04:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms01)
Oct 09 04:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms01)
Oct 09 04:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 09 04:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 09 04:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 09 04:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 09 04:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 09 04:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 09 04:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms02)
Oct 09 04:41:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__log_transition_summary) notice: Calculated transition 39, saving inputs in /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 04:41:37 pplxnsms02 pacemaker-schedulerd[2417] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 09 04:41:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 09 04:41:37 pplxnsms02 pacemaker-controld [2418] (do_te_invoke) info: Processing graph 39 (ref=pe_calc-dc-1728420097-167) derived from /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 04:41:37 pplxnsms02 pacemaker-controld [2418] (pcmk__execute_graph) notice: Transition 39 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-1006.bz2): Complete
Oct 09 04:41:37 pplxnsms02 pacemaker-controld [2418] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 09 04:41:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 09 04:56:37 pplxnsms02 pacemaker-controld [2418] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 09 04:56:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 09 04:56:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 09 04:56:37 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 09 04:56:37 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) notice: On loss of quorum: Ignore
Oct 09 04:56:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 09 04:56:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms02 is online
Oct 09 04:56:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 09 04:56:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms01 is online
Oct 09 04:56:37 pplxnsms02 pacemaker-schedulerd[2417] (unpack_rsc_op_failure) warning: Unexpected result (error) was recorded for start of nco_itnm on pplxnsms02 at Oct 8 20:15:42 2024 | rc=1 id=nco_itnm_last_failure_0
Oct 09 04:56:37 pplxnsms02 pacemaker-schedulerd[2417] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Oct 8 20:12:15 2024
Oct 09 04:56:37 pplxnsms02 pacemaker-schedulerd[2417] (pe_get_failcount) info: nco_itnm has failed INFINITY times on pplxnsms02
Oct 09 04:56:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__threshold_reached) warning: nco_itnm cannot run on pplxnsms02 due to reaching migration threshold (clean up resource to allow again)| failures=1000000 migration-threshold=1000000
Oct 09 04:56:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 09 04:56:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 09 04:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_vip (Started pplxnsms01)
Oct 09 04:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms01)
Oct 09 04:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs (Started pplxnsms01)
Oct 09 04:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms01)
Oct 09 04:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms01)
Oct 09 04:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms01)
Oct 09 04:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_omni (Started pplxnsms01)
Oct 09 04:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms01)
Oct 09 04:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms01)
Oct 09 04:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 09 04:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 09 04:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 09 04:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 09 04:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 09 04:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 09 04:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms02)
Oct 09 04:56:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__log_transition_summary) notice: Calculated transition 40, saving inputs in /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 04:56:37 pplxnsms02 pacemaker-schedulerd[2417] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 09 04:56:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 09 04:56:37 pplxnsms02 pacemaker-controld [2418] (do_te_invoke) info: Processing graph 40 (ref=pe_calc-dc-1728420997-168) derived from /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 04:56:37 pplxnsms02 pacemaker-controld [2418] (pcmk__execute_graph) notice: Transition 40 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-1006.bz2): Complete
Oct 09 04:56:37 pplxnsms02 pacemaker-controld [2418] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 09 04:56:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 09 05:11:37 pplxnsms02 pacemaker-controld [2418] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 09 05:11:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 09 05:11:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 09 05:11:37 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 09 05:11:37 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) notice: On loss of quorum: Ignore
Oct 09 05:11:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 09 05:11:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms02 is online
Oct 09 05:11:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 09 05:11:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms01 is online
Oct 09 05:11:37 pplxnsms02 pacemaker-schedulerd[2417] (unpack_rsc_op_failure) warning: Unexpected result (error) was recorded for start of nco_itnm on pplxnsms02 at Oct 8 20:15:42 2024 | rc=1 id=nco_itnm_last_failure_0
Oct 09 05:11:37 pplxnsms02 pacemaker-schedulerd[2417] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Oct 8 20:12:15 2024
Oct 09 05:11:37 pplxnsms02 pacemaker-schedulerd[2417] (pe_get_failcount) info: nco_itnm has failed INFINITY times on pplxnsms02
Oct 09 05:11:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__threshold_reached) warning: nco_itnm cannot run on pplxnsms02 due to reaching migration threshold (clean up resource to allow again)| failures=1000000 migration-threshold=1000000
Oct 09 05:11:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 09 05:11:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 09 05:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_vip (Started pplxnsms01)
Oct 09 05:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms01)
Oct 09 05:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs (Started pplxnsms01)
Oct 09 05:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms01)
Oct 09 05:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms01)
Oct 09 05:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms01)
Oct 09 05:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_omni (Started pplxnsms01)
Oct 09 05:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms01)
Oct 09 05:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms01)
Oct 09 05:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 09 05:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 09 05:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 09 05:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 09 05:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 09 05:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 09 05:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms02)
Oct 09 05:11:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__log_transition_summary) notice: Calculated transition 41, saving inputs in /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 05:11:37 pplxnsms02 pacemaker-schedulerd[2417] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 09 05:11:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 09 05:11:37 pplxnsms02 pacemaker-controld [2418] (do_te_invoke) info: Processing graph 41 (ref=pe_calc-dc-1728421897-169) derived from /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 05:11:37 pplxnsms02 pacemaker-controld [2418] (pcmk__execute_graph) notice: Transition 41 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-1006.bz2): Complete
Oct 09 05:11:37 pplxnsms02 pacemaker-controld [2418] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 09 05:11:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 09 05:26:37 pplxnsms02 pacemaker-controld [2418] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 09 05:26:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 09 05:26:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 09 05:26:37 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 09 05:26:37 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) notice: On loss of quorum: Ignore
Oct 09 05:26:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 09 05:26:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms02 is online
Oct 09 05:26:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 09 05:26:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms01 is online
Oct 09 05:26:37 pplxnsms02 pacemaker-schedulerd[2417] (unpack_rsc_op_failure) warning: Unexpected result (error) was recorded for start of nco_itnm on pplxnsms02 at Oct 8 20:15:42 2024 | rc=1 id=nco_itnm_last_failure_0
Oct 09 05:26:37 pplxnsms02 pacemaker-schedulerd[2417] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Oct 8 20:12:15 2024
Oct 09 05:26:37 pplxnsms02 pacemaker-schedulerd[2417] (pe_get_failcount) info: nco_itnm has failed INFINITY times on pplxnsms02
Oct 09 05:26:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__threshold_reached) warning: nco_itnm cannot run on pplxnsms02 due to reaching migration threshold (clean up resource to allow again)| failures=1000000 migration-threshold=1000000
Oct 09 05:26:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 09 05:26:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 09 05:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_vip (Started pplxnsms01)
Oct 09 05:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms01)
Oct 09 05:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs (Started pplxnsms01)
Oct 09 05:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms01)
Oct 09 05:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms01)
Oct 09 05:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms01)
Oct 09 05:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_omni (Started pplxnsms01)
Oct 09 05:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms01)
Oct 09 05:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms01)
Oct 09 05:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 09 05:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 09 05:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 09 05:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 09 05:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 09 05:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 09 05:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms02)
Oct 09 05:26:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__log_transition_summary) notice: Calculated transition 42, saving inputs in /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 05:26:37 pplxnsms02 pacemaker-schedulerd[2417] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 09 05:26:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 09 05:26:37 pplxnsms02 pacemaker-controld [2418] (do_te_invoke) info: Processing graph 42 (ref=pe_calc-dc-1728422797-170) derived from /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 05:26:37 pplxnsms02 pacemaker-controld [2418] (pcmk__execute_graph) notice: Transition 42 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-1006.bz2): Complete
Oct 09 05:26:37 pplxnsms02 pacemaker-controld [2418] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 09 05:26:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 09 05:41:37 pplxnsms02 pacemaker-controld [2418] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 09 05:41:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 09 05:41:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 09 05:41:37 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 09 05:41:37 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) notice: On loss of quorum: Ignore
Oct 09 05:41:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 09 05:41:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms02 is online
Oct 09 05:41:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 09 05:41:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms01 is online
Oct 09 05:41:37 pplxnsms02 pacemaker-schedulerd[2417] (unpack_rsc_op_failure) warning: Unexpected result (error) was recorded for start of nco_itnm on pplxnsms02 at Oct 8 20:15:42 2024 | rc=1 id=nco_itnm_last_failure_0
Oct 09 05:41:37 pplxnsms02 pacemaker-schedulerd[2417] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Oct 8 20:12:15 2024
Oct 09 05:41:37 pplxnsms02 pacemaker-schedulerd[2417] (pe_get_failcount) info: nco_itnm has failed INFINITY times on pplxnsms02
Oct 09 05:41:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__threshold_reached) warning: nco_itnm cannot run on pplxnsms02 due to reaching migration threshold (clean up resource to allow again)| failures=1000000 migration-threshold=1000000
Oct 09 05:41:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 09 05:41:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 09 05:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_vip (Started pplxnsms01)
Oct 09 05:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms01)
Oct 09 05:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs (Started pplxnsms01)
Oct 09 05:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms01)
Oct 09 05:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms01)
Oct 09 05:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms01)
Oct 09 05:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_omni (Started pplxnsms01)
Oct 09 05:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms01)
Oct 09 05:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms01)
Oct 09 05:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 09 05:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 09 05:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 09 05:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 09 05:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 09 05:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 09 05:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms02)
Oct 09 05:41:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__log_transition_summary) notice: Calculated transition 43, saving inputs in /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 05:41:37 pplxnsms02 pacemaker-schedulerd[2417] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 09 05:41:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 09 05:41:37 pplxnsms02 pacemaker-controld [2418] (do_te_invoke) info: Processing graph 43 (ref=pe_calc-dc-1728423697-171) derived from /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 05:41:37 pplxnsms02 pacemaker-controld [2418] (pcmk__execute_graph) notice: Transition 43 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-1006.bz2): Complete
Oct 09 05:41:37 pplxnsms02 pacemaker-controld [2418] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 09 05:41:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 09 05:56:37 pplxnsms02 pacemaker-controld [2418] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 09 05:56:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 09 05:56:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 09 05:56:37 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 09 05:56:37 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) notice: On loss of quorum: Ignore
Oct 09 05:56:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 09 05:56:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms02 is online
Oct 09 05:56:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 09 05:56:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms01 is online
Oct 09 05:56:37 pplxnsms02 pacemaker-schedulerd[2417] (unpack_rsc_op_failure) warning: Unexpected result (error) was recorded for start of nco_itnm on pplxnsms02 at Oct 8 20:15:42 2024 | rc=1 id=nco_itnm_last_failure_0
Oct 09 05:56:37 pplxnsms02 pacemaker-schedulerd[2417] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Oct 8 20:12:15 2024
Oct 09 05:56:37 pplxnsms02 pacemaker-schedulerd[2417] (pe_get_failcount) info: nco_itnm has failed INFINITY times on pplxnsms02
Oct 09 05:56:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__threshold_reached) warning: nco_itnm cannot run on pplxnsms02 due to reaching migration threshold (clean up resource to allow again)| failures=1000000 migration-threshold=1000000
Oct 09 05:56:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 09 05:56:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 09 05:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_vip (Started pplxnsms01)
Oct 09 05:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms01)
Oct 09 05:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs (Started pplxnsms01)
Oct 09 05:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms01)
Oct 09 05:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms01)
Oct 09 05:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms01)
Oct 09 05:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_omni (Started pplxnsms01)
Oct 09 05:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms01)
Oct 09 05:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms01)
Oct 09 05:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 09 05:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 09 05:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 09 05:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 09 05:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 09 05:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 09 05:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms02)
Oct 09 05:56:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__log_transition_summary) notice: Calculated transition 44, saving inputs in /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 05:56:37 pplxnsms02 pacemaker-schedulerd[2417] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 09 05:56:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 09 05:56:37 pplxnsms02 pacemaker-controld [2418] (do_te_invoke) info: Processing graph 44 (ref=pe_calc-dc-1728424597-172) derived from /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 05:56:37 pplxnsms02 pacemaker-controld [2418] (pcmk__execute_graph) notice: Transition 44 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-1006.bz2): Complete
Oct 09 05:56:37 pplxnsms02 pacemaker-controld [2418] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 09 05:56:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 09 06:11:37 pplxnsms02 pacemaker-controld [2418] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 09 06:11:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 09 06:11:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 09 06:11:37 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 09 06:11:37 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) notice: On loss of quorum: Ignore
Oct 09 06:11:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 09 06:11:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms02 is online
Oct 09 06:11:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 09 06:11:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms01 is online
Oct 09 06:11:37 pplxnsms02 pacemaker-schedulerd[2417] (unpack_rsc_op_failure) warning: Unexpected result (error) was recorded for start of nco_itnm on pplxnsms02 at Oct 8 20:15:42 2024 | rc=1 id=nco_itnm_last_failure_0
Oct 09 06:11:37 pplxnsms02 pacemaker-schedulerd[2417] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Oct 8 20:12:15 2024
Oct 09 06:11:37 pplxnsms02 pacemaker-schedulerd[2417] (pe_get_failcount) info: nco_itnm has failed INFINITY times on pplxnsms02
Oct 09 06:11:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__threshold_reached) warning: nco_itnm cannot run on pplxnsms02 due to reaching migration threshold (clean up resource to allow again)| failures=1000000 migration-threshold=1000000
Oct 09 06:11:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 09 06:11:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 09 06:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_vip (Started pplxnsms01)
Oct 09 06:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms01)
Oct 09 06:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs (Started pplxnsms01)
Oct 09 06:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms01)
Oct 09 06:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms01)
Oct 09 06:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms01)
Oct 09 06:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_omni (Started pplxnsms01)
Oct 09 06:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms01)
Oct 09 06:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms01)
Oct 09 06:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 09 06:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 09 06:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 09 06:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 09 06:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 09 06:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 09 06:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms02)
Oct 09 06:11:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__log_transition_summary) notice: Calculated transition 45, saving inputs in /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 06:11:37 pplxnsms02 pacemaker-schedulerd[2417] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 09 06:11:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 09 06:11:37 pplxnsms02 pacemaker-controld [2418] (do_te_invoke) info: Processing graph 45 (ref=pe_calc-dc-1728425497-173) derived from /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 06:11:37 pplxnsms02 pacemaker-controld [2418] (pcmk__execute_graph) notice: Transition 45 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-1006.bz2): Complete
Oct 09 06:11:37 pplxnsms02 pacemaker-controld [2418] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 09 06:11:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 09 06:26:37 pplxnsms02 pacemaker-controld [2418] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 09 06:26:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 09 06:26:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 09 06:26:37 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 09 06:26:37 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) notice: On loss of quorum: Ignore
Oct 09 06:26:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 09 06:26:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms02 is online
Oct 09 06:26:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 09 06:26:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms01 is online
Oct 09 06:26:37 pplxnsms02 pacemaker-schedulerd[2417] (unpack_rsc_op_failure) warning: Unexpected result (error) was recorded for start of nco_itnm on pplxnsms02 at Oct 8 20:15:42 2024 | rc=1 id=nco_itnm_last_failure_0
Oct 09 06:26:37 pplxnsms02 pacemaker-schedulerd[2417] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Oct 8 20:12:15 2024
Oct 09 06:26:37 pplxnsms02 pacemaker-schedulerd[2417] (pe_get_failcount) info: nco_itnm has failed INFINITY times on pplxnsms02
Oct 09 06:26:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__threshold_reached) warning: nco_itnm cannot run on pplxnsms02 due to reaching migration threshold (clean up resource to allow again)| failures=1000000 migration-threshold=1000000
Oct 09 06:26:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 09 06:26:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 09 06:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_vip (Started pplxnsms01)
Oct 09 06:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms01)
Oct 09 06:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs (Started pplxnsms01)
Oct 09 06:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms01)
Oct 09 06:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms01)
Oct 09 06:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms01)
Oct 09 06:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_omni (Started pplxnsms01)
Oct 09 06:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms01)
Oct 09 06:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms01)
Oct 09 06:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 09 06:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 09 06:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 09 06:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 09 06:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 09 06:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 09 06:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms02)
Oct 09 06:26:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__log_transition_summary) notice: Calculated transition 46, saving inputs in /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 06:26:37 pplxnsms02 pacemaker-schedulerd[2417] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 09 06:26:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 09 06:26:37 pplxnsms02 pacemaker-controld [2418] (do_te_invoke) info: Processing graph 46 (ref=pe_calc-dc-1728426397-174) derived from /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 06:26:37 pplxnsms02 pacemaker-controld [2418] (pcmk__execute_graph) notice: Transition 46 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-1006.bz2): Complete
Oct 09 06:26:37 pplxnsms02 pacemaker-controld [2418] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 09 06:26:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 09 06:41:37 pplxnsms02 pacemaker-controld [2418] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 09 06:41:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 09 06:41:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 09 06:41:37 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 09 06:41:37 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) notice: On loss of quorum: Ignore
Oct 09 06:41:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 09 06:41:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms02 is online
Oct 09 06:41:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 09 06:41:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms01 is online
Oct 09 06:41:37 pplxnsms02 pacemaker-schedulerd[2417] (unpack_rsc_op_failure) warning: Unexpected result (error) was recorded for start of nco_itnm on pplxnsms02 at Oct 8 20:15:42 2024 | rc=1 id=nco_itnm_last_failure_0
Oct 09 06:41:37 pplxnsms02 pacemaker-schedulerd[2417] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Oct 8 20:12:15 2024
Oct 09 06:41:37 pplxnsms02 pacemaker-schedulerd[2417] (pe_get_failcount) info: nco_itnm has failed INFINITY times on pplxnsms02
Oct 09 06:41:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__threshold_reached) warning: nco_itnm cannot run on pplxnsms02 due to reaching migration threshold (clean up resource to allow again)| failures=1000000 migration-threshold=1000000
Oct 09 06:41:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 09 06:41:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 09 06:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_vip (Started pplxnsms01)
Oct 09 06:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms01)
Oct 09 06:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs (Started pplxnsms01)
Oct 09 06:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms01)
Oct 09 06:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms01)
Oct 09 06:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms01)
Oct 09 06:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_omni (Started pplxnsms01)
Oct 09 06:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms01)
Oct 09 06:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms01)
Oct 09 06:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 09 06:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 09 06:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 09 06:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 09 06:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 09 06:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 09 06:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms02)
Oct 09 06:41:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__log_transition_summary) notice: Calculated transition 47, saving inputs in /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 06:41:37 pplxnsms02 pacemaker-schedulerd[2417] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 09 06:41:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 09 06:41:37 pplxnsms02 pacemaker-controld [2418] (do_te_invoke) info: Processing graph 47 (ref=pe_calc-dc-1728427297-175) derived from /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 06:41:37 pplxnsms02 pacemaker-controld [2418] (pcmk__execute_graph) notice: Transition 47 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-1006.bz2): Complete
Oct 09 06:41:37 pplxnsms02 pacemaker-controld [2418] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 09 06:41:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 09 06:56:37 pplxnsms02 pacemaker-controld [2418] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 09 06:56:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 09 06:56:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 09 06:56:37 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 09 06:56:37 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) notice: On loss of quorum: Ignore
Oct 09 06:56:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 09 06:56:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms02 is online
Oct 09 06:56:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 09 06:56:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms01 is online
Oct 09 06:56:37 pplxnsms02 pacemaker-schedulerd[2417] (unpack_rsc_op_failure) warning: Unexpected result (error) was recorded for start of nco_itnm on pplxnsms02 at Oct 8 20:15:42 2024 | rc=1 id=nco_itnm_last_failure_0
Oct 09 06:56:37 pplxnsms02 pacemaker-schedulerd[2417] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Oct 8 20:12:15 2024
Oct 09 06:56:37 pplxnsms02 pacemaker-schedulerd[2417] (pe_get_failcount) info: nco_itnm has failed INFINITY times on pplxnsms02
Oct 09 06:56:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__threshold_reached) warning: nco_itnm cannot run on pplxnsms02 due to reaching migration threshold (clean up resource to allow again)| failures=1000000 migration-threshold=1000000
Oct 09 06:56:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 09 06:56:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 09 06:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_vip (Started pplxnsms01)
Oct 09 06:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms01)
Oct 09 06:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs (Started pplxnsms01)
Oct 09 06:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms01)
Oct 09 06:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms01)
Oct 09 06:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms01)
Oct 09 06:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_omni (Started pplxnsms01)
Oct 09 06:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms01)
Oct 09 06:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms01)
Oct 09 06:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 09 06:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 09 06:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 09 06:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 09 06:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 09 06:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 09 06:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms02)
Oct 09 06:56:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__log_transition_summary) notice: Calculated transition 48, saving inputs in /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 06:56:37 pplxnsms02 pacemaker-schedulerd[2417] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 09 06:56:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 09 06:56:37 pplxnsms02 pacemaker-controld [2418] (do_te_invoke) info: Processing graph 48 (ref=pe_calc-dc-1728428197-176) derived from /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 06:56:37 pplxnsms02 pacemaker-controld [2418] (pcmk__execute_graph) notice: Transition 48 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-1006.bz2): Complete
Oct 09 06:56:37 pplxnsms02 pacemaker-controld [2418] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 09 06:56:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 09 07:11:37 pplxnsms02 pacemaker-controld [2418] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 09 07:11:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 09 07:11:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 09 07:11:37 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 09 07:11:37 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) notice: On loss of quorum: Ignore
Oct 09 07:11:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 09 07:11:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms02 is online
Oct 09 07:11:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 09 07:11:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms01 is online
Oct 09 07:11:37 pplxnsms02 pacemaker-schedulerd[2417] (unpack_rsc_op_failure) warning: Unexpected result (error) was recorded for start of nco_itnm on pplxnsms02 at Oct 8 20:15:42 2024 | rc=1 id=nco_itnm_last_failure_0
Oct 09 07:11:37 pplxnsms02 pacemaker-schedulerd[2417] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Oct 8 20:12:15 2024
Oct 09 07:11:37 pplxnsms02 pacemaker-schedulerd[2417] (pe_get_failcount) info: nco_itnm has failed INFINITY times on pplxnsms02
Oct 09 07:11:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__threshold_reached) warning: nco_itnm cannot run on pplxnsms02 due to reaching migration threshold (clean up resource to allow again)| failures=1000000 migration-threshold=1000000
Oct 09 07:11:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 09 07:11:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 09 07:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_vip (Started pplxnsms01)
Oct 09 07:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms01)
Oct 09 07:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs (Started pplxnsms01)
Oct 09 07:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms01)
Oct 09 07:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms01)
Oct 09 07:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms01)
Oct 09 07:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_omni (Started pplxnsms01)
Oct 09 07:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms01)
Oct 09 07:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms01)
Oct 09 07:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 09 07:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 09 07:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 09 07:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 09 07:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 09 07:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 09 07:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms02)
Oct 09 07:11:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__log_transition_summary) notice: Calculated transition 49, saving inputs in /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 07:11:37 pplxnsms02 pacemaker-schedulerd[2417] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 09 07:11:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 09 07:11:37 pplxnsms02 pacemaker-controld [2418] (do_te_invoke) info: Processing graph 49 (ref=pe_calc-dc-1728429097-177) derived from /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 07:11:37 pplxnsms02 pacemaker-controld [2418] (pcmk__execute_graph) notice: Transition 49 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-1006.bz2): Complete
Oct 09 07:11:37 pplxnsms02 pacemaker-controld [2418] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 09 07:11:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 09 07:26:37 pplxnsms02 pacemaker-controld [2418] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 09 07:26:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 09 07:26:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 09 07:26:37 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 09 07:26:37 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) notice: On loss of quorum: Ignore
Oct 09 07:26:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 09 07:26:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms02 is online
Oct 09 07:26:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 09 07:26:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms01 is online
Oct 09 07:26:37 pplxnsms02 pacemaker-schedulerd[2417] (unpack_rsc_op_failure) warning: Unexpected result (error) was recorded for start of nco_itnm on pplxnsms02 at Oct 8 20:15:42 2024 | rc=1 id=nco_itnm_last_failure_0
Oct 09 07:26:37 pplxnsms02 pacemaker-schedulerd[2417] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Oct 8 20:12:15 2024
Oct 09 07:26:37 pplxnsms02 pacemaker-schedulerd[2417] (pe_get_failcount) info: nco_itnm has failed INFINITY times on pplxnsms02
Oct 09 07:26:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__threshold_reached) warning: nco_itnm cannot run on pplxnsms02 due to reaching migration threshold (clean up resource to allow again)| failures=1000000 migration-threshold=1000000
Oct 09 07:26:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 09 07:26:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 09 07:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_vip (Started pplxnsms01)
Oct 09 07:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms01)
Oct 09 07:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs (Started pplxnsms01)
Oct 09 07:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms01)
Oct 09 07:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms01)
Oct 09 07:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms01)
Oct 09 07:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_omni (Started pplxnsms01)
Oct 09 07:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms01)
Oct 09 07:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms01)
Oct 09 07:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 09 07:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 09 07:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 09 07:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 09 07:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 09 07:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 09 07:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms02)
Oct 09 07:26:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__log_transition_summary) notice: Calculated transition 50, saving inputs in /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 07:26:37 pplxnsms02 pacemaker-schedulerd[2417] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 09 07:26:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 09 07:26:37 pplxnsms02 pacemaker-controld [2418] (do_te_invoke) info: Processing graph 50 (ref=pe_calc-dc-1728429997-178) derived from /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 07:26:37 pplxnsms02 pacemaker-controld [2418] (pcmk__execute_graph) notice: Transition 50 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-1006.bz2): Complete
Oct 09 07:26:37 pplxnsms02 pacemaker-controld [2418] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 09 07:26:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 09 07:41:37 pplxnsms02 pacemaker-controld [2418] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 09 07:41:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 09 07:41:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 09 07:41:37 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 09 07:41:37 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) notice: On loss of quorum: Ignore
Oct 09 07:41:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 09 07:41:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms02 is online
Oct 09 07:41:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 09 07:41:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms01 is online
Oct 09 07:41:37 pplxnsms02 pacemaker-schedulerd[2417] (unpack_rsc_op_failure) warning: Unexpected result (error) was recorded for start of nco_itnm on pplxnsms02 at Oct 8 20:15:42 2024 | rc=1 id=nco_itnm_last_failure_0
Oct 09 07:41:37 pplxnsms02 pacemaker-schedulerd[2417] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Oct 8 20:12:15 2024
Oct 09 07:41:37 pplxnsms02 pacemaker-schedulerd[2417] (pe_get_failcount) info: nco_itnm has failed INFINITY times on pplxnsms02
Oct 09 07:41:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__threshold_reached) warning: nco_itnm cannot run on pplxnsms02 due to reaching migration threshold (clean up resource to allow again)| failures=1000000 migration-threshold=1000000
Oct 09 07:41:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 09 07:41:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 09 07:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_vip (Started pplxnsms01)
Oct 09 07:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms01)
Oct 09 07:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs (Started pplxnsms01)
Oct 09 07:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms01)
Oct 09 07:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms01)
Oct 09 07:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms01)
Oct 09 07:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_omni (Started pplxnsms01)
Oct 09 07:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms01)
Oct 09 07:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms01)
Oct 09 07:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 09 07:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 09 07:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 09 07:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 09 07:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 09 07:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 09 07:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms02)
Oct 09 07:41:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__log_transition_summary) notice: Calculated transition 51, saving inputs in /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 07:41:37 pplxnsms02 pacemaker-schedulerd[2417] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 09 07:41:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 09 07:41:37 pplxnsms02 pacemaker-controld [2418] (do_te_invoke) info: Processing graph 51 (ref=pe_calc-dc-1728430897-179) derived from /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 07:41:37 pplxnsms02 pacemaker-controld [2418] (pcmk__execute_graph) notice: Transition 51 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-1006.bz2): Complete
Oct 09 07:41:37 pplxnsms02 pacemaker-controld [2418] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 09 07:41:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 09 07:56:37 pplxnsms02 pacemaker-controld [2418] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 09 07:56:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 09 07:56:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 09 07:56:37 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 09 07:56:37 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) notice: On loss of quorum: Ignore
Oct 09 07:56:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 09 07:56:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms02 is online
Oct 09 07:56:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 09 07:56:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms01 is online
Oct 09 07:56:37 pplxnsms02 pacemaker-schedulerd[2417] (unpack_rsc_op_failure) warning: Unexpected result (error) was recorded for start of nco_itnm on pplxnsms02 at Oct 8 20:15:42 2024 | rc=1 id=nco_itnm_last_failure_0
Oct 09 07:56:37 pplxnsms02 pacemaker-schedulerd[2417] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Oct 8 20:12:15 2024
Oct 09 07:56:37 pplxnsms02 pacemaker-schedulerd[2417] (pe_get_failcount) info: nco_itnm has failed INFINITY times on pplxnsms02
Oct 09 07:56:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__threshold_reached) warning: nco_itnm cannot run on pplxnsms02 due to reaching migration threshold (clean up resource to allow again)| failures=1000000 migration-threshold=1000000
Oct 09 07:56:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 09 07:56:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 09 07:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_vip (Started pplxnsms01)
Oct 09 07:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms01)
Oct 09 07:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs (Started pplxnsms01)
Oct 09 07:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms01)
Oct 09 07:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms01)
Oct 09 07:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms01)
Oct 09 07:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_omni (Started pplxnsms01)
Oct 09 07:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms01)
Oct 09 07:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms01)
Oct 09 07:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 09 07:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 09 07:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 09 07:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 09 07:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 09 07:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 09 07:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms02)
Oct 09 07:56:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__log_transition_summary) notice: Calculated transition 52, saving inputs in /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 07:56:37 pplxnsms02 pacemaker-schedulerd[2417] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 09 07:56:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 09 07:56:37 pplxnsms02 pacemaker-controld [2418] (do_te_invoke) info: Processing graph 52 (ref=pe_calc-dc-1728431797-180) derived from /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 07:56:37 pplxnsms02 pacemaker-controld [2418] (pcmk__execute_graph) notice: Transition 52 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-1006.bz2): Complete
Oct 09 07:56:37 pplxnsms02 pacemaker-controld [2418] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 09 07:56:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 09 08:11:37 pplxnsms02 pacemaker-controld [2418] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 09 08:11:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 09 08:11:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 09 08:11:37 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 09 08:11:37 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) notice: On loss of quorum: Ignore
Oct 09 08:11:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 09 08:11:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms02 is online
Oct 09 08:11:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 09 08:11:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms01 is online
Oct 09 08:11:37 pplxnsms02 pacemaker-schedulerd[2417] (unpack_rsc_op_failure) warning: Unexpected result (error) was recorded for start of nco_itnm on pplxnsms02 at Oct 8 20:15:42 2024 | rc=1 id=nco_itnm_last_failure_0
Oct 09 08:11:37 pplxnsms02 pacemaker-schedulerd[2417] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Oct 8 20:12:15 2024
Oct 09 08:11:37 pplxnsms02 pacemaker-schedulerd[2417] (pe_get_failcount) info: nco_itnm has failed INFINITY times on pplxnsms02
Oct 09 08:11:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__threshold_reached) warning: nco_itnm cannot run on pplxnsms02 due to reaching migration threshold (clean up resource to allow again)| failures=1000000 migration-threshold=1000000
Oct 09 08:11:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 09 08:11:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 09 08:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_vip (Started pplxnsms01)
Oct 09 08:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms01)
Oct 09 08:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs (Started pplxnsms01)
Oct 09 08:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms01)
Oct 09 08:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms01)
Oct 09 08:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms01)
Oct 09 08:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_omni (Started pplxnsms01)
Oct 09 08:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms01)
Oct 09 08:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms01)
Oct 09 08:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 09 08:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 09 08:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 09 08:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 09 08:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 09 08:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 09 08:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms02)
Oct 09 08:11:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__log_transition_summary) notice: Calculated transition 53, saving inputs in /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 08:11:37 pplxnsms02 pacemaker-schedulerd[2417] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 09 08:11:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 09 08:11:37 pplxnsms02 pacemaker-controld [2418] (do_te_invoke) info: Processing graph 53 (ref=pe_calc-dc-1728432697-181) derived from /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 08:11:37 pplxnsms02 pacemaker-controld [2418] (pcmk__execute_graph) notice: Transition 53 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-1006.bz2): Complete
Oct 09 08:11:37 pplxnsms02 pacemaker-controld [2418] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 09 08:11:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 09 08:26:37 pplxnsms02 pacemaker-controld [2418] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 09 08:26:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 09 08:26:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 09 08:26:37 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 09 08:26:37 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) notice: On loss of quorum: Ignore
Oct 09 08:26:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 09 08:26:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms02 is online
Oct 09 08:26:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 09 08:26:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms01 is online
Oct 09 08:26:37 pplxnsms02 pacemaker-schedulerd[2417] (unpack_rsc_op_failure) warning: Unexpected result (error) was recorded for start of nco_itnm on pplxnsms02 at Oct 8 20:15:42 2024 | rc=1 id=nco_itnm_last_failure_0
Oct 09 08:26:37 pplxnsms02 pacemaker-schedulerd[2417] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Oct 8 20:12:15 2024
Oct 09 08:26:37 pplxnsms02 pacemaker-schedulerd[2417] (pe_get_failcount) info: nco_itnm has failed INFINITY times on pplxnsms02
Oct 09 08:26:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__threshold_reached) warning: nco_itnm cannot run on pplxnsms02 due to reaching migration threshold (clean up resource to allow again)| failures=1000000 migration-threshold=1000000
Oct 09 08:26:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 09 08:26:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 09 08:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_vip (Started pplxnsms01)
Oct 09 08:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms01)
Oct 09 08:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs (Started pplxnsms01)
Oct 09 08:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms01)
Oct 09 08:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms01)
Oct 09 08:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms01)
Oct 09 08:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_omni (Started pplxnsms01)
Oct 09 08:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms01)
Oct 09 08:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms01)
Oct 09 08:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 09 08:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 09 08:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 09 08:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 09 08:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 09 08:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 09 08:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms02)
Oct 09 08:26:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__log_transition_summary) notice: Calculated transition 54, saving inputs in /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 08:26:37 pplxnsms02 pacemaker-schedulerd[2417] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 09 08:26:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 09 08:26:37 pplxnsms02 pacemaker-controld [2418] (do_te_invoke) info: Processing graph 54 (ref=pe_calc-dc-1728433597-182) derived from /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 08:26:37 pplxnsms02 pacemaker-controld [2418] (pcmk__execute_graph) notice: Transition 54 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-1006.bz2): Complete
Oct 09 08:26:37 pplxnsms02 pacemaker-controld [2418] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 09 08:26:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 09 08:41:37 pplxnsms02 pacemaker-controld [2418] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 09 08:41:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 09 08:41:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 09 08:41:37 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 09 08:41:37 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) notice: On loss of quorum: Ignore
Oct 09 08:41:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 09 08:41:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms02 is online
Oct 09 08:41:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 09 08:41:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms01 is online
Oct 09 08:41:37 pplxnsms02 pacemaker-schedulerd[2417] (unpack_rsc_op_failure) warning: Unexpected result (error) was recorded for start of nco_itnm on pplxnsms02 at Oct 8 20:15:42 2024 | rc=1 id=nco_itnm_last_failure_0
Oct 09 08:41:37 pplxnsms02 pacemaker-schedulerd[2417] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Oct 8 20:12:15 2024
Oct 09 08:41:37 pplxnsms02 pacemaker-schedulerd[2417] (pe_get_failcount) info: nco_itnm has failed INFINITY times on pplxnsms02
Oct 09 08:41:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__threshold_reached) warning: nco_itnm cannot run on pplxnsms02 due to reaching migration threshold (clean up resource to allow again)| failures=1000000 migration-threshold=1000000
Oct 09 08:41:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 09 08:41:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 09 08:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_vip (Started pplxnsms01)
Oct 09 08:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms01)
Oct 09 08:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs (Started pplxnsms01)
Oct 09 08:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms01)
Oct 09 08:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms01)
Oct 09 08:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms01)
Oct 09 08:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_omni (Started pplxnsms01)
Oct 09 08:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms01)
Oct 09 08:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms01)
Oct 09 08:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 09 08:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 09 08:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 09 08:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 09 08:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 09 08:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 09 08:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms02)
Oct 09 08:41:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__log_transition_summary) notice: Calculated transition 55, saving inputs in /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 08:41:37 pplxnsms02 pacemaker-schedulerd[2417] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 09 08:41:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 09 08:41:37 pplxnsms02 pacemaker-controld [2418] (do_te_invoke) info: Processing graph 55 (ref=pe_calc-dc-1728434497-183) derived from /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 08:41:37 pplxnsms02 pacemaker-controld [2418] (pcmk__execute_graph) notice: Transition 55 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-1006.bz2): Complete
Oct 09 08:41:37 pplxnsms02 pacemaker-controld [2418] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 09 08:41:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 09 08:56:37 pplxnsms02 pacemaker-controld [2418] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 09 08:56:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 09 08:56:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 09 08:56:37 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 09 08:56:37 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) notice: On loss of quorum: Ignore
Oct 09 08:56:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 09 08:56:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms02 is online
Oct 09 08:56:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 09 08:56:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms01 is online
Oct 09 08:56:37 pplxnsms02 pacemaker-schedulerd[2417] (unpack_rsc_op_failure) warning: Unexpected result (error) was recorded for start of nco_itnm on pplxnsms02 at Oct 8 20:15:42 2024 | rc=1 id=nco_itnm_last_failure_0
Oct 09 08:56:37 pplxnsms02 pacemaker-schedulerd[2417] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Oct 8 20:12:15 2024
Oct 09 08:56:37 pplxnsms02 pacemaker-schedulerd[2417] (pe_get_failcount) info: nco_itnm has failed INFINITY times on pplxnsms02
Oct 09 08:56:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__threshold_reached) warning: nco_itnm cannot run on pplxnsms02 due to reaching migration threshold (clean up resource to allow again)| failures=1000000 migration-threshold=1000000
Oct 09 08:56:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 09 08:56:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 09 08:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_vip (Started pplxnsms01)
Oct 09 08:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms01)
Oct 09 08:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs (Started pplxnsms01)
Oct 09 08:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms01)
Oct 09 08:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms01)
Oct 09 08:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms01)
Oct 09 08:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_omni (Started pplxnsms01)
Oct 09 08:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms01)
Oct 09 08:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms01)
Oct 09 08:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 09 08:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 09 08:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 09 08:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 09 08:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 09 08:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 09 08:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms02)
Oct 09 08:56:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__log_transition_summary) notice: Calculated transition 56, saving inputs in /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 08:56:37 pplxnsms02 pacemaker-schedulerd[2417] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 09 08:56:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 09 08:56:37 pplxnsms02 pacemaker-controld [2418] (do_te_invoke) info: Processing graph 56 (ref=pe_calc-dc-1728435397-184) derived from /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 08:56:37 pplxnsms02 pacemaker-controld [2418] (pcmk__execute_graph) notice: Transition 56 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-1006.bz2): Complete
Oct 09 08:56:37 pplxnsms02 pacemaker-controld [2418] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 09 08:56:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 09 09:11:37 pplxnsms02 pacemaker-controld [2418] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 09 09:11:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 09 09:11:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 09 09:11:37 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 09 09:11:37 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) notice: On loss of quorum: Ignore
Oct 09 09:11:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 09 09:11:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms02 is online
Oct 09 09:11:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 09 09:11:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms01 is online
Oct 09 09:11:37 pplxnsms02 pacemaker-schedulerd[2417] (unpack_rsc_op_failure) warning: Unexpected result (error) was recorded for start of nco_itnm on pplxnsms02 at Oct 8 20:15:42 2024 | rc=1 id=nco_itnm_last_failure_0
Oct 09 09:11:37 pplxnsms02 pacemaker-schedulerd[2417] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Oct 8 20:12:15 2024
Oct 09 09:11:37 pplxnsms02 pacemaker-schedulerd[2417] (pe_get_failcount) info: nco_itnm has failed INFINITY times on pplxnsms02
Oct 09 09:11:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__threshold_reached) warning: nco_itnm cannot run on pplxnsms02 due to reaching migration threshold (clean up resource to allow again)| failures=1000000 migration-threshold=1000000
Oct 09 09:11:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 09 09:11:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 09 09:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_vip (Started pplxnsms01)
Oct 09 09:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms01)
Oct 09 09:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs (Started pplxnsms01)
Oct 09 09:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms01)
Oct 09 09:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms01)
Oct 09 09:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms01)
Oct 09 09:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_omni (Started pplxnsms01)
Oct 09 09:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms01)
Oct 09 09:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms01)
Oct 09 09:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 09 09:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 09 09:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 09 09:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 09 09:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 09 09:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 09 09:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms02)
Oct 09 09:11:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__log_transition_summary) notice: Calculated transition 57, saving inputs in /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 09:11:37 pplxnsms02 pacemaker-schedulerd[2417] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 09 09:11:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 09 09:11:37 pplxnsms02 pacemaker-controld [2418] (do_te_invoke) info: Processing graph 57 (ref=pe_calc-dc-1728436297-185) derived from /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 09:11:37 pplxnsms02 pacemaker-controld [2418] (pcmk__execute_graph) notice: Transition 57 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-1006.bz2): Complete
Oct 09 09:11:37 pplxnsms02 pacemaker-controld [2418] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 09 09:11:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 09 09:26:37 pplxnsms02 pacemaker-controld [2418] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 09 09:26:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 09 09:26:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 09 09:26:37 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 09 09:26:37 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) notice: On loss of quorum: Ignore
Oct 09 09:26:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 09 09:26:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms02 is online
Oct 09 09:26:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 09 09:26:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms01 is online
Oct 09 09:26:37 pplxnsms02 pacemaker-schedulerd[2417] (unpack_rsc_op_failure) warning: Unexpected result (error) was recorded for start of nco_itnm on pplxnsms02 at Oct 8 20:15:42 2024 | rc=1 id=nco_itnm_last_failure_0
Oct 09 09:26:37 pplxnsms02 pacemaker-schedulerd[2417] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Oct 8 20:12:15 2024
Oct 09 09:26:37 pplxnsms02 pacemaker-schedulerd[2417] (pe_get_failcount) info: nco_itnm has failed INFINITY times on pplxnsms02
Oct 09 09:26:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__threshold_reached) warning: nco_itnm cannot run on pplxnsms02 due to reaching migration threshold (clean up resource to allow again)| failures=1000000 migration-threshold=1000000
Oct 09 09:26:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 09 09:26:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 09 09:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_vip (Started pplxnsms01)
Oct 09 09:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms01)
Oct 09 09:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs (Started pplxnsms01)
Oct 09 09:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms01)
Oct 09 09:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms01)
Oct 09 09:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms01)
Oct 09 09:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_omni (Started pplxnsms01)
Oct 09 09:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms01)
Oct 09 09:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms01)
Oct 09 09:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 09 09:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 09 09:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 09 09:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 09 09:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 09 09:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 09 09:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms02)
Oct 09 09:26:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__log_transition_summary) notice: Calculated transition 58, saving inputs in /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 09:26:37 pplxnsms02 pacemaker-schedulerd[2417] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 09 09:26:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 09 09:26:37 pplxnsms02 pacemaker-controld [2418] (do_te_invoke) info: Processing graph 58 (ref=pe_calc-dc-1728437197-186) derived from /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 09:26:37 pplxnsms02 pacemaker-controld [2418] (pcmk__execute_graph) notice: Transition 58 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-1006.bz2): Complete
Oct 09 09:26:37 pplxnsms02 pacemaker-controld [2418] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 09 09:26:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 09 09:41:37 pplxnsms02 pacemaker-controld [2418] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 09 09:41:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 09 09:41:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 09 09:41:37 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 09 09:41:37 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) notice: On loss of quorum: Ignore
Oct 09 09:41:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 09 09:41:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms02 is online
Oct 09 09:41:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 09 09:41:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms01 is online
Oct 09 09:41:37 pplxnsms02 pacemaker-schedulerd[2417] (unpack_rsc_op_failure) warning: Unexpected result (error) was recorded for start of nco_itnm on pplxnsms02 at Oct 8 20:15:42 2024 | rc=1 id=nco_itnm_last_failure_0
Oct 09 09:41:37 pplxnsms02 pacemaker-schedulerd[2417] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Oct 8 20:12:15 2024
Oct 09 09:41:37 pplxnsms02 pacemaker-schedulerd[2417] (pe_get_failcount) info: nco_itnm has failed INFINITY times on pplxnsms02
Oct 09 09:41:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__threshold_reached) warning: nco_itnm cannot run on pplxnsms02 due to reaching migration threshold (clean up resource to allow again)| failures=1000000 migration-threshold=1000000
Oct 09 09:41:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 09 09:41:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 09 09:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_vip (Started pplxnsms01)
Oct 09 09:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms01)
Oct 09 09:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs (Started pplxnsms01)
Oct 09 09:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms01)
Oct 09 09:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms01)
Oct 09 09:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms01)
Oct 09 09:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_omni (Started pplxnsms01)
Oct 09 09:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms01)
Oct 09 09:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms01)
Oct 09 09:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 09 09:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 09 09:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 09 09:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 09 09:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 09 09:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 09 09:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms02)
Oct 09 09:41:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__log_transition_summary) notice: Calculated transition 59, saving inputs in /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 09:41:37 pplxnsms02 pacemaker-schedulerd[2417] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 09 09:41:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 09 09:41:37 pplxnsms02 pacemaker-controld [2418] (do_te_invoke) info: Processing graph 59 (ref=pe_calc-dc-1728438097-187) derived from /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 09:41:37 pplxnsms02 pacemaker-controld [2418] (pcmk__execute_graph) notice: Transition 59 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-1006.bz2): Complete
Oct 09 09:41:37 pplxnsms02 pacemaker-controld [2418] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 09 09:41:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 09 09:56:37 pplxnsms02 pacemaker-controld [2418] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 09 09:56:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 09 09:56:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 09 09:56:37 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 09 09:56:37 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) notice: On loss of quorum: Ignore
Oct 09 09:56:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 09 09:56:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms02 is online
Oct 09 09:56:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 09 09:56:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms01 is online
Oct 09 09:56:37 pplxnsms02 pacemaker-schedulerd[2417] (unpack_rsc_op_failure) warning: Unexpected result (error) was recorded for start of nco_itnm on pplxnsms02 at Oct 8 20:15:42 2024 | rc=1 id=nco_itnm_last_failure_0
Oct 09 09:56:37 pplxnsms02 pacemaker-schedulerd[2417] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Oct 8 20:12:15 2024
Oct 09 09:56:37 pplxnsms02 pacemaker-schedulerd[2417] (pe_get_failcount) info: nco_itnm has failed INFINITY times on pplxnsms02
Oct 09 09:56:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__threshold_reached) warning: nco_itnm cannot run on pplxnsms02 due to reaching migration threshold (clean up resource to allow again)| failures=1000000 migration-threshold=1000000
Oct 09 09:56:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 09 09:56:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 09 09:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_vip (Started pplxnsms01)
Oct 09 09:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms01)
Oct 09 09:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs (Started pplxnsms01)
Oct 09 09:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms01)
Oct 09 09:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms01)
Oct 09 09:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms01)
Oct 09 09:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_omni (Started pplxnsms01)
Oct 09 09:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms01)
Oct 09 09:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms01)
Oct 09 09:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 09 09:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 09 09:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 09 09:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 09 09:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 09 09:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 09 09:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms02)
Oct 09 09:56:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__log_transition_summary) notice: Calculated transition 60, saving inputs in /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 09:56:37 pplxnsms02 pacemaker-schedulerd[2417] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 09 09:56:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 09 09:56:37 pplxnsms02 pacemaker-controld [2418] (do_te_invoke) info: Processing graph 60 (ref=pe_calc-dc-1728438997-188) derived from /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 09:56:37 pplxnsms02 pacemaker-controld [2418] (pcmk__execute_graph) notice: Transition 60 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-1006.bz2): Complete
Oct 09 09:56:37 pplxnsms02 pacemaker-controld [2418] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 09 09:56:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 09 10:11:37 pplxnsms02 pacemaker-controld [2418] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 09 10:11:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 09 10:11:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 09 10:11:37 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 09 10:11:37 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) notice: On loss of quorum: Ignore
Oct 09 10:11:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 09 10:11:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms02 is online
Oct 09 10:11:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 09 10:11:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms01 is online
Oct 09 10:11:37 pplxnsms02 pacemaker-schedulerd[2417] (unpack_rsc_op_failure) warning: Unexpected result (error) was recorded for start of nco_itnm on pplxnsms02 at Oct 8 20:15:42 2024 | rc=1 id=nco_itnm_last_failure_0
Oct 09 10:11:37 pplxnsms02 pacemaker-schedulerd[2417] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Oct 8 20:12:15 2024
Oct 09 10:11:37 pplxnsms02 pacemaker-schedulerd[2417] (pe_get_failcount) info: nco_itnm has failed INFINITY times on pplxnsms02
Oct 09 10:11:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__threshold_reached) warning: nco_itnm cannot run on pplxnsms02 due to reaching migration threshold (clean up resource to allow again)| failures=1000000 migration-threshold=1000000
Oct 09 10:11:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 09 10:11:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 09 10:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_vip (Started pplxnsms01)
Oct 09 10:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms01)
Oct 09 10:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs (Started pplxnsms01)
Oct 09 10:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms01)
Oct 09 10:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms01)
Oct 09 10:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms01)
Oct 09 10:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_omni (Started pplxnsms01)
Oct 09 10:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms01)
Oct 09 10:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms01)
Oct 09 10:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 09 10:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 09 10:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 09 10:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 09 10:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 09 10:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 09 10:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms02)
Oct 09 10:11:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__log_transition_summary) notice: Calculated transition 61, saving inputs in /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 10:11:37 pplxnsms02 pacemaker-schedulerd[2417] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 09 10:11:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 09 10:11:37 pplxnsms02 pacemaker-controld [2418] (do_te_invoke) info: Processing graph 61 (ref=pe_calc-dc-1728439897-189) derived from /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 10:11:37 pplxnsms02 pacemaker-controld [2418] (pcmk__execute_graph) notice: Transition 61 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-1006.bz2): Complete
Oct 09 10:11:37 pplxnsms02 pacemaker-controld [2418] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 09 10:11:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 09 10:26:37 pplxnsms02 pacemaker-controld [2418] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 09 10:26:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 09 10:26:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 09 10:26:37 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 09 10:26:37 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) notice: On loss of quorum: Ignore
Oct 09 10:26:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 09 10:26:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms02 is online
Oct 09 10:26:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 09 10:26:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms01 is online
Oct 09 10:26:37 pplxnsms02 pacemaker-schedulerd[2417] (unpack_rsc_op_failure) warning: Unexpected result (error) was recorded for start of nco_itnm on pplxnsms02 at Oct 8 20:15:42 2024 | rc=1 id=nco_itnm_last_failure_0
Oct 09 10:26:37 pplxnsms02 pacemaker-schedulerd[2417] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Oct 8 20:12:15 2024
Oct 09 10:26:37 pplxnsms02 pacemaker-schedulerd[2417] (pe_get_failcount) info: nco_itnm has failed INFINITY times on pplxnsms02
Oct 09 10:26:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__threshold_reached) warning: nco_itnm cannot run on pplxnsms02 due to reaching migration threshold (clean up resource to allow again)| failures=1000000 migration-threshold=1000000
Oct 09 10:26:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 09 10:26:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 09 10:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_vip (Started pplxnsms01)
Oct 09 10:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms01)
Oct 09 10:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs (Started pplxnsms01)
Oct 09 10:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms01)
Oct 09 10:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms01)
Oct 09 10:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms01)
Oct 09 10:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_omni (Started pplxnsms01)
Oct 09 10:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms01)
Oct 09 10:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms01)
Oct 09 10:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 09 10:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 09 10:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 09 10:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 09 10:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 09 10:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 09 10:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms02)
Oct 09 10:26:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__log_transition_summary) notice: Calculated transition 62, saving inputs in /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 10:26:37 pplxnsms02 pacemaker-schedulerd[2417] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 09 10:26:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 09 10:26:37 pplxnsms02 pacemaker-controld [2418] (do_te_invoke) info: Processing graph 62 (ref=pe_calc-dc-1728440797-190) derived from /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 10:26:37 pplxnsms02 pacemaker-controld [2418] (pcmk__execute_graph) notice: Transition 62 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-1006.bz2): Complete
Oct 09 10:26:37 pplxnsms02 pacemaker-controld [2418] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 09 10:26:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 09 10:41:37 pplxnsms02 pacemaker-controld [2418] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 09 10:41:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 09 10:41:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 09 10:41:37 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 09 10:41:37 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) notice: On loss of quorum: Ignore
Oct 09 10:41:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 09 10:41:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms02 is online
Oct 09 10:41:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 09 10:41:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms01 is online
Oct 09 10:41:37 pplxnsms02 pacemaker-schedulerd[2417] (unpack_rsc_op_failure) warning: Unexpected result (error) was recorded for start of nco_itnm on pplxnsms02 at Oct 8 20:15:42 2024 | rc=1 id=nco_itnm_last_failure_0
Oct 09 10:41:37 pplxnsms02 pacemaker-schedulerd[2417] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Oct 8 20:12:15 2024
Oct 09 10:41:37 pplxnsms02 pacemaker-schedulerd[2417] (pe_get_failcount) info: nco_itnm has failed INFINITY times on pplxnsms02
Oct 09 10:41:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__threshold_reached) warning: nco_itnm cannot run on pplxnsms02 due to reaching migration threshold (clean up resource to allow again)| failures=1000000 migration-threshold=1000000
Oct 09 10:41:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 09 10:41:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 09 10:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_vip (Started pplxnsms01)
Oct 09 10:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms01)
Oct 09 10:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs (Started pplxnsms01)
Oct 09 10:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms01)
Oct 09 10:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms01)
Oct 09 10:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms01)
Oct 09 10:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_omni (Started pplxnsms01)
Oct 09 10:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms01)
Oct 09 10:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms01)
Oct 09 10:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 09 10:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 09 10:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 09 10:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 09 10:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 09 10:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 09 10:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms02)
Oct 09 10:41:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__log_transition_summary) notice: Calculated transition 63, saving inputs in /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 10:41:37 pplxnsms02 pacemaker-schedulerd[2417] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 09 10:41:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 09 10:41:37 pplxnsms02 pacemaker-controld [2418] (do_te_invoke) info: Processing graph 63 (ref=pe_calc-dc-1728441697-191) derived from /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 10:41:37 pplxnsms02 pacemaker-controld [2418] (pcmk__execute_graph) notice: Transition 63 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-1006.bz2): Complete
Oct 09 10:41:37 pplxnsms02 pacemaker-controld [2418] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 09 10:41:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 09 10:56:37 pplxnsms02 pacemaker-controld [2418] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 09 10:56:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 09 10:56:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 09 10:56:37 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 09 10:56:37 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) notice: On loss of quorum: Ignore
Oct 09 10:56:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 09 10:56:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms02 is online
Oct 09 10:56:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 09 10:56:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms01 is online
Oct 09 10:56:37 pplxnsms02 pacemaker-schedulerd[2417] (unpack_rsc_op_failure) warning: Unexpected result (error) was recorded for start of nco_itnm on pplxnsms02 at Oct 8 20:15:42 2024 | rc=1 id=nco_itnm_last_failure_0
Oct 09 10:56:37 pplxnsms02 pacemaker-schedulerd[2417] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Oct 8 20:12:15 2024
Oct 09 10:56:37 pplxnsms02 pacemaker-schedulerd[2417] (pe_get_failcount) info: nco_itnm has failed INFINITY times on pplxnsms02
Oct 09 10:56:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__threshold_reached) warning: nco_itnm cannot run on pplxnsms02 due to reaching migration threshold (clean up resource to allow again)| failures=1000000 migration-threshold=1000000
Oct 09 10:56:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 09 10:56:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 09 10:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_vip (Started pplxnsms01)
Oct 09 10:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms01)
Oct 09 10:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs (Started pplxnsms01)
Oct 09 10:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms01)
Oct 09 10:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms01)
Oct 09 10:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms01)
Oct 09 10:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_omni (Started pplxnsms01)
Oct 09 10:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms01)
Oct 09 10:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms01)
Oct 09 10:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 09 10:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 09 10:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 09 10:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 09 10:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 09 10:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 09 10:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms02)
Oct 09 10:56:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__log_transition_summary) notice: Calculated transition 64, saving inputs in /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 10:56:37 pplxnsms02 pacemaker-schedulerd[2417] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 09 10:56:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 09 10:56:37 pplxnsms02 pacemaker-controld [2418] (do_te_invoke) info: Processing graph 64 (ref=pe_calc-dc-1728442597-192) derived from /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 10:56:37 pplxnsms02 pacemaker-controld [2418] (pcmk__execute_graph) notice: Transition 64 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-1006.bz2): Complete
Oct 09 10:56:37 pplxnsms02 pacemaker-controld [2418] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 09 10:56:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 09 11:11:37 pplxnsms02 pacemaker-controld [2418] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 09 11:11:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 09 11:11:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 09 11:11:37 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 09 11:11:37 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) notice: On loss of quorum: Ignore
Oct 09 11:11:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 09 11:11:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms02 is online
Oct 09 11:11:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 09 11:11:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms01 is online
Oct 09 11:11:37 pplxnsms02 pacemaker-schedulerd[2417] (unpack_rsc_op_failure) warning: Unexpected result (error) was recorded for start of nco_itnm on pplxnsms02 at Oct 8 20:15:42 2024 | rc=1 id=nco_itnm_last_failure_0
Oct 09 11:11:37 pplxnsms02 pacemaker-schedulerd[2417] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Oct 8 20:12:15 2024
Oct 09 11:11:37 pplxnsms02 pacemaker-schedulerd[2417] (pe_get_failcount) info: nco_itnm has failed INFINITY times on pplxnsms02
Oct 09 11:11:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__threshold_reached) warning: nco_itnm cannot run on pplxnsms02 due to reaching migration threshold (clean up resource to allow again)| failures=1000000 migration-threshold=1000000
Oct 09 11:11:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 09 11:11:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 09 11:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_vip (Started pplxnsms01)
Oct 09 11:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms01)
Oct 09 11:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs (Started pplxnsms01)
Oct 09 11:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms01)
Oct 09 11:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms01)
Oct 09 11:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms01)
Oct 09 11:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_omni (Started pplxnsms01)
Oct 09 11:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms01)
Oct 09 11:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms01)
Oct 09 11:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 09 11:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 09 11:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 09 11:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 09 11:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 09 11:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 09 11:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms02)
Oct 09 11:11:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__log_transition_summary) notice: Calculated transition 65, saving inputs in /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 11:11:37 pplxnsms02 pacemaker-schedulerd[2417] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 09 11:11:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 09 11:11:37 pplxnsms02 pacemaker-controld [2418] (do_te_invoke) info: Processing graph 65 (ref=pe_calc-dc-1728443497-193) derived from /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 11:11:37 pplxnsms02 pacemaker-controld [2418] (pcmk__execute_graph) notice: Transition 65 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-1006.bz2): Complete
Oct 09 11:11:37 pplxnsms02 pacemaker-controld [2418] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 09 11:11:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 09 11:26:37 pplxnsms02 pacemaker-controld [2418] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 09 11:26:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 09 11:26:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 09 11:26:37 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 09 11:26:37 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) notice: On loss of quorum: Ignore
Oct 09 11:26:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 09 11:26:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms02 is online
Oct 09 11:26:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 09 11:26:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms01 is online
Oct 09 11:26:37 pplxnsms02 pacemaker-schedulerd[2417] (unpack_rsc_op_failure) warning: Unexpected result (error) was recorded for start of nco_itnm on pplxnsms02 at Oct 8 20:15:42 2024 | rc=1 id=nco_itnm_last_failure_0
Oct 09 11:26:37 pplxnsms02 pacemaker-schedulerd[2417] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Oct 8 20:12:15 2024
Oct 09 11:26:37 pplxnsms02 pacemaker-schedulerd[2417] (pe_get_failcount) info: nco_itnm has failed INFINITY times on pplxnsms02
Oct 09 11:26:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__threshold_reached) warning: nco_itnm cannot run on pplxnsms02 due to reaching migration threshold (clean up resource to allow again)| failures=1000000 migration-threshold=1000000
Oct 09 11:26:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 09 11:26:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 09 11:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_vip (Started pplxnsms01)
Oct 09 11:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms01)
Oct 09 11:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs (Started pplxnsms01)
Oct 09 11:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms01)
Oct 09 11:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms01)
Oct 09 11:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms01)
Oct 09 11:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_omni (Started pplxnsms01)
Oct 09 11:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms01)
Oct 09 11:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms01)
Oct 09 11:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 09 11:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 09 11:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 09 11:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 09 11:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 09 11:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 09 11:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms02)
Oct 09 11:26:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__log_transition_summary) notice: Calculated transition 66, saving inputs in /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 11:26:37 pplxnsms02 pacemaker-schedulerd[2417] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 09 11:26:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 09 11:26:37 pplxnsms02 pacemaker-controld [2418] (do_te_invoke) info: Processing graph 66 (ref=pe_calc-dc-1728444397-194) derived from /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 11:26:37 pplxnsms02 pacemaker-controld [2418] (pcmk__execute_graph) notice: Transition 66 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-1006.bz2): Complete
Oct 09 11:26:37 pplxnsms02 pacemaker-controld [2418] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 09 11:26:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 09 11:41:37 pplxnsms02 pacemaker-controld [2418] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 09 11:41:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 09 11:41:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 09 11:41:37 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 09 11:41:37 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) notice: On loss of quorum: Ignore
Oct 09 11:41:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 09 11:41:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms02 is online
Oct 09 11:41:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 09 11:41:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms01 is online
Oct 09 11:41:37 pplxnsms02 pacemaker-schedulerd[2417] (unpack_rsc_op_failure) warning: Unexpected result (error) was recorded for start of nco_itnm on pplxnsms02 at Oct 8 20:15:42 2024 | rc=1 id=nco_itnm_last_failure_0
Oct 09 11:41:37 pplxnsms02 pacemaker-schedulerd[2417] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Oct 8 20:12:15 2024
Oct 09 11:41:37 pplxnsms02 pacemaker-schedulerd[2417] (pe_get_failcount) info: nco_itnm has failed INFINITY times on pplxnsms02
Oct 09 11:41:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__threshold_reached) warning: nco_itnm cannot run on pplxnsms02 due to reaching migration threshold (clean up resource to allow again)| failures=1000000 migration-threshold=1000000
Oct 09 11:41:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 09 11:41:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 09 11:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_vip (Started pplxnsms01)
Oct 09 11:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms01)
Oct 09 11:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs (Started pplxnsms01)
Oct 09 11:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms01)
Oct 09 11:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms01)
Oct 09 11:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms01)
Oct 09 11:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_omni (Started pplxnsms01)
Oct 09 11:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms01)
Oct 09 11:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms01)
Oct 09 11:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 09 11:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 09 11:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 09 11:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 09 11:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 09 11:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 09 11:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms02)
Oct 09 11:41:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__log_transition_summary) notice: Calculated transition 67, saving inputs in /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 11:41:37 pplxnsms02 pacemaker-schedulerd[2417] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 09 11:41:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 09 11:41:37 pplxnsms02 pacemaker-controld [2418] (do_te_invoke) info: Processing graph 67 (ref=pe_calc-dc-1728445297-195) derived from /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 11:41:37 pplxnsms02 pacemaker-controld [2418] (pcmk__execute_graph) notice: Transition 67 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-1006.bz2): Complete
Oct 09 11:41:37 pplxnsms02 pacemaker-controld [2418] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 09 11:41:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 09 11:56:37 pplxnsms02 pacemaker-controld [2418] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 09 11:56:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 09 11:56:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 09 11:56:37 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 09 11:56:37 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) notice: On loss of quorum: Ignore
Oct 09 11:56:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 09 11:56:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms02 is online
Oct 09 11:56:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 09 11:56:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms01 is online
Oct 09 11:56:37 pplxnsms02 pacemaker-schedulerd[2417] (unpack_rsc_op_failure) warning: Unexpected result (error) was recorded for start of nco_itnm on pplxnsms02 at Oct 8 20:15:42 2024 | rc=1 id=nco_itnm_last_failure_0
Oct 09 11:56:37 pplxnsms02 pacemaker-schedulerd[2417] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Oct 8 20:12:15 2024
Oct 09 11:56:37 pplxnsms02 pacemaker-schedulerd[2417] (pe_get_failcount) info: nco_itnm has failed INFINITY times on pplxnsms02
Oct 09 11:56:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__threshold_reached) warning: nco_itnm cannot run on pplxnsms02 due to reaching migration threshold (clean up resource to allow again)| failures=1000000 migration-threshold=1000000
Oct 09 11:56:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 09 11:56:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 09 11:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_vip (Started pplxnsms01)
Oct 09 11:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms01)
Oct 09 11:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs (Started pplxnsms01)
Oct 09 11:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms01)
Oct 09 11:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms01)
Oct 09 11:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms01)
Oct 09 11:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_omni (Started pplxnsms01)
Oct 09 11:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms01)
Oct 09 11:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms01)
Oct 09 11:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 09 11:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 09 11:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 09 11:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 09 11:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 09 11:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 09 11:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms02)
Oct 09 11:56:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__log_transition_summary) notice: Calculated transition 68, saving inputs in /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 11:56:37 pplxnsms02 pacemaker-schedulerd[2417] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 09 11:56:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 09 11:56:37 pplxnsms02 pacemaker-controld [2418] (do_te_invoke) info: Processing graph 68 (ref=pe_calc-dc-1728446197-196) derived from /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 11:56:37 pplxnsms02 pacemaker-controld [2418] (pcmk__execute_graph) notice: Transition 68 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-1006.bz2): Complete
Oct 09 11:56:37 pplxnsms02 pacemaker-controld [2418] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 09 11:56:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 09 12:11:37 pplxnsms02 pacemaker-controld [2418] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 09 12:11:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 09 12:11:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 09 12:11:37 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 09 12:11:37 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) notice: On loss of quorum: Ignore
Oct 09 12:11:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 09 12:11:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms02 is online
Oct 09 12:11:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 09 12:11:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms01 is online
Oct 09 12:11:37 pplxnsms02 pacemaker-schedulerd[2417] (unpack_rsc_op_failure) warning: Unexpected result (error) was recorded for start of nco_itnm on pplxnsms02 at Oct 8 20:15:42 2024 | rc=1 id=nco_itnm_last_failure_0
Oct 09 12:11:37 pplxnsms02 pacemaker-schedulerd[2417] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Oct 8 20:12:15 2024
Oct 09 12:11:37 pplxnsms02 pacemaker-schedulerd[2417] (pe_get_failcount) info: nco_itnm has failed INFINITY times on pplxnsms02
Oct 09 12:11:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__threshold_reached) warning: nco_itnm cannot run on pplxnsms02 due to reaching migration threshold (clean up resource to allow again)| failures=1000000 migration-threshold=1000000
Oct 09 12:11:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 09 12:11:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 09 12:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_vip (Started pplxnsms01)
Oct 09 12:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms01)
Oct 09 12:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs (Started pplxnsms01)
Oct 09 12:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms01)
Oct 09 12:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms01)
Oct 09 12:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms01)
Oct 09 12:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_omni (Started pplxnsms01)
Oct 09 12:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms01)
Oct 09 12:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms01)
Oct 09 12:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 09 12:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 09 12:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 09 12:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 09 12:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 09 12:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 09 12:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms02)
Oct 09 12:11:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__log_transition_summary) notice: Calculated transition 69, saving inputs in /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 12:11:37 pplxnsms02 pacemaker-schedulerd[2417] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 09 12:11:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 09 12:11:37 pplxnsms02 pacemaker-controld [2418] (do_te_invoke) info: Processing graph 69 (ref=pe_calc-dc-1728447097-197) derived from /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 12:11:37 pplxnsms02 pacemaker-controld [2418] (pcmk__execute_graph) notice: Transition 69 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-1006.bz2): Complete
Oct 09 12:11:37 pplxnsms02 pacemaker-controld [2418] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 09 12:11:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 09 12:26:37 pplxnsms02 pacemaker-controld [2418] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 09 12:26:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 09 12:26:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 09 12:26:37 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 09 12:26:37 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) notice: On loss of quorum: Ignore
Oct 09 12:26:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 09 12:26:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms02 is online
Oct 09 12:26:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 09 12:26:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms01 is online
Oct 09 12:26:37 pplxnsms02 pacemaker-schedulerd[2417] (unpack_rsc_op_failure) warning: Unexpected result (error) was recorded for start of nco_itnm on pplxnsms02 at Oct 8 20:15:42 2024 | rc=1 id=nco_itnm_last_failure_0
Oct 09 12:26:37 pplxnsms02 pacemaker-schedulerd[2417] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Oct 8 20:12:15 2024
Oct 09 12:26:37 pplxnsms02 pacemaker-schedulerd[2417] (pe_get_failcount) info: nco_itnm has failed INFINITY times on pplxnsms02
Oct 09 12:26:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__threshold_reached) warning: nco_itnm cannot run on pplxnsms02 due to reaching migration threshold (clean up resource to allow again)| failures=1000000 migration-threshold=1000000
Oct 09 12:26:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 09 12:26:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 09 12:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_vip (Started pplxnsms01)
Oct 09 12:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms01)
Oct 09 12:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs (Started pplxnsms01)
Oct 09 12:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms01)
Oct 09 12:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms01)
Oct 09 12:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms01)
Oct 09 12:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_omni (Started pplxnsms01)
Oct 09 12:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms01)
Oct 09 12:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms01)
Oct 09 12:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 09 12:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 09 12:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 09 12:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 09 12:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 09 12:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 09 12:26:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms02)
Oct 09 12:26:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__log_transition_summary) notice: Calculated transition 70, saving inputs in /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 12:26:37 pplxnsms02 pacemaker-schedulerd[2417] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 09 12:26:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 09 12:26:37 pplxnsms02 pacemaker-controld [2418] (do_te_invoke) info: Processing graph 70 (ref=pe_calc-dc-1728447997-198) derived from /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 12:26:37 pplxnsms02 pacemaker-controld [2418] (pcmk__execute_graph) notice: Transition 70 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-1006.bz2): Complete
Oct 09 12:26:37 pplxnsms02 pacemaker-controld [2418] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 09 12:26:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 09 12:41:37 pplxnsms02 pacemaker-controld [2418] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 09 12:41:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 09 12:41:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 09 12:41:37 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 09 12:41:37 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) notice: On loss of quorum: Ignore
Oct 09 12:41:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 09 12:41:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms02 is online
Oct 09 12:41:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 09 12:41:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms01 is online
Oct 09 12:41:37 pplxnsms02 pacemaker-schedulerd[2417] (unpack_rsc_op_failure) warning: Unexpected result (error) was recorded for start of nco_itnm on pplxnsms02 at Oct 8 20:15:42 2024 | rc=1 id=nco_itnm_last_failure_0
Oct 09 12:41:37 pplxnsms02 pacemaker-schedulerd[2417] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Oct 8 20:12:15 2024
Oct 09 12:41:37 pplxnsms02 pacemaker-schedulerd[2417] (pe_get_failcount) info: nco_itnm has failed INFINITY times on pplxnsms02
Oct 09 12:41:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__threshold_reached) warning: nco_itnm cannot run on pplxnsms02 due to reaching migration threshold (clean up resource to allow again)| failures=1000000 migration-threshold=1000000
Oct 09 12:41:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 09 12:41:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 09 12:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_vip (Started pplxnsms01)
Oct 09 12:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms01)
Oct 09 12:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs (Started pplxnsms01)
Oct 09 12:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms01)
Oct 09 12:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms01)
Oct 09 12:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms01)
Oct 09 12:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_omni (Started pplxnsms01)
Oct 09 12:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms01)
Oct 09 12:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms01)
Oct 09 12:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 09 12:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 09 12:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 09 12:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 09 12:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 09 12:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 09 12:41:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms02)
Oct 09 12:41:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__log_transition_summary) notice: Calculated transition 71, saving inputs in /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 12:41:37 pplxnsms02 pacemaker-schedulerd[2417] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 09 12:41:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 09 12:41:37 pplxnsms02 pacemaker-controld [2418] (do_te_invoke) info: Processing graph 71 (ref=pe_calc-dc-1728448897-199) derived from /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 12:41:37 pplxnsms02 pacemaker-controld [2418] (pcmk__execute_graph) notice: Transition 71 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-1006.bz2): Complete
Oct 09 12:41:37 pplxnsms02 pacemaker-controld [2418] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 09 12:41:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 09 12:56:37 pplxnsms02 pacemaker-controld [2418] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 09 12:56:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 09 12:56:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 09 12:56:37 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 09 12:56:37 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) notice: On loss of quorum: Ignore
Oct 09 12:56:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 09 12:56:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms02 is online
Oct 09 12:56:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 09 12:56:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms01 is online
Oct 09 12:56:37 pplxnsms02 pacemaker-schedulerd[2417] (unpack_rsc_op_failure) warning: Unexpected result (error) was recorded for start of nco_itnm on pplxnsms02 at Oct 8 20:15:42 2024 | rc=1 id=nco_itnm_last_failure_0
Oct 09 12:56:37 pplxnsms02 pacemaker-schedulerd[2417] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Oct 8 20:12:15 2024
Oct 09 12:56:37 pplxnsms02 pacemaker-schedulerd[2417] (pe_get_failcount) info: nco_itnm has failed INFINITY times on pplxnsms02
Oct 09 12:56:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__threshold_reached) warning: nco_itnm cannot run on pplxnsms02 due to reaching migration threshold (clean up resource to allow again)| failures=1000000 migration-threshold=1000000
Oct 09 12:56:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 09 12:56:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 09 12:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_vip (Started pplxnsms01)
Oct 09 12:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms01)
Oct 09 12:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs (Started pplxnsms01)
Oct 09 12:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms01)
Oct 09 12:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms01)
Oct 09 12:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms01)
Oct 09 12:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_omni (Started pplxnsms01)
Oct 09 12:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms01)
Oct 09 12:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms01)
Oct 09 12:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 09 12:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 09 12:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 09 12:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 09 12:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 09 12:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 09 12:56:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms02)
Oct 09 12:56:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__log_transition_summary) notice: Calculated transition 72, saving inputs in /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 12:56:37 pplxnsms02 pacemaker-schedulerd[2417] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 09 12:56:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 09 12:56:37 pplxnsms02 pacemaker-controld [2418] (do_te_invoke) info: Processing graph 72 (ref=pe_calc-dc-1728449797-200) derived from /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 12:56:37 pplxnsms02 pacemaker-controld [2418] (pcmk__execute_graph) notice: Transition 72 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-1006.bz2): Complete
Oct 09 12:56:37 pplxnsms02 pacemaker-controld [2418] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 09 12:56:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 09 13:11:37 pplxnsms02 pacemaker-controld [2418] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 09 13:11:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 09 13:11:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 09 13:11:37 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 09 13:11:37 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) notice: On loss of quorum: Ignore
Oct 09 13:11:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 09 13:11:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms02 is online
Oct 09 13:11:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 09 13:11:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms01 is online
Oct 09 13:11:37 pplxnsms02 pacemaker-schedulerd[2417] (unpack_rsc_op_failure) warning: Unexpected result (error) was recorded for start of nco_itnm on pplxnsms02 at Oct 8 20:15:42 2024 | rc=1 id=nco_itnm_last_failure_0
Oct 09 13:11:37 pplxnsms02 pacemaker-schedulerd[2417] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Oct 8 20:12:15 2024
Oct 09 13:11:37 pplxnsms02 pacemaker-schedulerd[2417] (pe_get_failcount) info: nco_itnm has failed INFINITY times on pplxnsms02
Oct 09 13:11:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__threshold_reached) warning: nco_itnm cannot run on pplxnsms02 due to reaching migration threshold (clean up resource to allow again)| failures=1000000 migration-threshold=1000000
Oct 09 13:11:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 09 13:11:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 09 13:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_vip (Started pplxnsms01)
Oct 09 13:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms01)
Oct 09 13:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs (Started pplxnsms01)
Oct 09 13:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms01)
Oct 09 13:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms01)
Oct 09 13:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms01)
Oct 09 13:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_omni (Started pplxnsms01)
Oct 09 13:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms01)
Oct 09 13:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms01)
Oct 09 13:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 09 13:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 09 13:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 09 13:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 09 13:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 09 13:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 09 13:11:37 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms02)
Oct 09 13:11:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__log_transition_summary) notice: Calculated transition 73, saving inputs in /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 13:11:37 pplxnsms02 pacemaker-schedulerd[2417] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 09 13:11:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 09 13:11:37 pplxnsms02 pacemaker-controld [2418] (do_te_invoke) info: Processing graph 73 (ref=pe_calc-dc-1728450697-201) derived from /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 13:11:37 pplxnsms02 pacemaker-controld [2418] (pcmk__execute_graph) notice: Transition 73 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-1006.bz2): Complete
Oct 09 13:11:37 pplxnsms02 pacemaker-controld [2418] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 09 13:11:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 09 13:26:37 pplxnsms02 pacemaker-controld [2418] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 09 13:26:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 09 13:26:37 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 09 13:26:37 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 09 13:26:37 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) notice: On loss of quorum: Ignore
Oct 09 13:26:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 09 13:26:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms02 is online
Oct 09 13:26:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 09 13:26:37 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms01 is online
Oct 09 13:26:37 pplxnsms02 pacemaker-schedulerd[2417] (unpack_rsc_op_failure) warning: Unexpected result (error) was recorded for start of nco_itnm on pplxnsms02 at Oct 8 20:15:42 2024 | rc=1 id=nco_itnm_last_failure_0
Oct 09 13:26:37 pplxnsms02 pacemaker-schedulerd[2417] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Oct 8 20:12:15 2024
Oct 09 13:26:37 pplxnsms02 pacemaker-schedulerd[2417] (pe_get_failcount) info: nco_itnm has failed INFINITY times on pplxnsms02
Oct 09 13:26:37 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__threshold_reached) warning: nco_itnm cannot run on pplxnsms02 due to reaching migration threshold (clean up resource to allow again)| failures=1000000 migration-threshold=1000000
Oct 09 13:26:38 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 09 13:26:38 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 09 13:26:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_vip (Started pplxnsms01)
Oct 09 13:26:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms01)
Oct 09 13:26:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs (Started pplxnsms01)
Oct 09 13:26:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms01)
Oct 09 13:26:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms01)
Oct 09 13:26:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms01)
Oct 09 13:26:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_omni (Started pplxnsms01)
Oct 09 13:26:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms01)
Oct 09 13:26:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms01)
Oct 09 13:26:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 09 13:26:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 09 13:26:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 09 13:26:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 09 13:26:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 09 13:26:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 09 13:26:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms02)
Oct 09 13:26:38 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__log_transition_summary) notice: Calculated transition 74, saving inputs in /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 13:26:38 pplxnsms02 pacemaker-schedulerd[2417] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 09 13:26:38 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 09 13:26:38 pplxnsms02 pacemaker-controld [2418] (do_te_invoke) info: Processing graph 74 (ref=pe_calc-dc-1728451597-202) derived from /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 13:26:38 pplxnsms02 pacemaker-controld [2418] (pcmk__execute_graph) notice: Transition 74 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-1006.bz2): Complete
Oct 09 13:26:38 pplxnsms02 pacemaker-controld [2418] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 09 13:26:38 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 09 13:41:38 pplxnsms02 pacemaker-controld [2418] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 09 13:41:38 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 09 13:41:38 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 09 13:41:38 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 09 13:41:38 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) notice: On loss of quorum: Ignore
Oct 09 13:41:38 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 09 13:41:38 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms02 is online
Oct 09 13:41:38 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 09 13:41:38 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms01 is online
Oct 09 13:41:38 pplxnsms02 pacemaker-schedulerd[2417] (unpack_rsc_op_failure) warning: Unexpected result (error) was recorded for start of nco_itnm on pplxnsms02 at Oct 8 20:15:42 2024 | rc=1 id=nco_itnm_last_failure_0
Oct 09 13:41:38 pplxnsms02 pacemaker-schedulerd[2417] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Oct 8 20:12:15 2024
Oct 09 13:41:38 pplxnsms02 pacemaker-schedulerd[2417] (pe_get_failcount) info: nco_itnm has failed INFINITY times on pplxnsms02
Oct 09 13:41:38 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__threshold_reached) warning: nco_itnm cannot run on pplxnsms02 due to reaching migration threshold (clean up resource to allow again)| failures=1000000 migration-threshold=1000000
Oct 09 13:41:38 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 09 13:41:38 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 09 13:41:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_vip (Started pplxnsms01)
Oct 09 13:41:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms01)
Oct 09 13:41:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs (Started pplxnsms01)
Oct 09 13:41:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms01)
Oct 09 13:41:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms01)
Oct 09 13:41:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms01)
Oct 09 13:41:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_omni (Started pplxnsms01)
Oct 09 13:41:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms01)
Oct 09 13:41:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms01)
Oct 09 13:41:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 09 13:41:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 09 13:41:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 09 13:41:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 09 13:41:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 09 13:41:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 09 13:41:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms02)
Oct 09 13:41:38 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__log_transition_summary) notice: Calculated transition 75, saving inputs in /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 13:41:38 pplxnsms02 pacemaker-schedulerd[2417] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 09 13:41:38 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 09 13:41:38 pplxnsms02 pacemaker-controld [2418] (do_te_invoke) info: Processing graph 75 (ref=pe_calc-dc-1728452498-203) derived from /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 13:41:38 pplxnsms02 pacemaker-controld [2418] (pcmk__execute_graph) notice: Transition 75 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-1006.bz2): Complete
Oct 09 13:41:38 pplxnsms02 pacemaker-controld [2418] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 09 13:41:38 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 09 13:56:38 pplxnsms02 pacemaker-controld [2418] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 09 13:56:38 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 09 13:56:38 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 09 13:56:38 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 09 13:56:38 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) notice: On loss of quorum: Ignore
Oct 09 13:56:38 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 09 13:56:38 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms02 is online
Oct 09 13:56:38 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 09 13:56:38 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms01 is online
Oct 09 13:56:38 pplxnsms02 pacemaker-schedulerd[2417] (unpack_rsc_op_failure) warning: Unexpected result (error) was recorded for start of nco_itnm on pplxnsms02 at Oct 8 20:15:42 2024 | rc=1 id=nco_itnm_last_failure_0
Oct 09 13:56:38 pplxnsms02 pacemaker-schedulerd[2417] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Oct 8 20:12:15 2024
Oct 09 13:56:38 pplxnsms02 pacemaker-schedulerd[2417] (pe_get_failcount) info: nco_itnm has failed INFINITY times on pplxnsms02
Oct 09 13:56:38 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__threshold_reached) warning: nco_itnm cannot run on pplxnsms02 due to reaching migration threshold (clean up resource to allow again)| failures=1000000 migration-threshold=1000000
Oct 09 13:56:38 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 09 13:56:38 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 09 13:56:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_vip (Started pplxnsms01)
Oct 09 13:56:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms01)
Oct 09 13:56:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs (Started pplxnsms01)
Oct 09 13:56:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms01)
Oct 09 13:56:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms01)
Oct 09 13:56:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms01)
Oct 09 13:56:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_omni (Started pplxnsms01)
Oct 09 13:56:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms01)
Oct 09 13:56:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms01)
Oct 09 13:56:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 09 13:56:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 09 13:56:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 09 13:56:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 09 13:56:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 09 13:56:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 09 13:56:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms02)
Oct 09 13:56:38 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__log_transition_summary) notice: Calculated transition 76, saving inputs in /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 13:56:38 pplxnsms02 pacemaker-schedulerd[2417] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 09 13:56:38 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 09 13:56:38 pplxnsms02 pacemaker-controld [2418] (do_te_invoke) info: Processing graph 76 (ref=pe_calc-dc-1728453398-204) derived from /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 13:56:38 pplxnsms02 pacemaker-controld [2418] (pcmk__execute_graph) notice: Transition 76 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-1006.bz2): Complete
Oct 09 13:56:38 pplxnsms02 pacemaker-controld [2418] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 09 13:56:38 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 09 14:11:38 pplxnsms02 pacemaker-controld [2418] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 09 14:11:38 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 09 14:11:38 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 09 14:11:38 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 09 14:11:38 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) notice: On loss of quorum: Ignore
Oct 09 14:11:38 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 09 14:11:38 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms02 is online
Oct 09 14:11:38 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 09 14:11:38 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms01 is online
Oct 09 14:11:38 pplxnsms02 pacemaker-schedulerd[2417] (unpack_rsc_op_failure) warning: Unexpected result (error) was recorded for start of nco_itnm on pplxnsms02 at Oct 8 20:15:42 2024 | rc=1 id=nco_itnm_last_failure_0
Oct 09 14:11:38 pplxnsms02 pacemaker-schedulerd[2417] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Oct 8 20:12:15 2024
Oct 09 14:11:38 pplxnsms02 pacemaker-schedulerd[2417] (pe_get_failcount) info: nco_itnm has failed INFINITY times on pplxnsms02
Oct 09 14:11:38 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__threshold_reached) warning: nco_itnm cannot run on pplxnsms02 due to reaching migration threshold (clean up resource to allow again)| failures=1000000 migration-threshold=1000000
Oct 09 14:11:38 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 09 14:11:38 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 09 14:11:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_vip (Started pplxnsms01)
Oct 09 14:11:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms01)
Oct 09 14:11:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs (Started pplxnsms01)
Oct 09 14:11:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms01)
Oct 09 14:11:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms01)
Oct 09 14:11:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms01)
Oct 09 14:11:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_omni (Started pplxnsms01)
Oct 09 14:11:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms01)
Oct 09 14:11:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms01)
Oct 09 14:11:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 09 14:11:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 09 14:11:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 09 14:11:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 09 14:11:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 09 14:11:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 09 14:11:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms02)
Oct 09 14:11:38 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__log_transition_summary) notice: Calculated transition 77, saving inputs in /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 14:11:38 pplxnsms02 pacemaker-schedulerd[2417] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 09 14:11:38 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 09 14:11:38 pplxnsms02 pacemaker-controld [2418] (do_te_invoke) info: Processing graph 77 (ref=pe_calc-dc-1728454298-205) derived from /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 14:11:38 pplxnsms02 pacemaker-controld [2418] (pcmk__execute_graph) notice: Transition 77 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-1006.bz2): Complete
Oct 09 14:11:38 pplxnsms02 pacemaker-controld [2418] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 09 14:11:38 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 09 14:26:38 pplxnsms02 pacemaker-controld [2418] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 09 14:26:38 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 09 14:26:38 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 09 14:26:38 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 09 14:26:38 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) notice: On loss of quorum: Ignore
Oct 09 14:26:38 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 09 14:26:38 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms02 is online
Oct 09 14:26:38 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 09 14:26:38 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms01 is online
Oct 09 14:26:38 pplxnsms02 pacemaker-schedulerd[2417] (unpack_rsc_op_failure) warning: Unexpected result (error) was recorded for start of nco_itnm on pplxnsms02 at Oct 8 20:15:42 2024 | rc=1 id=nco_itnm_last_failure_0
Oct 09 14:26:38 pplxnsms02 pacemaker-schedulerd[2417] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Oct 8 20:12:15 2024
Oct 09 14:26:38 pplxnsms02 pacemaker-schedulerd[2417] (pe_get_failcount) info: nco_itnm has failed INFINITY times on pplxnsms02
Oct 09 14:26:38 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__threshold_reached) warning: nco_itnm cannot run on pplxnsms02 due to reaching migration threshold (clean up resource to allow again)| failures=1000000 migration-threshold=1000000
Oct 09 14:26:38 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 09 14:26:38 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 09 14:26:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_vip (Started pplxnsms01)
Oct 09 14:26:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms01)
Oct 09 14:26:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs (Started pplxnsms01)
Oct 09 14:26:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms01)
Oct 09 14:26:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms01)
Oct 09 14:26:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms01)
Oct 09 14:26:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_omni (Started pplxnsms01)
Oct 09 14:26:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms01)
Oct 09 14:26:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms01)
Oct 09 14:26:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 09 14:26:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 09 14:26:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 09 14:26:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 09 14:26:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 09 14:26:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 09 14:26:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms02)
Oct 09 14:26:38 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__log_transition_summary) notice: Calculated transition 78, saving inputs in /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 14:26:38 pplxnsms02 pacemaker-schedulerd[2417] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 09 14:26:38 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 09 14:26:38 pplxnsms02 pacemaker-controld [2418] (do_te_invoke) info: Processing graph 78 (ref=pe_calc-dc-1728455198-206) derived from /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 14:26:38 pplxnsms02 pacemaker-controld [2418] (pcmk__execute_graph) notice: Transition 78 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-1006.bz2): Complete
Oct 09 14:26:38 pplxnsms02 pacemaker-controld [2418] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 09 14:26:38 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 09 14:41:38 pplxnsms02 pacemaker-controld [2418] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 09 14:41:38 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 09 14:41:38 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 09 14:41:38 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 09 14:41:38 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) notice: On loss of quorum: Ignore
Oct 09 14:41:38 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 09 14:41:38 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms02 is online
Oct 09 14:41:38 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 09 14:41:38 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms01 is online
Oct 09 14:41:38 pplxnsms02 pacemaker-schedulerd[2417] (unpack_rsc_op_failure) warning: Unexpected result (error) was recorded for start of nco_itnm on pplxnsms02 at Oct 8 20:15:42 2024 | rc=1 id=nco_itnm_last_failure_0
Oct 09 14:41:38 pplxnsms02 pacemaker-schedulerd[2417] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Oct 8 20:12:15 2024
Oct 09 14:41:38 pplxnsms02 pacemaker-schedulerd[2417] (pe_get_failcount) info: nco_itnm has failed INFINITY times on pplxnsms02
Oct 09 14:41:38 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__threshold_reached) warning: nco_itnm cannot run on pplxnsms02 due to reaching migration threshold (clean up resource to allow again)| failures=1000000 migration-threshold=1000000
Oct 09 14:41:38 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 09 14:41:38 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 09 14:41:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_vip (Started pplxnsms01)
Oct 09 14:41:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms01)
Oct 09 14:41:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs (Started pplxnsms01)
Oct 09 14:41:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms01)
Oct 09 14:41:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms01)
Oct 09 14:41:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms01)
Oct 09 14:41:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_omni (Started pplxnsms01)
Oct 09 14:41:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms01)
Oct 09 14:41:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms01)
Oct 09 14:41:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 09 14:41:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 09 14:41:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 09 14:41:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 09 14:41:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 09 14:41:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 09 14:41:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms02)
Oct 09 14:41:38 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__log_transition_summary) notice: Calculated transition 79, saving inputs in /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 14:41:38 pplxnsms02 pacemaker-schedulerd[2417] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 09 14:41:38 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 09 14:41:38 pplxnsms02 pacemaker-controld [2418] (do_te_invoke) info: Processing graph 79 (ref=pe_calc-dc-1728456098-207) derived from /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 14:41:38 pplxnsms02 pacemaker-controld [2418] (pcmk__execute_graph) notice: Transition 79 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-1006.bz2): Complete
Oct 09 14:41:38 pplxnsms02 pacemaker-controld [2418] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 09 14:41:38 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 09 14:56:38 pplxnsms02 pacemaker-controld [2418] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 09 14:56:38 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 09 14:56:38 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 09 14:56:38 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 09 14:56:38 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) notice: On loss of quorum: Ignore
Oct 09 14:56:38 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 09 14:56:38 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms02 is online
Oct 09 14:56:38 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 09 14:56:38 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms01 is online
Oct 09 14:56:38 pplxnsms02 pacemaker-schedulerd[2417] (unpack_rsc_op_failure) warning: Unexpected result (error) was recorded for start of nco_itnm on pplxnsms02 at Oct 8 20:15:42 2024 | rc=1 id=nco_itnm_last_failure_0
Oct 09 14:56:38 pplxnsms02 pacemaker-schedulerd[2417] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Oct 8 20:12:15 2024
Oct 09 14:56:38 pplxnsms02 pacemaker-schedulerd[2417] (pe_get_failcount) info: nco_itnm has failed INFINITY times on pplxnsms02
Oct 09 14:56:38 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__threshold_reached) warning: nco_itnm cannot run on pplxnsms02 due to reaching migration threshold (clean up resource to allow again)| failures=1000000 migration-threshold=1000000
Oct 09 14:56:38 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 09 14:56:38 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 09 14:56:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_vip (Started pplxnsms01)
Oct 09 14:56:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms01)
Oct 09 14:56:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs (Started pplxnsms01)
Oct 09 14:56:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms01)
Oct 09 14:56:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms01)
Oct 09 14:56:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms01)
Oct 09 14:56:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_omni (Started pplxnsms01)
Oct 09 14:56:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms01)
Oct 09 14:56:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms01)
Oct 09 14:56:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 09 14:56:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 09 14:56:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 09 14:56:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 09 14:56:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 09 14:56:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 09 14:56:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms02)
Oct 09 14:56:38 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__log_transition_summary) notice: Calculated transition 80, saving inputs in /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 14:56:38 pplxnsms02 pacemaker-schedulerd[2417] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 09 14:56:38 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 09 14:56:38 pplxnsms02 pacemaker-controld [2418] (do_te_invoke) info: Processing graph 80 (ref=pe_calc-dc-1728456998-208) derived from /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 14:56:38 pplxnsms02 pacemaker-controld [2418] (pcmk__execute_graph) notice: Transition 80 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-1006.bz2): Complete
Oct 09 14:56:38 pplxnsms02 pacemaker-controld [2418] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 09 14:56:38 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 09 15:11:38 pplxnsms02 pacemaker-controld [2418] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 09 15:11:38 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 09 15:11:38 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 09 15:11:38 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 09 15:11:38 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) notice: On loss of quorum: Ignore
Oct 09 15:11:38 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 09 15:11:38 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms02 is online
Oct 09 15:11:38 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 09 15:11:38 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms01 is online
Oct 09 15:11:38 pplxnsms02 pacemaker-schedulerd[2417] (unpack_rsc_op_failure) warning: Unexpected result (error) was recorded for start of nco_itnm on pplxnsms02 at Oct 8 20:15:42 2024 | rc=1 id=nco_itnm_last_failure_0
Oct 09 15:11:38 pplxnsms02 pacemaker-schedulerd[2417] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Oct 8 20:12:15 2024
Oct 09 15:11:38 pplxnsms02 pacemaker-schedulerd[2417] (pe_get_failcount) info: nco_itnm has failed INFINITY times on pplxnsms02
Oct 09 15:11:38 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__threshold_reached) warning: nco_itnm cannot run on pplxnsms02 due to reaching migration threshold (clean up resource to allow again)| failures=1000000 migration-threshold=1000000
Oct 09 15:11:38 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 09 15:11:38 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 09 15:11:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_vip (Started pplxnsms01)
Oct 09 15:11:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms01)
Oct 09 15:11:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs (Started pplxnsms01)
Oct 09 15:11:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms01)
Oct 09 15:11:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms01)
Oct 09 15:11:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms01)
Oct 09 15:11:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_omni (Started pplxnsms01)
Oct 09 15:11:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms01)
Oct 09 15:11:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms01)
Oct 09 15:11:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 09 15:11:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 09 15:11:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 09 15:11:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 09 15:11:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 09 15:11:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 09 15:11:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms02)
Oct 09 15:11:38 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__log_transition_summary) notice: Calculated transition 81, saving inputs in /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 15:11:38 pplxnsms02 pacemaker-schedulerd[2417] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 09 15:11:38 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 09 15:11:38 pplxnsms02 pacemaker-controld [2418] (do_te_invoke) info: Processing graph 81 (ref=pe_calc-dc-1728457898-209) derived from /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 15:11:38 pplxnsms02 pacemaker-controld [2418] (pcmk__execute_graph) notice: Transition 81 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-1006.bz2): Complete
Oct 09 15:11:38 pplxnsms02 pacemaker-controld [2418] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 09 15:11:38 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 09 15:26:38 pplxnsms02 pacemaker-controld [2418] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 09 15:26:38 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 09 15:26:38 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 09 15:26:38 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 09 15:26:38 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) notice: On loss of quorum: Ignore
Oct 09 15:26:38 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 09 15:26:38 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms02 is online
Oct 09 15:26:38 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 09 15:26:38 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms01 is online
Oct 09 15:26:38 pplxnsms02 pacemaker-schedulerd[2417] (unpack_rsc_op_failure) warning: Unexpected result (error) was recorded for start of nco_itnm on pplxnsms02 at Oct 8 20:15:42 2024 | rc=1 id=nco_itnm_last_failure_0
Oct 09 15:26:38 pplxnsms02 pacemaker-schedulerd[2417] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Oct 8 20:12:15 2024
Oct 09 15:26:38 pplxnsms02 pacemaker-schedulerd[2417] (pe_get_failcount) info: nco_itnm has failed INFINITY times on pplxnsms02
Oct 09 15:26:38 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__threshold_reached) warning: nco_itnm cannot run on pplxnsms02 due to reaching migration threshold (clean up resource to allow again)| failures=1000000 migration-threshold=1000000
Oct 09 15:26:38 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 09 15:26:38 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 09 15:26:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_vip (Started pplxnsms01)
Oct 09 15:26:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms01)
Oct 09 15:26:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs (Started pplxnsms01)
Oct 09 15:26:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms01)
Oct 09 15:26:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms01)
Oct 09 15:26:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms01)
Oct 09 15:26:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_omni (Started pplxnsms01)
Oct 09 15:26:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms01)
Oct 09 15:26:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms01)
Oct 09 15:26:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 09 15:26:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 09 15:26:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 09 15:26:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 09 15:26:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 09 15:26:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 09 15:26:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms02)
Oct 09 15:26:38 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__log_transition_summary) notice: Calculated transition 82, saving inputs in /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 15:26:38 pplxnsms02 pacemaker-schedulerd[2417] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 09 15:26:38 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 09 15:26:38 pplxnsms02 pacemaker-controld [2418] (do_te_invoke) info: Processing graph 82 (ref=pe_calc-dc-1728458798-210) derived from /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 15:26:38 pplxnsms02 pacemaker-controld [2418] (pcmk__execute_graph) notice: Transition 82 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-1006.bz2): Complete
Oct 09 15:26:38 pplxnsms02 pacemaker-controld [2418] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 09 15:26:38 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 09 15:41:38 pplxnsms02 pacemaker-controld [2418] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 09 15:41:38 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 09 15:41:38 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 09 15:41:38 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 09 15:41:38 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) notice: On loss of quorum: Ignore
Oct 09 15:41:38 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 09 15:41:38 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms02 is online
Oct 09 15:41:38 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 09 15:41:38 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms01 is online
Oct 09 15:41:38 pplxnsms02 pacemaker-schedulerd[2417] (unpack_rsc_op_failure) warning: Unexpected result (error) was recorded for start of nco_itnm on pplxnsms02 at Oct 8 20:15:42 2024 | rc=1 id=nco_itnm_last_failure_0
Oct 09 15:41:38 pplxnsms02 pacemaker-schedulerd[2417] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Oct 8 20:12:15 2024
Oct 09 15:41:38 pplxnsms02 pacemaker-schedulerd[2417] (pe_get_failcount) info: nco_itnm has failed INFINITY times on pplxnsms02
Oct 09 15:41:38 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__threshold_reached) warning: nco_itnm cannot run on pplxnsms02 due to reaching migration threshold (clean up resource to allow again)| failures=1000000 migration-threshold=1000000
Oct 09 15:41:38 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 09 15:41:38 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 09 15:41:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_vip (Started pplxnsms01)
Oct 09 15:41:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms01)
Oct 09 15:41:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs (Started pplxnsms01)
Oct 09 15:41:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms01)
Oct 09 15:41:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms01)
Oct 09 15:41:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms01)
Oct 09 15:41:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_omni (Started pplxnsms01)
Oct 09 15:41:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms01)
Oct 09 15:41:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms01)
Oct 09 15:41:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 09 15:41:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 09 15:41:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 09 15:41:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 09 15:41:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 09 15:41:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 09 15:41:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms02)
Oct 09 15:41:38 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__log_transition_summary) notice: Calculated transition 83, saving inputs in /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 15:41:38 pplxnsms02 pacemaker-schedulerd[2417] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 09 15:41:38 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 09 15:41:38 pplxnsms02 pacemaker-controld [2418] (do_te_invoke) info: Processing graph 83 (ref=pe_calc-dc-1728459698-211) derived from /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 15:41:38 pplxnsms02 pacemaker-controld [2418] (pcmk__execute_graph) notice: Transition 83 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-1006.bz2): Complete
Oct 09 15:41:38 pplxnsms02 pacemaker-controld [2418] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 09 15:41:38 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 09 15:56:38 pplxnsms02 pacemaker-controld [2418] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 09 15:56:38 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 09 15:56:38 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 09 15:56:38 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 09 15:56:38 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) notice: On loss of quorum: Ignore
Oct 09 15:56:38 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 09 15:56:38 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms02 is online
Oct 09 15:56:38 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 09 15:56:38 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms01 is online
Oct 09 15:56:38 pplxnsms02 pacemaker-schedulerd[2417] (unpack_rsc_op_failure) warning: Unexpected result (error) was recorded for start of nco_itnm on pplxnsms02 at Oct 8 20:15:42 2024 | rc=1 id=nco_itnm_last_failure_0
Oct 09 15:56:38 pplxnsms02 pacemaker-schedulerd[2417] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Oct 8 20:12:15 2024
Oct 09 15:56:38 pplxnsms02 pacemaker-schedulerd[2417] (pe_get_failcount) info: nco_itnm has failed INFINITY times on pplxnsms02
Oct 09 15:56:38 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__threshold_reached) warning: nco_itnm cannot run on pplxnsms02 due to reaching migration threshold (clean up resource to allow again)| failures=1000000 migration-threshold=1000000
Oct 09 15:56:38 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 09 15:56:38 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 09 15:56:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_vip (Started pplxnsms01)
Oct 09 15:56:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms01)
Oct 09 15:56:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs (Started pplxnsms01)
Oct 09 15:56:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms01)
Oct 09 15:56:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms01)
Oct 09 15:56:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms01)
Oct 09 15:56:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_omni (Started pplxnsms01)
Oct 09 15:56:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms01)
Oct 09 15:56:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms01)
Oct 09 15:56:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 09 15:56:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 09 15:56:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 09 15:56:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 09 15:56:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 09 15:56:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 09 15:56:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms02)
Oct 09 15:56:38 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__log_transition_summary) notice: Calculated transition 84, saving inputs in /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 15:56:38 pplxnsms02 pacemaker-schedulerd[2417] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 09 15:56:38 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 09 15:56:38 pplxnsms02 pacemaker-controld [2418] (do_te_invoke) info: Processing graph 84 (ref=pe_calc-dc-1728460598-212) derived from /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 15:56:38 pplxnsms02 pacemaker-controld [2418] (pcmk__execute_graph) notice: Transition 84 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-1006.bz2): Complete
Oct 09 15:56:38 pplxnsms02 pacemaker-controld [2418] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 09 15:56:38 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 09 16:11:38 pplxnsms02 pacemaker-controld [2418] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 09 16:11:38 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 09 16:11:38 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 09 16:11:38 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 09 16:11:38 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) notice: On loss of quorum: Ignore
Oct 09 16:11:38 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 09 16:11:38 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms02 is online
Oct 09 16:11:38 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 09 16:11:38 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms01 is online
Oct 09 16:11:38 pplxnsms02 pacemaker-schedulerd[2417] (unpack_rsc_op_failure) warning: Unexpected result (error) was recorded for start of nco_itnm on pplxnsms02 at Oct 8 20:15:42 2024 | rc=1 id=nco_itnm_last_failure_0
Oct 09 16:11:38 pplxnsms02 pacemaker-schedulerd[2417] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Oct 8 20:12:15 2024
Oct 09 16:11:38 pplxnsms02 pacemaker-schedulerd[2417] (pe_get_failcount) info: nco_itnm has failed INFINITY times on pplxnsms02
Oct 09 16:11:38 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__threshold_reached) warning: nco_itnm cannot run on pplxnsms02 due to reaching migration threshold (clean up resource to allow again)| failures=1000000 migration-threshold=1000000
Oct 09 16:11:38 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 09 16:11:38 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 09 16:11:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_vip (Started pplxnsms01)
Oct 09 16:11:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms01)
Oct 09 16:11:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs (Started pplxnsms01)
Oct 09 16:11:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms01)
Oct 09 16:11:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms01)
Oct 09 16:11:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms01)
Oct 09 16:11:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_omni (Started pplxnsms01)
Oct 09 16:11:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms01)
Oct 09 16:11:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms01)
Oct 09 16:11:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 09 16:11:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 09 16:11:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 09 16:11:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 09 16:11:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 09 16:11:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 09 16:11:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms02)
Oct 09 16:11:38 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__log_transition_summary) notice: Calculated transition 85, saving inputs in /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 16:11:38 pplxnsms02 pacemaker-schedulerd[2417] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 09 16:11:38 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 09 16:11:38 pplxnsms02 pacemaker-controld [2418] (do_te_invoke) info: Processing graph 85 (ref=pe_calc-dc-1728461498-213) derived from /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 16:11:38 pplxnsms02 pacemaker-controld [2418] (pcmk__execute_graph) notice: Transition 85 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-1006.bz2): Complete
Oct 09 16:11:38 pplxnsms02 pacemaker-controld [2418] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 09 16:11:38 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 09 16:26:38 pplxnsms02 pacemaker-controld [2418] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 09 16:26:38 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 09 16:26:38 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 09 16:26:38 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 09 16:26:38 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) notice: On loss of quorum: Ignore
Oct 09 16:26:38 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 09 16:26:38 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms02 is online
Oct 09 16:26:38 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 09 16:26:38 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms01 is online
Oct 09 16:26:38 pplxnsms02 pacemaker-schedulerd[2417] (unpack_rsc_op_failure) warning: Unexpected result (error) was recorded for start of nco_itnm on pplxnsms02 at Oct 8 20:15:42 2024 | rc=1 id=nco_itnm_last_failure_0
Oct 09 16:26:38 pplxnsms02 pacemaker-schedulerd[2417] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Oct 8 20:12:15 2024
Oct 09 16:26:38 pplxnsms02 pacemaker-schedulerd[2417] (pe_get_failcount) info: nco_itnm has failed INFINITY times on pplxnsms02
Oct 09 16:26:38 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__threshold_reached) warning: nco_itnm cannot run on pplxnsms02 due to reaching migration threshold (clean up resource to allow again)| failures=1000000 migration-threshold=1000000
Oct 09 16:26:38 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 09 16:26:38 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 09 16:26:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_vip (Started pplxnsms01)
Oct 09 16:26:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms01)
Oct 09 16:26:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs (Started pplxnsms01)
Oct 09 16:26:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms01)
Oct 09 16:26:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms01)
Oct 09 16:26:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms01)
Oct 09 16:26:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_omni (Started pplxnsms01)
Oct 09 16:26:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms01)
Oct 09 16:26:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms01)
Oct 09 16:26:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 09 16:26:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 09 16:26:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 09 16:26:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 09 16:26:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 09 16:26:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 09 16:26:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms02)
Oct 09 16:26:38 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__log_transition_summary) notice: Calculated transition 86, saving inputs in /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 16:26:38 pplxnsms02 pacemaker-schedulerd[2417] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 09 16:26:38 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 09 16:26:38 pplxnsms02 pacemaker-controld [2418] (do_te_invoke) info: Processing graph 86 (ref=pe_calc-dc-1728462398-214) derived from /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 16:26:38 pplxnsms02 pacemaker-controld [2418] (pcmk__execute_graph) notice: Transition 86 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-1006.bz2): Complete
Oct 09 16:26:38 pplxnsms02 pacemaker-controld [2418] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 09 16:26:38 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 09 16:41:38 pplxnsms02 pacemaker-controld [2418] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 09 16:41:38 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 09 16:41:38 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 09 16:41:38 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 09 16:41:38 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) notice: On loss of quorum: Ignore
Oct 09 16:41:38 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 09 16:41:38 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms02 is online
Oct 09 16:41:38 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 09 16:41:38 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms01 is online
Oct 09 16:41:38 pplxnsms02 pacemaker-schedulerd[2417] (unpack_rsc_op_failure) warning: Unexpected result (error) was recorded for start of nco_itnm on pplxnsms02 at Oct 8 20:15:42 2024 | rc=1 id=nco_itnm_last_failure_0
Oct 09 16:41:38 pplxnsms02 pacemaker-schedulerd[2417] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Oct 8 20:12:15 2024
Oct 09 16:41:38 pplxnsms02 pacemaker-schedulerd[2417] (pe_get_failcount) info: nco_itnm has failed INFINITY times on pplxnsms02
Oct 09 16:41:38 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__threshold_reached) warning: nco_itnm cannot run on pplxnsms02 due to reaching migration threshold (clean up resource to allow again)| failures=1000000 migration-threshold=1000000
Oct 09 16:41:38 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 09 16:41:38 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 09 16:41:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_vip (Started pplxnsms01)
Oct 09 16:41:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms01)
Oct 09 16:41:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs (Started pplxnsms01)
Oct 09 16:41:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms01)
Oct 09 16:41:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms01)
Oct 09 16:41:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms01)
Oct 09 16:41:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_omni (Started pplxnsms01)
Oct 09 16:41:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms01)
Oct 09 16:41:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms01)
Oct 09 16:41:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 09 16:41:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 09 16:41:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 09 16:41:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 09 16:41:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 09 16:41:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 09 16:41:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms02)
Oct 09 16:41:38 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__log_transition_summary) notice: Calculated transition 87, saving inputs in /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 16:41:38 pplxnsms02 pacemaker-schedulerd[2417] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 09 16:41:38 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 09 16:41:38 pplxnsms02 pacemaker-controld [2418] (do_te_invoke) info: Processing graph 87 (ref=pe_calc-dc-1728463298-215) derived from /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 16:41:38 pplxnsms02 pacemaker-controld [2418] (pcmk__execute_graph) notice: Transition 87 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-1006.bz2): Complete
Oct 09 16:41:38 pplxnsms02 pacemaker-controld [2418] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 09 16:41:38 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 09 16:56:38 pplxnsms02 pacemaker-controld [2418] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 09 16:56:38 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 09 16:56:38 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 09 16:56:38 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 09 16:56:38 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) notice: On loss of quorum: Ignore
Oct 09 16:56:38 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 09 16:56:38 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms02 is online
Oct 09 16:56:38 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 09 16:56:38 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms01 is online
Oct 09 16:56:38 pplxnsms02 pacemaker-schedulerd[2417] (unpack_rsc_op_failure) warning: Unexpected result (error) was recorded for start of nco_itnm on pplxnsms02 at Oct 8 20:15:42 2024 | rc=1 id=nco_itnm_last_failure_0
Oct 09 16:56:38 pplxnsms02 pacemaker-schedulerd[2417] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Oct 8 20:12:15 2024
Oct 09 16:56:38 pplxnsms02 pacemaker-schedulerd[2417] (pe_get_failcount) info: nco_itnm has failed INFINITY times on pplxnsms02
Oct 09 16:56:38 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__threshold_reached) warning: nco_itnm cannot run on pplxnsms02 due to reaching migration threshold (clean up resource to allow again)| failures=1000000 migration-threshold=1000000
Oct 09 16:56:38 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 09 16:56:38 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 09 16:56:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_vip (Started pplxnsms01)
Oct 09 16:56:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms01)
Oct 09 16:56:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs (Started pplxnsms01)
Oct 09 16:56:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms01)
Oct 09 16:56:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms01)
Oct 09 16:56:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms01)
Oct 09 16:56:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_omni (Started pplxnsms01)
Oct 09 16:56:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms01)
Oct 09 16:56:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms01)
Oct 09 16:56:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 09 16:56:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 09 16:56:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 09 16:56:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 09 16:56:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 09 16:56:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 09 16:56:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms02)
Oct 09 16:56:38 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__log_transition_summary) notice: Calculated transition 88, saving inputs in /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 16:56:38 pplxnsms02 pacemaker-schedulerd[2417] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 09 16:56:38 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 09 16:56:38 pplxnsms02 pacemaker-controld [2418] (do_te_invoke) info: Processing graph 88 (ref=pe_calc-dc-1728464198-216) derived from /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 16:56:38 pplxnsms02 pacemaker-controld [2418] (pcmk__execute_graph) notice: Transition 88 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-1006.bz2): Complete
Oct 09 16:56:38 pplxnsms02 pacemaker-controld [2418] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 09 16:56:38 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 09 17:11:38 pplxnsms02 pacemaker-controld [2418] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 09 17:11:38 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 09 17:11:38 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 09 17:11:38 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 09 17:11:38 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) notice: On loss of quorum: Ignore
Oct 09 17:11:38 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 09 17:11:38 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms02 is online
Oct 09 17:11:38 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 09 17:11:38 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms01 is online
Oct 09 17:11:38 pplxnsms02 pacemaker-schedulerd[2417] (unpack_rsc_op_failure) warning: Unexpected result (error) was recorded for start of nco_itnm on pplxnsms02 at Oct 8 20:15:42 2024 | rc=1 id=nco_itnm_last_failure_0
Oct 09 17:11:38 pplxnsms02 pacemaker-schedulerd[2417] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Oct 8 20:12:15 2024
Oct 09 17:11:38 pplxnsms02 pacemaker-schedulerd[2417] (pe_get_failcount) info: nco_itnm has failed INFINITY times on pplxnsms02
Oct 09 17:11:38 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__threshold_reached) warning: nco_itnm cannot run on pplxnsms02 due to reaching migration threshold (clean up resource to allow again)| failures=1000000 migration-threshold=1000000
Oct 09 17:11:38 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 09 17:11:38 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 09 17:11:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_vip (Started pplxnsms01)
Oct 09 17:11:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms01)
Oct 09 17:11:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs (Started pplxnsms01)
Oct 09 17:11:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms01)
Oct 09 17:11:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms01)
Oct 09 17:11:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms01)
Oct 09 17:11:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_omni (Started pplxnsms01)
Oct 09 17:11:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms01)
Oct 09 17:11:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms01)
Oct 09 17:11:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 09 17:11:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 09 17:11:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 09 17:11:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 09 17:11:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 09 17:11:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 09 17:11:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms02)
Oct 09 17:11:38 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__log_transition_summary) notice: Calculated transition 89, saving inputs in /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 17:11:38 pplxnsms02 pacemaker-schedulerd[2417] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 09 17:11:38 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 09 17:11:38 pplxnsms02 pacemaker-controld [2418] (do_te_invoke) info: Processing graph 89 (ref=pe_calc-dc-1728465098-217) derived from /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 17:11:38 pplxnsms02 pacemaker-controld [2418] (pcmk__execute_graph) notice: Transition 89 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-1006.bz2): Complete
Oct 09 17:11:38 pplxnsms02 pacemaker-controld [2418] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 09 17:11:38 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 09 17:26:38 pplxnsms02 pacemaker-controld [2418] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 09 17:26:38 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 09 17:26:38 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 09 17:26:38 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 09 17:26:38 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) notice: On loss of quorum: Ignore
Oct 09 17:26:38 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 09 17:26:38 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms02 is online
Oct 09 17:26:38 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 09 17:26:38 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms01 is online
Oct 09 17:26:38 pplxnsms02 pacemaker-schedulerd[2417] (unpack_rsc_op_failure) warning: Unexpected result (error) was recorded for start of nco_itnm on pplxnsms02 at Oct 8 20:15:42 2024 | rc=1 id=nco_itnm_last_failure_0
Oct 09 17:26:38 pplxnsms02 pacemaker-schedulerd[2417] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Oct 8 20:12:15 2024
Oct 09 17:26:38 pplxnsms02 pacemaker-schedulerd[2417] (pe_get_failcount) info: nco_itnm has failed INFINITY times on pplxnsms02
Oct 09 17:26:38 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__threshold_reached) warning: nco_itnm cannot run on pplxnsms02 due to reaching migration threshold (clean up resource to allow again)| failures=1000000 migration-threshold=1000000
Oct 09 17:26:38 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 09 17:26:38 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 09 17:26:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_vip (Started pplxnsms01)
Oct 09 17:26:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms01)
Oct 09 17:26:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs (Started pplxnsms01)
Oct 09 17:26:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms01)
Oct 09 17:26:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms01)
Oct 09 17:26:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms01)
Oct 09 17:26:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_omni (Started pplxnsms01)
Oct 09 17:26:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms01)
Oct 09 17:26:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms01)
Oct 09 17:26:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 09 17:26:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 09 17:26:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 09 17:26:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 09 17:26:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 09 17:26:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 09 17:26:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms02)
Oct 09 17:26:38 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__log_transition_summary) notice: Calculated transition 90, saving inputs in /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 17:26:38 pplxnsms02 pacemaker-schedulerd[2417] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 09 17:26:38 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 09 17:26:38 pplxnsms02 pacemaker-controld [2418] (do_te_invoke) info: Processing graph 90 (ref=pe_calc-dc-1728465998-218) derived from /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 17:26:38 pplxnsms02 pacemaker-controld [2418] (pcmk__execute_graph) notice: Transition 90 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-1006.bz2): Complete
Oct 09 17:26:38 pplxnsms02 pacemaker-controld [2418] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 09 17:26:38 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 09 17:41:38 pplxnsms02 pacemaker-controld [2418] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 09 17:41:38 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 09 17:41:38 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 09 17:41:38 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 09 17:41:38 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) notice: On loss of quorum: Ignore
Oct 09 17:41:38 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 09 17:41:38 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms02 is online
Oct 09 17:41:38 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 09 17:41:38 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms01 is online
Oct 09 17:41:38 pplxnsms02 pacemaker-schedulerd[2417] (unpack_rsc_op_failure) warning: Unexpected result (error) was recorded for start of nco_itnm on pplxnsms02 at Oct 8 20:15:42 2024 | rc=1 id=nco_itnm_last_failure_0
Oct 09 17:41:38 pplxnsms02 pacemaker-schedulerd[2417] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Oct 8 20:12:15 2024
Oct 09 17:41:38 pplxnsms02 pacemaker-schedulerd[2417] (pe_get_failcount) info: nco_itnm has failed INFINITY times on pplxnsms02
Oct 09 17:41:38 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__threshold_reached) warning: nco_itnm cannot run on pplxnsms02 due to reaching migration threshold (clean up resource to allow again)| failures=1000000 migration-threshold=1000000
Oct 09 17:41:38 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 09 17:41:38 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 09 17:41:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_vip (Started pplxnsms01)
Oct 09 17:41:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms01)
Oct 09 17:41:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs (Started pplxnsms01)
Oct 09 17:41:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms01)
Oct 09 17:41:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms01)
Oct 09 17:41:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms01)
Oct 09 17:41:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_omni (Started pplxnsms01)
Oct 09 17:41:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms01)
Oct 09 17:41:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms01)
Oct 09 17:41:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 09 17:41:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 09 17:41:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 09 17:41:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 09 17:41:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 09 17:41:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 09 17:41:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms02)
Oct 09 17:41:38 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__log_transition_summary) notice: Calculated transition 91, saving inputs in /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 17:41:38 pplxnsms02 pacemaker-schedulerd[2417] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 09 17:41:38 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 09 17:41:38 pplxnsms02 pacemaker-controld [2418] (do_te_invoke) info: Processing graph 91 (ref=pe_calc-dc-1728466898-219) derived from /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 17:41:38 pplxnsms02 pacemaker-controld [2418] (pcmk__execute_graph) notice: Transition 91 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-1006.bz2): Complete
Oct 09 17:41:38 pplxnsms02 pacemaker-controld [2418] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 09 17:41:38 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 09 17:56:38 pplxnsms02 pacemaker-controld [2418] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 09 17:56:38 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 09 17:56:38 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 09 17:56:38 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 09 17:56:38 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) notice: On loss of quorum: Ignore
Oct 09 17:56:38 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 09 17:56:38 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms02 is online
Oct 09 17:56:38 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 09 17:56:38 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms01 is online
Oct 09 17:56:38 pplxnsms02 pacemaker-schedulerd[2417] (unpack_rsc_op_failure) warning: Unexpected result (error) was recorded for start of nco_itnm on pplxnsms02 at Oct 8 20:15:42 2024 | rc=1 id=nco_itnm_last_failure_0
Oct 09 17:56:38 pplxnsms02 pacemaker-schedulerd[2417] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Oct 8 20:12:15 2024
Oct 09 17:56:38 pplxnsms02 pacemaker-schedulerd[2417] (pe_get_failcount) info: nco_itnm has failed INFINITY times on pplxnsms02
Oct 09 17:56:38 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__threshold_reached) warning: nco_itnm cannot run on pplxnsms02 due to reaching migration threshold (clean up resource to allow again)| failures=1000000 migration-threshold=1000000
Oct 09 17:56:38 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 09 17:56:38 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 09 17:56:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_vip (Started pplxnsms01)
Oct 09 17:56:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms01)
Oct 09 17:56:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs (Started pplxnsms01)
Oct 09 17:56:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms01)
Oct 09 17:56:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms01)
Oct 09 17:56:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms01)
Oct 09 17:56:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_omni (Started pplxnsms01)
Oct 09 17:56:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms01)
Oct 09 17:56:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms01)
Oct 09 17:56:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 09 17:56:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 09 17:56:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 09 17:56:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 09 17:56:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 09 17:56:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 09 17:56:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms02)
Oct 09 17:56:38 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__log_transition_summary) notice: Calculated transition 92, saving inputs in /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 17:56:38 pplxnsms02 pacemaker-schedulerd[2417] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 09 17:56:38 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 09 17:56:38 pplxnsms02 pacemaker-controld [2418] (do_te_invoke) info: Processing graph 92 (ref=pe_calc-dc-1728467798-220) derived from /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 17:56:38 pplxnsms02 pacemaker-controld [2418] (pcmk__execute_graph) notice: Transition 92 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-1006.bz2): Complete
Oct 09 17:56:38 pplxnsms02 pacemaker-controld [2418] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 09 17:56:38 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 09 18:11:38 pplxnsms02 pacemaker-controld [2418] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 09 18:11:38 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 09 18:11:38 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 09 18:11:38 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 09 18:11:38 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) notice: On loss of quorum: Ignore
Oct 09 18:11:38 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 09 18:11:38 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms02 is online
Oct 09 18:11:38 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 09 18:11:38 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms01 is online
Oct 09 18:11:38 pplxnsms02 pacemaker-schedulerd[2417] (unpack_rsc_op_failure) warning: Unexpected result (error) was recorded for start of nco_itnm on pplxnsms02 at Oct 8 20:15:42 2024 | rc=1 id=nco_itnm_last_failure_0
Oct 09 18:11:38 pplxnsms02 pacemaker-schedulerd[2417] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Oct 8 20:12:15 2024
Oct 09 18:11:38 pplxnsms02 pacemaker-schedulerd[2417] (pe_get_failcount) info: nco_itnm has failed INFINITY times on pplxnsms02
Oct 09 18:11:38 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__threshold_reached) warning: nco_itnm cannot run on pplxnsms02 due to reaching migration threshold (clean up resource to allow again)| failures=1000000 migration-threshold=1000000
Oct 09 18:11:38 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 09 18:11:38 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 09 18:11:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_vip (Started pplxnsms01)
Oct 09 18:11:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms01)
Oct 09 18:11:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs (Started pplxnsms01)
Oct 09 18:11:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms01)
Oct 09 18:11:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms01)
Oct 09 18:11:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms01)
Oct 09 18:11:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_omni (Started pplxnsms01)
Oct 09 18:11:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms01)
Oct 09 18:11:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms01)
Oct 09 18:11:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 09 18:11:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 09 18:11:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 09 18:11:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 09 18:11:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 09 18:11:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 09 18:11:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms02)
Oct 09 18:11:38 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__log_transition_summary) notice: Calculated transition 93, saving inputs in /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 18:11:38 pplxnsms02 pacemaker-schedulerd[2417] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 09 18:11:38 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 09 18:11:38 pplxnsms02 pacemaker-controld [2418] (do_te_invoke) info: Processing graph 93 (ref=pe_calc-dc-1728468698-221) derived from /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 18:11:38 pplxnsms02 pacemaker-controld [2418] (pcmk__execute_graph) notice: Transition 93 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-1006.bz2): Complete
Oct 09 18:11:38 pplxnsms02 pacemaker-controld [2418] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 09 18:11:38 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 09 18:26:38 pplxnsms02 pacemaker-controld [2418] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 09 18:26:38 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 09 18:26:38 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 09 18:26:38 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 09 18:26:38 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) notice: On loss of quorum: Ignore
Oct 09 18:26:38 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 09 18:26:38 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms02 is online
Oct 09 18:26:38 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 09 18:26:38 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms01 is online
Oct 09 18:26:38 pplxnsms02 pacemaker-schedulerd[2417] (unpack_rsc_op_failure) warning: Unexpected result (error) was recorded for start of nco_itnm on pplxnsms02 at Oct 8 20:15:42 2024 | rc=1 id=nco_itnm_last_failure_0
Oct 09 18:26:38 pplxnsms02 pacemaker-schedulerd[2417] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Oct 8 20:12:15 2024
Oct 09 18:26:38 pplxnsms02 pacemaker-schedulerd[2417] (pe_get_failcount) info: nco_itnm has failed INFINITY times on pplxnsms02
Oct 09 18:26:38 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__threshold_reached) warning: nco_itnm cannot run on pplxnsms02 due to reaching migration threshold (clean up resource to allow again)| failures=1000000 migration-threshold=1000000
Oct 09 18:26:38 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 09 18:26:38 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 09 18:26:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_vip (Started pplxnsms01)
Oct 09 18:26:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms01)
Oct 09 18:26:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs (Started pplxnsms01)
Oct 09 18:26:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms01)
Oct 09 18:26:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms01)
Oct 09 18:26:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms01)
Oct 09 18:26:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_omni (Started pplxnsms01)
Oct 09 18:26:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms01)
Oct 09 18:26:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms01)
Oct 09 18:26:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 09 18:26:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 09 18:26:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 09 18:26:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 09 18:26:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 09 18:26:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 09 18:26:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms02)
Oct 09 18:26:38 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__log_transition_summary) notice: Calculated transition 94, saving inputs in /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 18:26:38 pplxnsms02 pacemaker-schedulerd[2417] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 09 18:26:38 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 09 18:26:38 pplxnsms02 pacemaker-controld [2418] (do_te_invoke) info: Processing graph 94 (ref=pe_calc-dc-1728469598-222) derived from /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 18:26:38 pplxnsms02 pacemaker-controld [2418] (pcmk__execute_graph) notice: Transition 94 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-1006.bz2): Complete
Oct 09 18:26:38 pplxnsms02 pacemaker-controld [2418] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 09 18:26:38 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 09 18:41:38 pplxnsms02 pacemaker-controld [2418] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 09 18:41:38 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 09 18:41:38 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 09 18:41:38 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 09 18:41:38 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) notice: On loss of quorum: Ignore
Oct 09 18:41:38 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 09 18:41:38 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms02 is online
Oct 09 18:41:38 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 09 18:41:38 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms01 is online
Oct 09 18:41:38 pplxnsms02 pacemaker-schedulerd[2417] (unpack_rsc_op_failure) warning: Unexpected result (error) was recorded for start of nco_itnm on pplxnsms02 at Oct 8 20:15:42 2024 | rc=1 id=nco_itnm_last_failure_0
Oct 09 18:41:38 pplxnsms02 pacemaker-schedulerd[2417] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Oct 8 20:12:15 2024
Oct 09 18:41:38 pplxnsms02 pacemaker-schedulerd[2417] (pe_get_failcount) info: nco_itnm has failed INFINITY times on pplxnsms02
Oct 09 18:41:38 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__threshold_reached) warning: nco_itnm cannot run on pplxnsms02 due to reaching migration threshold (clean up resource to allow again)| failures=1000000 migration-threshold=1000000
Oct 09 18:41:38 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 09 18:41:38 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 09 18:41:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_vip (Started pplxnsms01)
Oct 09 18:41:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms01)
Oct 09 18:41:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs (Started pplxnsms01)
Oct 09 18:41:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms01)
Oct 09 18:41:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms01)
Oct 09 18:41:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms01)
Oct 09 18:41:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_omni (Started pplxnsms01)
Oct 09 18:41:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms01)
Oct 09 18:41:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms01)
Oct 09 18:41:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 09 18:41:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 09 18:41:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 09 18:41:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 09 18:41:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 09 18:41:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 09 18:41:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms02)
Oct 09 18:41:38 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__log_transition_summary) notice: Calculated transition 95, saving inputs in /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 18:41:38 pplxnsms02 pacemaker-schedulerd[2417] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 09 18:41:38 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 09 18:41:38 pplxnsms02 pacemaker-controld [2418] (do_te_invoke) info: Processing graph 95 (ref=pe_calc-dc-1728470498-223) derived from /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 18:41:38 pplxnsms02 pacemaker-controld [2418] (pcmk__execute_graph) notice: Transition 95 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-1006.bz2): Complete
Oct 09 18:41:38 pplxnsms02 pacemaker-controld [2418] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 09 18:41:38 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 09 18:56:38 pplxnsms02 pacemaker-controld [2418] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 09 18:56:38 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 09 18:56:38 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 09 18:56:38 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 09 18:56:38 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) notice: On loss of quorum: Ignore
Oct 09 18:56:38 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 09 18:56:38 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms02 is online
Oct 09 18:56:38 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 09 18:56:38 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms01 is online
Oct 09 18:56:38 pplxnsms02 pacemaker-schedulerd[2417] (unpack_rsc_op_failure) warning: Unexpected result (error) was recorded for start of nco_itnm on pplxnsms02 at Oct 8 20:15:42 2024 | rc=1 id=nco_itnm_last_failure_0
Oct 09 18:56:38 pplxnsms02 pacemaker-schedulerd[2417] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Oct 8 20:12:15 2024
Oct 09 18:56:38 pplxnsms02 pacemaker-schedulerd[2417] (pe_get_failcount) info: nco_itnm has failed INFINITY times on pplxnsms02
Oct 09 18:56:38 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__threshold_reached) warning: nco_itnm cannot run on pplxnsms02 due to reaching migration threshold (clean up resource to allow again)| failures=1000000 migration-threshold=1000000
Oct 09 18:56:38 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 09 18:56:38 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 09 18:56:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_vip (Started pplxnsms01)
Oct 09 18:56:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms01)
Oct 09 18:56:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs (Started pplxnsms01)
Oct 09 18:56:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms01)
Oct 09 18:56:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms01)
Oct 09 18:56:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms01)
Oct 09 18:56:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_omni (Started pplxnsms01)
Oct 09 18:56:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms01)
Oct 09 18:56:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms01)
Oct 09 18:56:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 09 18:56:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 09 18:56:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 09 18:56:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 09 18:56:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 09 18:56:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 09 18:56:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms02)
Oct 09 18:56:38 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__log_transition_summary) notice: Calculated transition 96, saving inputs in /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 18:56:38 pplxnsms02 pacemaker-schedulerd[2417] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 09 18:56:38 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 09 18:56:38 pplxnsms02 pacemaker-controld [2418] (do_te_invoke) info: Processing graph 96 (ref=pe_calc-dc-1728471398-224) derived from /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 18:56:38 pplxnsms02 pacemaker-controld [2418] (pcmk__execute_graph) notice: Transition 96 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-1006.bz2): Complete
Oct 09 18:56:38 pplxnsms02 pacemaker-controld [2418] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 09 18:56:38 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 09 19:11:38 pplxnsms02 pacemaker-controld [2418] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 09 19:11:38 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 09 19:11:38 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 09 19:11:38 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 09 19:11:38 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) notice: On loss of quorum: Ignore
Oct 09 19:11:38 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 09 19:11:38 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms02 is online
Oct 09 19:11:38 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 09 19:11:38 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms01 is online
Oct 09 19:11:38 pplxnsms02 pacemaker-schedulerd[2417] (unpack_rsc_op_failure) warning: Unexpected result (error) was recorded for start of nco_itnm on pplxnsms02 at Oct 8 20:15:42 2024 | rc=1 id=nco_itnm_last_failure_0
Oct 09 19:11:38 pplxnsms02 pacemaker-schedulerd[2417] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Oct 8 20:12:15 2024
Oct 09 19:11:38 pplxnsms02 pacemaker-schedulerd[2417] (pe_get_failcount) info: nco_itnm has failed INFINITY times on pplxnsms02
Oct 09 19:11:38 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__threshold_reached) warning: nco_itnm cannot run on pplxnsms02 due to reaching migration threshold (clean up resource to allow again)| failures=1000000 migration-threshold=1000000
Oct 09 19:11:38 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 09 19:11:38 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 09 19:11:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_vip (Started pplxnsms01)
Oct 09 19:11:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms01)
Oct 09 19:11:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs (Started pplxnsms01)
Oct 09 19:11:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms01)
Oct 09 19:11:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms01)
Oct 09 19:11:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms01)
Oct 09 19:11:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_omni (Started pplxnsms01)
Oct 09 19:11:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms01)
Oct 09 19:11:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms01)
Oct 09 19:11:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 09 19:11:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 09 19:11:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 09 19:11:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 09 19:11:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 09 19:11:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 09 19:11:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms02)
Oct 09 19:11:38 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__log_transition_summary) notice: Calculated transition 97, saving inputs in /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 19:11:38 pplxnsms02 pacemaker-schedulerd[2417] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 09 19:11:38 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 09 19:11:38 pplxnsms02 pacemaker-controld [2418] (do_te_invoke) info: Processing graph 97 (ref=pe_calc-dc-1728472298-225) derived from /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 19:11:38 pplxnsms02 pacemaker-controld [2418] (pcmk__execute_graph) notice: Transition 97 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-1006.bz2): Complete
Oct 09 19:11:38 pplxnsms02 pacemaker-controld [2418] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 09 19:11:38 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 09 19:26:38 pplxnsms02 pacemaker-controld [2418] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 09 19:26:38 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 09 19:26:38 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 09 19:26:38 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 09 19:26:38 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) notice: On loss of quorum: Ignore
Oct 09 19:26:38 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 09 19:26:38 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms02 is online
Oct 09 19:26:38 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 09 19:26:38 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms01 is online
Oct 09 19:26:38 pplxnsms02 pacemaker-schedulerd[2417] (unpack_rsc_op_failure) warning: Unexpected result (error) was recorded for start of nco_itnm on pplxnsms02 at Oct 8 20:15:42 2024 | rc=1 id=nco_itnm_last_failure_0
Oct 09 19:26:38 pplxnsms02 pacemaker-schedulerd[2417] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Oct 8 20:12:15 2024
Oct 09 19:26:38 pplxnsms02 pacemaker-schedulerd[2417] (pe_get_failcount) info: nco_itnm has failed INFINITY times on pplxnsms02
Oct 09 19:26:38 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__threshold_reached) warning: nco_itnm cannot run on pplxnsms02 due to reaching migration threshold (clean up resource to allow again)| failures=1000000 migration-threshold=1000000
Oct 09 19:26:38 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 09 19:26:38 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 09 19:26:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_vip (Started pplxnsms01)
Oct 09 19:26:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms01)
Oct 09 19:26:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs (Started pplxnsms01)
Oct 09 19:26:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms01)
Oct 09 19:26:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms01)
Oct 09 19:26:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms01)
Oct 09 19:26:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_omni (Started pplxnsms01)
Oct 09 19:26:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms01)
Oct 09 19:26:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms01)
Oct 09 19:26:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 09 19:26:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 09 19:26:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 09 19:26:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 09 19:26:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 09 19:26:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 09 19:26:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms02)
Oct 09 19:26:38 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__log_transition_summary) notice: Calculated transition 98, saving inputs in /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 19:26:38 pplxnsms02 pacemaker-schedulerd[2417] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 09 19:26:38 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 09 19:26:38 pplxnsms02 pacemaker-controld [2418] (do_te_invoke) info: Processing graph 98 (ref=pe_calc-dc-1728473198-226) derived from /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 19:26:38 pplxnsms02 pacemaker-controld [2418] (pcmk__execute_graph) notice: Transition 98 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-1006.bz2): Complete
Oct 09 19:26:38 pplxnsms02 pacemaker-controld [2418] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 09 19:26:38 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 09 19:41:38 pplxnsms02 pacemaker-controld [2418] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 09 19:41:38 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 09 19:41:38 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 09 19:41:38 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 09 19:41:38 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) notice: On loss of quorum: Ignore
Oct 09 19:41:38 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 09 19:41:38 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms02 is online
Oct 09 19:41:38 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 09 19:41:38 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms01 is online
Oct 09 19:41:38 pplxnsms02 pacemaker-schedulerd[2417] (unpack_rsc_op_failure) warning: Unexpected result (error) was recorded for start of nco_itnm on pplxnsms02 at Oct 8 20:15:42 2024 | rc=1 id=nco_itnm_last_failure_0
Oct 09 19:41:38 pplxnsms02 pacemaker-schedulerd[2417] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Oct 8 20:12:15 2024
Oct 09 19:41:38 pplxnsms02 pacemaker-schedulerd[2417] (pe_get_failcount) info: nco_itnm has failed INFINITY times on pplxnsms02
Oct 09 19:41:38 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__threshold_reached) warning: nco_itnm cannot run on pplxnsms02 due to reaching migration threshold (clean up resource to allow again)| failures=1000000 migration-threshold=1000000
Oct 09 19:41:38 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 09 19:41:38 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 09 19:41:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_vip (Started pplxnsms01)
Oct 09 19:41:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms01)
Oct 09 19:41:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs (Started pplxnsms01)
Oct 09 19:41:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms01)
Oct 09 19:41:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms01)
Oct 09 19:41:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms01)
Oct 09 19:41:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_omni (Started pplxnsms01)
Oct 09 19:41:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms01)
Oct 09 19:41:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms01)
Oct 09 19:41:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 09 19:41:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 09 19:41:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 09 19:41:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 09 19:41:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 09 19:41:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 09 19:41:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms02)
Oct 09 19:41:38 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__log_transition_summary) notice: Calculated transition 99, saving inputs in /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 19:41:38 pplxnsms02 pacemaker-schedulerd[2417] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 09 19:41:38 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 09 19:41:38 pplxnsms02 pacemaker-controld [2418] (do_te_invoke) info: Processing graph 99 (ref=pe_calc-dc-1728474098-227) derived from /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 19:41:38 pplxnsms02 pacemaker-controld [2418] (pcmk__execute_graph) notice: Transition 99 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-1006.bz2): Complete
Oct 09 19:41:38 pplxnsms02 pacemaker-controld [2418] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 09 19:41:38 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 09 19:56:38 pplxnsms02 pacemaker-controld [2418] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 09 19:56:38 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 09 19:56:38 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 09 19:56:38 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 09 19:56:38 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) notice: On loss of quorum: Ignore
Oct 09 19:56:38 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 09 19:56:38 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms02 is online
Oct 09 19:56:38 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 09 19:56:38 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms01 is online
Oct 09 19:56:38 pplxnsms02 pacemaker-schedulerd[2417] (unpack_rsc_op_failure) warning: Unexpected result (error) was recorded for start of nco_itnm on pplxnsms02 at Oct 8 20:15:42 2024 | rc=1 id=nco_itnm_last_failure_0
Oct 09 19:56:38 pplxnsms02 pacemaker-schedulerd[2417] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Oct 8 20:12:15 2024
Oct 09 19:56:38 pplxnsms02 pacemaker-schedulerd[2417] (pe_get_failcount) info: nco_itnm has failed INFINITY times on pplxnsms02
Oct 09 19:56:38 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__threshold_reached) warning: nco_itnm cannot run on pplxnsms02 due to reaching migration threshold (clean up resource to allow again)| failures=1000000 migration-threshold=1000000
Oct 09 19:56:38 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 09 19:56:38 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 09 19:56:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_vip (Started pplxnsms01)
Oct 09 19:56:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms01)
Oct 09 19:56:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs (Started pplxnsms01)
Oct 09 19:56:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms01)
Oct 09 19:56:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms01)
Oct 09 19:56:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms01)
Oct 09 19:56:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_omni (Started pplxnsms01)
Oct 09 19:56:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms01)
Oct 09 19:56:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms01)
Oct 09 19:56:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 09 19:56:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 09 19:56:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 09 19:56:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 09 19:56:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 09 19:56:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 09 19:56:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms02)
Oct 09 19:56:38 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__log_transition_summary) notice: Calculated transition 100, saving inputs in /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 19:56:38 pplxnsms02 pacemaker-schedulerd[2417] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 09 19:56:38 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 09 19:56:38 pplxnsms02 pacemaker-controld [2418] (do_te_invoke) info: Processing graph 100 (ref=pe_calc-dc-1728474998-228) derived from /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 19:56:38 pplxnsms02 pacemaker-controld [2418] (pcmk__execute_graph) notice: Transition 100 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-1006.bz2): Complete
Oct 09 19:56:38 pplxnsms02 pacemaker-controld [2418] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 09 19:56:38 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 09 20:11:38 pplxnsms02 pacemaker-controld [2418] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 09 20:11:38 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 09 20:11:38 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 09 20:11:38 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 09 20:11:38 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) notice: On loss of quorum: Ignore
Oct 09 20:11:38 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 09 20:11:38 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms02 is online
Oct 09 20:11:38 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 09 20:11:38 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms01 is online
Oct 09 20:11:38 pplxnsms02 pacemaker-schedulerd[2417] (unpack_rsc_op_failure) warning: Unexpected result (error) was recorded for start of nco_itnm on pplxnsms02 at Oct 8 20:15:42 2024 | rc=1 id=nco_itnm_last_failure_0
Oct 09 20:11:38 pplxnsms02 pacemaker-schedulerd[2417] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Oct 8 20:12:15 2024
Oct 09 20:11:38 pplxnsms02 pacemaker-schedulerd[2417] (pe_get_failcount) info: nco_itnm has failed INFINITY times on pplxnsms02
Oct 09 20:11:38 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__threshold_reached) warning: nco_itnm cannot run on pplxnsms02 due to reaching migration threshold (clean up resource to allow again)| failures=1000000 migration-threshold=1000000
Oct 09 20:11:38 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 09 20:11:38 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 09 20:11:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_vip (Started pplxnsms01)
Oct 09 20:11:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms01)
Oct 09 20:11:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs (Started pplxnsms01)
Oct 09 20:11:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms01)
Oct 09 20:11:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms01)
Oct 09 20:11:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms01)
Oct 09 20:11:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_omni (Started pplxnsms01)
Oct 09 20:11:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms01)
Oct 09 20:11:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms01)
Oct 09 20:11:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 09 20:11:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 09 20:11:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 09 20:11:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 09 20:11:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 09 20:11:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 09 20:11:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms02)
Oct 09 20:11:38 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__log_transition_summary) notice: Calculated transition 101, saving inputs in /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 20:11:38 pplxnsms02 pacemaker-schedulerd[2417] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 09 20:11:38 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 09 20:11:38 pplxnsms02 pacemaker-controld [2418] (do_te_invoke) info: Processing graph 101 (ref=pe_calc-dc-1728475898-229) derived from /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 20:11:38 pplxnsms02 pacemaker-controld [2418] (pcmk__execute_graph) notice: Transition 101 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-1006.bz2): Complete
Oct 09 20:11:38 pplxnsms02 pacemaker-controld [2418] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 09 20:11:38 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 09 20:26:38 pplxnsms02 pacemaker-controld [2418] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 09 20:26:38 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 09 20:26:38 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 09 20:26:38 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 09 20:26:38 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) notice: On loss of quorum: Ignore
Oct 09 20:26:38 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 09 20:26:38 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms02 is online
Oct 09 20:26:38 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 09 20:26:38 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms01 is online
Oct 09 20:26:38 pplxnsms02 pacemaker-schedulerd[2417] (unpack_rsc_op_failure) warning: Unexpected result (error) was recorded for start of nco_itnm on pplxnsms02 at Oct 8 20:15:42 2024 | rc=1 id=nco_itnm_last_failure_0
Oct 09 20:26:38 pplxnsms02 pacemaker-schedulerd[2417] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Oct 8 20:12:15 2024
Oct 09 20:26:38 pplxnsms02 pacemaker-schedulerd[2417] (pe_get_failcount) info: nco_itnm has failed INFINITY times on pplxnsms02
Oct 09 20:26:38 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__threshold_reached) warning: nco_itnm cannot run on pplxnsms02 due to reaching migration threshold (clean up resource to allow again)| failures=1000000 migration-threshold=1000000
Oct 09 20:26:38 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 09 20:26:38 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 09 20:26:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_vip (Started pplxnsms01)
Oct 09 20:26:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms01)
Oct 09 20:26:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs (Started pplxnsms01)
Oct 09 20:26:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms01)
Oct 09 20:26:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms01)
Oct 09 20:26:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms01)
Oct 09 20:26:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_omni (Started pplxnsms01)
Oct 09 20:26:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms01)
Oct 09 20:26:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms01)
Oct 09 20:26:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 09 20:26:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 09 20:26:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 09 20:26:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 09 20:26:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 09 20:26:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 09 20:26:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms02)
Oct 09 20:26:38 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__log_transition_summary) notice: Calculated transition 102, saving inputs in /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 20:26:38 pplxnsms02 pacemaker-schedulerd[2417] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 09 20:26:38 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 09 20:26:38 pplxnsms02 pacemaker-controld [2418] (do_te_invoke) info: Processing graph 102 (ref=pe_calc-dc-1728476798-230) derived from /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 20:26:38 pplxnsms02 pacemaker-controld [2418] (pcmk__execute_graph) notice: Transition 102 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-1006.bz2): Complete
Oct 09 20:26:38 pplxnsms02 pacemaker-controld [2418] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 09 20:26:38 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 09 20:41:38 pplxnsms02 pacemaker-controld [2418] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 09 20:41:38 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 09 20:41:38 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 09 20:41:38 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 09 20:41:38 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) notice: On loss of quorum: Ignore
Oct 09 20:41:38 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 09 20:41:38 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms02 is online
Oct 09 20:41:38 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 09 20:41:38 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms01 is online
Oct 09 20:41:38 pplxnsms02 pacemaker-schedulerd[2417] (unpack_rsc_op_failure) warning: Unexpected result (error) was recorded for start of nco_itnm on pplxnsms02 at Oct 8 20:15:42 2024 | rc=1 id=nco_itnm_last_failure_0
Oct 09 20:41:38 pplxnsms02 pacemaker-schedulerd[2417] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Oct 8 20:12:15 2024
Oct 09 20:41:38 pplxnsms02 pacemaker-schedulerd[2417] (pe_get_failcount) info: nco_itnm has failed INFINITY times on pplxnsms02
Oct 09 20:41:38 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__threshold_reached) warning: nco_itnm cannot run on pplxnsms02 due to reaching migration threshold (clean up resource to allow again)| failures=1000000 migration-threshold=1000000
Oct 09 20:41:38 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 09 20:41:38 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 09 20:41:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_vip (Started pplxnsms01)
Oct 09 20:41:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms01)
Oct 09 20:41:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs (Started pplxnsms01)
Oct 09 20:41:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms01)
Oct 09 20:41:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms01)
Oct 09 20:41:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms01)
Oct 09 20:41:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_omni (Started pplxnsms01)
Oct 09 20:41:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms01)
Oct 09 20:41:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms01)
Oct 09 20:41:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 09 20:41:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 09 20:41:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 09 20:41:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 09 20:41:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 09 20:41:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 09 20:41:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms02)
Oct 09 20:41:38 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__log_transition_summary) notice: Calculated transition 103, saving inputs in /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 20:41:38 pplxnsms02 pacemaker-schedulerd[2417] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 09 20:41:38 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 09 20:41:38 pplxnsms02 pacemaker-controld [2418] (do_te_invoke) info: Processing graph 103 (ref=pe_calc-dc-1728477698-231) derived from /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 20:41:38 pplxnsms02 pacemaker-controld [2418] (pcmk__execute_graph) notice: Transition 103 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-1006.bz2): Complete
Oct 09 20:41:38 pplxnsms02 pacemaker-controld [2418] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 09 20:41:38 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 09 20:56:38 pplxnsms02 pacemaker-controld [2418] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 09 20:56:38 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 09 20:56:38 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 09 20:56:38 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 09 20:56:38 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) notice: On loss of quorum: Ignore
Oct 09 20:56:38 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 09 20:56:38 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms02 is online
Oct 09 20:56:38 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 09 20:56:38 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms01 is online
Oct 09 20:56:38 pplxnsms02 pacemaker-schedulerd[2417] (unpack_rsc_op_failure) warning: Unexpected result (error) was recorded for start of nco_itnm on pplxnsms02 at Oct 8 20:15:42 2024 | rc=1 id=nco_itnm_last_failure_0
Oct 09 20:56:38 pplxnsms02 pacemaker-schedulerd[2417] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Oct 8 20:12:15 2024
Oct 09 20:56:38 pplxnsms02 pacemaker-schedulerd[2417] (pe_get_failcount) info: nco_itnm has failed INFINITY times on pplxnsms02
Oct 09 20:56:38 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__threshold_reached) warning: nco_itnm cannot run on pplxnsms02 due to reaching migration threshold (clean up resource to allow again)| failures=1000000 migration-threshold=1000000
Oct 09 20:56:38 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 09 20:56:38 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 09 20:56:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_vip (Started pplxnsms01)
Oct 09 20:56:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms01)
Oct 09 20:56:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs (Started pplxnsms01)
Oct 09 20:56:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms01)
Oct 09 20:56:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms01)
Oct 09 20:56:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms01)
Oct 09 20:56:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_omni (Started pplxnsms01)
Oct 09 20:56:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms01)
Oct 09 20:56:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms01)
Oct 09 20:56:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 09 20:56:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 09 20:56:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 09 20:56:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 09 20:56:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 09 20:56:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 09 20:56:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms02)
Oct 09 20:56:38 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__log_transition_summary) notice: Calculated transition 104, saving inputs in /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 20:56:38 pplxnsms02 pacemaker-schedulerd[2417] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 09 20:56:38 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 09 20:56:38 pplxnsms02 pacemaker-controld [2418] (do_te_invoke) info: Processing graph 104 (ref=pe_calc-dc-1728478598-232) derived from /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 20:56:38 pplxnsms02 pacemaker-controld [2418] (pcmk__execute_graph) notice: Transition 104 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-1006.bz2): Complete
Oct 09 20:56:38 pplxnsms02 pacemaker-controld [2418] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 09 20:56:38 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 09 21:11:38 pplxnsms02 pacemaker-controld [2418] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 09 21:11:38 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 09 21:11:38 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 09 21:11:38 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 09 21:11:38 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) notice: On loss of quorum: Ignore
Oct 09 21:11:38 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 09 21:11:38 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms02 is online
Oct 09 21:11:38 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 09 21:11:38 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms01 is online
Oct 09 21:11:38 pplxnsms02 pacemaker-schedulerd[2417] (unpack_rsc_op_failure) warning: Unexpected result (error) was recorded for start of nco_itnm on pplxnsms02 at Oct 8 20:15:42 2024 | rc=1 id=nco_itnm_last_failure_0
Oct 09 21:11:38 pplxnsms02 pacemaker-schedulerd[2417] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Oct 8 20:12:15 2024
Oct 09 21:11:38 pplxnsms02 pacemaker-schedulerd[2417] (pe_get_failcount) info: nco_itnm has failed INFINITY times on pplxnsms02
Oct 09 21:11:38 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__threshold_reached) warning: nco_itnm cannot run on pplxnsms02 due to reaching migration threshold (clean up resource to allow again)| failures=1000000 migration-threshold=1000000
Oct 09 21:11:38 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 09 21:11:38 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 09 21:11:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_vip (Started pplxnsms01)
Oct 09 21:11:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms01)
Oct 09 21:11:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs (Started pplxnsms01)
Oct 09 21:11:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms01)
Oct 09 21:11:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms01)
Oct 09 21:11:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms01)
Oct 09 21:11:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_omni (Started pplxnsms01)
Oct 09 21:11:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms01)
Oct 09 21:11:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms01)
Oct 09 21:11:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 09 21:11:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 09 21:11:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 09 21:11:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 09 21:11:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 09 21:11:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 09 21:11:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms02)
Oct 09 21:11:38 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__log_transition_summary) notice: Calculated transition 105, saving inputs in /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 21:11:38 pplxnsms02 pacemaker-schedulerd[2417] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 09 21:11:38 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 09 21:11:38 pplxnsms02 pacemaker-controld [2418] (do_te_invoke) info: Processing graph 105 (ref=pe_calc-dc-1728479498-233) derived from /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 21:11:38 pplxnsms02 pacemaker-controld [2418] (pcmk__execute_graph) notice: Transition 105 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-1006.bz2): Complete
Oct 09 21:11:38 pplxnsms02 pacemaker-controld [2418] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 09 21:11:38 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 09 21:26:38 pplxnsms02 pacemaker-controld [2418] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 09 21:26:38 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 09 21:26:38 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 09 21:26:38 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 09 21:26:38 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) notice: On loss of quorum: Ignore
Oct 09 21:26:38 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 09 21:26:38 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms02 is online
Oct 09 21:26:38 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 09 21:26:38 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms01 is online
Oct 09 21:26:38 pplxnsms02 pacemaker-schedulerd[2417] (unpack_rsc_op_failure) warning: Unexpected result (error) was recorded for start of nco_itnm on pplxnsms02 at Oct 8 20:15:42 2024 | rc=1 id=nco_itnm_last_failure_0
Oct 09 21:26:38 pplxnsms02 pacemaker-schedulerd[2417] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Oct 8 20:12:15 2024
Oct 09 21:26:38 pplxnsms02 pacemaker-schedulerd[2417] (pe_get_failcount) info: nco_itnm has failed INFINITY times on pplxnsms02
Oct 09 21:26:38 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__threshold_reached) warning: nco_itnm cannot run on pplxnsms02 due to reaching migration threshold (clean up resource to allow again)| failures=1000000 migration-threshold=1000000
Oct 09 21:26:38 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 09 21:26:38 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 09 21:26:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_vip (Started pplxnsms01)
Oct 09 21:26:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms01)
Oct 09 21:26:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs (Started pplxnsms01)
Oct 09 21:26:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms01)
Oct 09 21:26:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms01)
Oct 09 21:26:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms01)
Oct 09 21:26:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_omni (Started pplxnsms01)
Oct 09 21:26:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms01)
Oct 09 21:26:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms01)
Oct 09 21:26:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 09 21:26:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 09 21:26:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 09 21:26:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 09 21:26:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 09 21:26:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 09 21:26:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms02)
Oct 09 21:26:38 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__log_transition_summary) notice: Calculated transition 106, saving inputs in /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 21:26:38 pplxnsms02 pacemaker-schedulerd[2417] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 09 21:26:38 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 09 21:26:38 pplxnsms02 pacemaker-controld [2418] (do_te_invoke) info: Processing graph 106 (ref=pe_calc-dc-1728480398-234) derived from /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 21:26:38 pplxnsms02 pacemaker-controld [2418] (pcmk__execute_graph) notice: Transition 106 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-1006.bz2): Complete
Oct 09 21:26:38 pplxnsms02 pacemaker-controld [2418] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 09 21:26:38 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 09 21:41:38 pplxnsms02 pacemaker-controld [2418] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 09 21:41:38 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 09 21:41:38 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 09 21:41:38 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 09 21:41:38 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) notice: On loss of quorum: Ignore
Oct 09 21:41:38 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 09 21:41:38 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms02 is online
Oct 09 21:41:38 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 09 21:41:38 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms01 is online
Oct 09 21:41:38 pplxnsms02 pacemaker-schedulerd[2417] (unpack_rsc_op_failure) warning: Unexpected result (error) was recorded for start of nco_itnm on pplxnsms02 at Oct 8 20:15:42 2024 | rc=1 id=nco_itnm_last_failure_0
Oct 09 21:41:38 pplxnsms02 pacemaker-schedulerd[2417] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Oct 8 20:12:15 2024
Oct 09 21:41:38 pplxnsms02 pacemaker-schedulerd[2417] (pe_get_failcount) info: nco_itnm has failed INFINITY times on pplxnsms02
Oct 09 21:41:38 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__threshold_reached) warning: nco_itnm cannot run on pplxnsms02 due to reaching migration threshold (clean up resource to allow again)| failures=1000000 migration-threshold=1000000
Oct 09 21:41:38 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 09 21:41:38 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 09 21:41:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_vip (Started pplxnsms01)
Oct 09 21:41:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms01)
Oct 09 21:41:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs (Started pplxnsms01)
Oct 09 21:41:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms01)
Oct 09 21:41:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms01)
Oct 09 21:41:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms01)
Oct 09 21:41:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_omni (Started pplxnsms01)
Oct 09 21:41:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms01)
Oct 09 21:41:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms01)
Oct 09 21:41:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 09 21:41:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 09 21:41:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 09 21:41:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 09 21:41:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 09 21:41:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 09 21:41:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms02)
Oct 09 21:41:38 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__log_transition_summary) notice: Calculated transition 107, saving inputs in /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 21:41:38 pplxnsms02 pacemaker-schedulerd[2417] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 09 21:41:38 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 09 21:41:38 pplxnsms02 pacemaker-controld [2418] (do_te_invoke) info: Processing graph 107 (ref=pe_calc-dc-1728481298-235) derived from /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 21:41:38 pplxnsms02 pacemaker-controld [2418] (pcmk__execute_graph) notice: Transition 107 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-1006.bz2): Complete
Oct 09 21:41:38 pplxnsms02 pacemaker-controld [2418] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 09 21:41:38 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 09 21:56:38 pplxnsms02 pacemaker-controld [2418] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 09 21:56:38 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 09 21:56:38 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 09 21:56:38 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 09 21:56:38 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) notice: On loss of quorum: Ignore
Oct 09 21:56:38 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 09 21:56:38 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms02 is online
Oct 09 21:56:38 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 09 21:56:38 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms01 is online
Oct 09 21:56:38 pplxnsms02 pacemaker-schedulerd[2417] (unpack_rsc_op_failure) warning: Unexpected result (error) was recorded for start of nco_itnm on pplxnsms02 at Oct 8 20:15:42 2024 | rc=1 id=nco_itnm_last_failure_0
Oct 09 21:56:38 pplxnsms02 pacemaker-schedulerd[2417] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Oct 8 20:12:15 2024
Oct 09 21:56:38 pplxnsms02 pacemaker-schedulerd[2417] (pe_get_failcount) info: nco_itnm has failed INFINITY times on pplxnsms02
Oct 09 21:56:38 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__threshold_reached) warning: nco_itnm cannot run on pplxnsms02 due to reaching migration threshold (clean up resource to allow again)| failures=1000000 migration-threshold=1000000
Oct 09 21:56:38 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 09 21:56:38 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 09 21:56:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_vip (Started pplxnsms01)
Oct 09 21:56:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms01)
Oct 09 21:56:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs (Started pplxnsms01)
Oct 09 21:56:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms01)
Oct 09 21:56:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms01)
Oct 09 21:56:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms01)
Oct 09 21:56:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_omni (Started pplxnsms01)
Oct 09 21:56:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms01)
Oct 09 21:56:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms01)
Oct 09 21:56:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 09 21:56:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 09 21:56:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 09 21:56:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 09 21:56:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 09 21:56:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 09 21:56:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms02)
Oct 09 21:56:38 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__log_transition_summary) notice: Calculated transition 108, saving inputs in /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 21:56:38 pplxnsms02 pacemaker-schedulerd[2417] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 09 21:56:38 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 09 21:56:38 pplxnsms02 pacemaker-controld [2418] (do_te_invoke) info: Processing graph 108 (ref=pe_calc-dc-1728482198-236) derived from /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 21:56:38 pplxnsms02 pacemaker-controld [2418] (pcmk__execute_graph) notice: Transition 108 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-1006.bz2): Complete
Oct 09 21:56:38 pplxnsms02 pacemaker-controld [2418] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 09 21:56:38 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 09 22:11:38 pplxnsms02 pacemaker-controld [2418] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 09 22:11:38 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 09 22:11:38 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 09 22:11:38 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 09 22:11:38 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) notice: On loss of quorum: Ignore
Oct 09 22:11:38 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 09 22:11:38 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms02 is online
Oct 09 22:11:38 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 09 22:11:38 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms01 is online
Oct 09 22:11:38 pplxnsms02 pacemaker-schedulerd[2417] (unpack_rsc_op_failure) warning: Unexpected result (error) was recorded for start of nco_itnm on pplxnsms02 at Oct 8 20:15:42 2024 | rc=1 id=nco_itnm_last_failure_0
Oct 09 22:11:38 pplxnsms02 pacemaker-schedulerd[2417] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Oct 8 20:12:15 2024
Oct 09 22:11:38 pplxnsms02 pacemaker-schedulerd[2417] (pe_get_failcount) info: nco_itnm has failed INFINITY times on pplxnsms02
Oct 09 22:11:38 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__threshold_reached) warning: nco_itnm cannot run on pplxnsms02 due to reaching migration threshold (clean up resource to allow again)| failures=1000000 migration-threshold=1000000
Oct 09 22:11:38 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 09 22:11:38 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 09 22:11:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_vip (Started pplxnsms01)
Oct 09 22:11:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms01)
Oct 09 22:11:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs (Started pplxnsms01)
Oct 09 22:11:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms01)
Oct 09 22:11:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms01)
Oct 09 22:11:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms01)
Oct 09 22:11:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_omni (Started pplxnsms01)
Oct 09 22:11:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms01)
Oct 09 22:11:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms01)
Oct 09 22:11:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 09 22:11:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 09 22:11:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 09 22:11:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 09 22:11:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 09 22:11:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 09 22:11:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms02)
Oct 09 22:11:38 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__log_transition_summary) notice: Calculated transition 109, saving inputs in /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 22:11:38 pplxnsms02 pacemaker-schedulerd[2417] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 09 22:11:38 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 09 22:11:38 pplxnsms02 pacemaker-controld [2418] (do_te_invoke) info: Processing graph 109 (ref=pe_calc-dc-1728483098-237) derived from /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 22:11:38 pplxnsms02 pacemaker-controld [2418] (pcmk__execute_graph) notice: Transition 109 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-1006.bz2): Complete
Oct 09 22:11:38 pplxnsms02 pacemaker-controld [2418] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 09 22:11:38 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 09 22:26:38 pplxnsms02 pacemaker-controld [2418] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 09 22:26:38 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 09 22:26:38 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 09 22:26:38 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 09 22:26:38 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) notice: On loss of quorum: Ignore
Oct 09 22:26:38 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 09 22:26:38 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms02 is online
Oct 09 22:26:38 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 09 22:26:38 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms01 is online
Oct 09 22:26:38 pplxnsms02 pacemaker-schedulerd[2417] (unpack_rsc_op_failure) warning: Unexpected result (error) was recorded for start of nco_itnm on pplxnsms02 at Oct 8 20:15:42 2024 | rc=1 id=nco_itnm_last_failure_0
Oct 09 22:26:38 pplxnsms02 pacemaker-schedulerd[2417] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Oct 8 20:12:15 2024
Oct 09 22:26:38 pplxnsms02 pacemaker-schedulerd[2417] (pe_get_failcount) info: nco_itnm has failed INFINITY times on pplxnsms02
Oct 09 22:26:38 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__threshold_reached) warning: nco_itnm cannot run on pplxnsms02 due to reaching migration threshold (clean up resource to allow again)| failures=1000000 migration-threshold=1000000
Oct 09 22:26:38 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 09 22:26:38 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 09 22:26:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_vip (Started pplxnsms01)
Oct 09 22:26:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms01)
Oct 09 22:26:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs (Started pplxnsms01)
Oct 09 22:26:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms01)
Oct 09 22:26:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms01)
Oct 09 22:26:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms01)
Oct 09 22:26:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_omni (Started pplxnsms01)
Oct 09 22:26:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms01)
Oct 09 22:26:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms01)
Oct 09 22:26:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 09 22:26:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 09 22:26:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 09 22:26:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 09 22:26:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 09 22:26:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 09 22:26:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms02)
Oct 09 22:26:38 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__log_transition_summary) notice: Calculated transition 110, saving inputs in /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 22:26:38 pplxnsms02 pacemaker-schedulerd[2417] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 09 22:26:38 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 09 22:26:38 pplxnsms02 pacemaker-controld [2418] (do_te_invoke) info: Processing graph 110 (ref=pe_calc-dc-1728483998-238) derived from /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 22:26:38 pplxnsms02 pacemaker-controld [2418] (pcmk__execute_graph) notice: Transition 110 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-1006.bz2): Complete
Oct 09 22:26:38 pplxnsms02 pacemaker-controld [2418] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 09 22:26:38 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 09 22:41:38 pplxnsms02 pacemaker-controld [2418] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 09 22:41:38 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 09 22:41:38 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 09 22:41:38 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 09 22:41:38 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) notice: On loss of quorum: Ignore
Oct 09 22:41:38 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 09 22:41:38 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms02 is online
Oct 09 22:41:38 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 09 22:41:38 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms01 is online
Oct 09 22:41:38 pplxnsms02 pacemaker-schedulerd[2417] (unpack_rsc_op_failure) warning: Unexpected result (error) was recorded for start of nco_itnm on pplxnsms02 at Oct 8 20:15:42 2024 | rc=1 id=nco_itnm_last_failure_0
Oct 09 22:41:38 pplxnsms02 pacemaker-schedulerd[2417] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Oct 8 20:12:15 2024
Oct 09 22:41:38 pplxnsms02 pacemaker-schedulerd[2417] (pe_get_failcount) info: nco_itnm has failed INFINITY times on pplxnsms02
Oct 09 22:41:38 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__threshold_reached) warning: nco_itnm cannot run on pplxnsms02 due to reaching migration threshold (clean up resource to allow again)| failures=1000000 migration-threshold=1000000
Oct 09 22:41:38 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 09 22:41:38 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 09 22:41:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_vip (Started pplxnsms01)
Oct 09 22:41:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms01)
Oct 09 22:41:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs (Started pplxnsms01)
Oct 09 22:41:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms01)
Oct 09 22:41:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms01)
Oct 09 22:41:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms01)
Oct 09 22:41:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_omni (Started pplxnsms01)
Oct 09 22:41:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms01)
Oct 09 22:41:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms01)
Oct 09 22:41:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 09 22:41:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 09 22:41:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 09 22:41:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 09 22:41:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 09 22:41:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 09 22:41:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms02)
Oct 09 22:41:38 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__log_transition_summary) notice: Calculated transition 111, saving inputs in /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 22:41:38 pplxnsms02 pacemaker-schedulerd[2417] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 09 22:41:38 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 09 22:41:38 pplxnsms02 pacemaker-controld [2418] (do_te_invoke) info: Processing graph 111 (ref=pe_calc-dc-1728484898-239) derived from /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 22:41:38 pplxnsms02 pacemaker-controld [2418] (pcmk__execute_graph) notice: Transition 111 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-1006.bz2): Complete
Oct 09 22:41:38 pplxnsms02 pacemaker-controld [2418] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 09 22:41:38 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 09 22:56:38 pplxnsms02 pacemaker-controld [2418] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 09 22:56:38 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 09 22:56:38 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 09 22:56:38 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 09 22:56:38 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) notice: On loss of quorum: Ignore
Oct 09 22:56:38 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 09 22:56:38 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms02 is online
Oct 09 22:56:38 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 09 22:56:38 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms01 is online
Oct 09 22:56:38 pplxnsms02 pacemaker-schedulerd[2417] (unpack_rsc_op_failure) warning: Unexpected result (error) was recorded for start of nco_itnm on pplxnsms02 at Oct 8 20:15:42 2024 | rc=1 id=nco_itnm_last_failure_0
Oct 09 22:56:38 pplxnsms02 pacemaker-schedulerd[2417] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Oct 8 20:12:15 2024
Oct 09 22:56:38 pplxnsms02 pacemaker-schedulerd[2417] (pe_get_failcount) info: nco_itnm has failed INFINITY times on pplxnsms02
Oct 09 22:56:38 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__threshold_reached) warning: nco_itnm cannot run on pplxnsms02 due to reaching migration threshold (clean up resource to allow again)| failures=1000000 migration-threshold=1000000
Oct 09 22:56:38 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 09 22:56:38 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 09 22:56:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_vip (Started pplxnsms01)
Oct 09 22:56:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms01)
Oct 09 22:56:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs (Started pplxnsms01)
Oct 09 22:56:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms01)
Oct 09 22:56:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms01)
Oct 09 22:56:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms01)
Oct 09 22:56:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_omni (Started pplxnsms01)
Oct 09 22:56:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms01)
Oct 09 22:56:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms01)
Oct 09 22:56:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 09 22:56:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 09 22:56:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 09 22:56:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 09 22:56:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 09 22:56:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 09 22:56:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms02)
Oct 09 22:56:38 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__log_transition_summary) notice: Calculated transition 112, saving inputs in /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 22:56:38 pplxnsms02 pacemaker-schedulerd[2417] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 09 22:56:38 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 09 22:56:38 pplxnsms02 pacemaker-controld [2418] (do_te_invoke) info: Processing graph 112 (ref=pe_calc-dc-1728485798-240) derived from /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 22:56:38 pplxnsms02 pacemaker-controld [2418] (pcmk__execute_graph) notice: Transition 112 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-1006.bz2): Complete
Oct 09 22:56:38 pplxnsms02 pacemaker-controld [2418] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 09 22:56:38 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 09 23:11:38 pplxnsms02 pacemaker-controld [2418] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 09 23:11:38 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 09 23:11:38 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 09 23:11:38 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 09 23:11:38 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) notice: On loss of quorum: Ignore
Oct 09 23:11:38 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 09 23:11:38 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms02 is online
Oct 09 23:11:38 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 09 23:11:38 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms01 is online
Oct 09 23:11:38 pplxnsms02 pacemaker-schedulerd[2417] (unpack_rsc_op_failure) warning: Unexpected result (error) was recorded for start of nco_itnm on pplxnsms02 at Oct 8 20:15:42 2024 | rc=1 id=nco_itnm_last_failure_0
Oct 09 23:11:38 pplxnsms02 pacemaker-schedulerd[2417] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Oct 8 20:12:15 2024
Oct 09 23:11:38 pplxnsms02 pacemaker-schedulerd[2417] (pe_get_failcount) info: nco_itnm has failed INFINITY times on pplxnsms02
Oct 09 23:11:38 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__threshold_reached) warning: nco_itnm cannot run on pplxnsms02 due to reaching migration threshold (clean up resource to allow again)| failures=1000000 migration-threshold=1000000
Oct 09 23:11:38 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 09 23:11:38 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 09 23:11:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_vip (Started pplxnsms01)
Oct 09 23:11:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms01)
Oct 09 23:11:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs (Started pplxnsms01)
Oct 09 23:11:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms01)
Oct 09 23:11:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms01)
Oct 09 23:11:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms01)
Oct 09 23:11:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_omni (Started pplxnsms01)
Oct 09 23:11:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms01)
Oct 09 23:11:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms01)
Oct 09 23:11:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 09 23:11:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 09 23:11:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 09 23:11:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 09 23:11:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 09 23:11:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 09 23:11:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms02)
Oct 09 23:11:38 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__log_transition_summary) notice: Calculated transition 113, saving inputs in /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 23:11:38 pplxnsms02 pacemaker-schedulerd[2417] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 09 23:11:38 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 09 23:11:38 pplxnsms02 pacemaker-controld [2418] (do_te_invoke) info: Processing graph 113 (ref=pe_calc-dc-1728486698-241) derived from /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 23:11:38 pplxnsms02 pacemaker-controld [2418] (pcmk__execute_graph) notice: Transition 113 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-1006.bz2): Complete
Oct 09 23:11:38 pplxnsms02 pacemaker-controld [2418] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 09 23:11:38 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 09 23:26:38 pplxnsms02 pacemaker-controld [2418] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 09 23:26:38 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 09 23:26:38 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 09 23:26:38 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 09 23:26:38 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) notice: On loss of quorum: Ignore
Oct 09 23:26:38 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 09 23:26:38 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms02 is online
Oct 09 23:26:38 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 09 23:26:38 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms01 is online
Oct 09 23:26:38 pplxnsms02 pacemaker-schedulerd[2417] (unpack_rsc_op_failure) warning: Unexpected result (error) was recorded for start of nco_itnm on pplxnsms02 at Oct 8 20:15:42 2024 | rc=1 id=nco_itnm_last_failure_0
Oct 09 23:26:38 pplxnsms02 pacemaker-schedulerd[2417] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Oct 8 20:12:15 2024
Oct 09 23:26:38 pplxnsms02 pacemaker-schedulerd[2417] (pe_get_failcount) info: nco_itnm has failed INFINITY times on pplxnsms02
Oct 09 23:26:38 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__threshold_reached) warning: nco_itnm cannot run on pplxnsms02 due to reaching migration threshold (clean up resource to allow again)| failures=1000000 migration-threshold=1000000
Oct 09 23:26:38 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 09 23:26:38 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 09 23:26:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_vip (Started pplxnsms01)
Oct 09 23:26:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms01)
Oct 09 23:26:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs (Started pplxnsms01)
Oct 09 23:26:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms01)
Oct 09 23:26:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms01)
Oct 09 23:26:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms01)
Oct 09 23:26:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_omni (Started pplxnsms01)
Oct 09 23:26:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms01)
Oct 09 23:26:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms01)
Oct 09 23:26:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 09 23:26:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 09 23:26:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 09 23:26:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 09 23:26:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 09 23:26:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 09 23:26:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms02)
Oct 09 23:26:38 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__log_transition_summary) notice: Calculated transition 114, saving inputs in /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 23:26:38 pplxnsms02 pacemaker-schedulerd[2417] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 09 23:26:38 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 09 23:26:38 pplxnsms02 pacemaker-controld [2418] (do_te_invoke) info: Processing graph 114 (ref=pe_calc-dc-1728487598-242) derived from /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 23:26:38 pplxnsms02 pacemaker-controld [2418] (pcmk__execute_graph) notice: Transition 114 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-1006.bz2): Complete
Oct 09 23:26:38 pplxnsms02 pacemaker-controld [2418] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 09 23:26:38 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 09 23:41:38 pplxnsms02 pacemaker-controld [2418] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 09 23:41:38 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 09 23:41:38 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 09 23:41:38 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 09 23:41:38 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) notice: On loss of quorum: Ignore
Oct 09 23:41:38 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 09 23:41:38 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms02 is online
Oct 09 23:41:38 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 09 23:41:38 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms01 is online
Oct 09 23:41:38 pplxnsms02 pacemaker-schedulerd[2417] (unpack_rsc_op_failure) warning: Unexpected result (error) was recorded for start of nco_itnm on pplxnsms02 at Oct 8 20:15:42 2024 | rc=1 id=nco_itnm_last_failure_0
Oct 09 23:41:38 pplxnsms02 pacemaker-schedulerd[2417] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Oct 8 20:12:15 2024
Oct 09 23:41:38 pplxnsms02 pacemaker-schedulerd[2417] (pe_get_failcount) info: nco_itnm has failed INFINITY times on pplxnsms02
Oct 09 23:41:38 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__threshold_reached) warning: nco_itnm cannot run on pplxnsms02 due to reaching migration threshold (clean up resource to allow again)| failures=1000000 migration-threshold=1000000
Oct 09 23:41:38 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 09 23:41:38 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 09 23:41:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_vip (Started pplxnsms01)
Oct 09 23:41:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms01)
Oct 09 23:41:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs (Started pplxnsms01)
Oct 09 23:41:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms01)
Oct 09 23:41:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms01)
Oct 09 23:41:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms01)
Oct 09 23:41:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_omni (Started pplxnsms01)
Oct 09 23:41:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms01)
Oct 09 23:41:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms01)
Oct 09 23:41:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 09 23:41:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 09 23:41:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 09 23:41:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 09 23:41:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 09 23:41:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 09 23:41:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms02)
Oct 09 23:41:38 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__log_transition_summary) notice: Calculated transition 115, saving inputs in /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 23:41:38 pplxnsms02 pacemaker-schedulerd[2417] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 09 23:41:38 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 09 23:41:38 pplxnsms02 pacemaker-controld [2418] (do_te_invoke) info: Processing graph 115 (ref=pe_calc-dc-1728488498-243) derived from /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 23:41:38 pplxnsms02 pacemaker-controld [2418] (pcmk__execute_graph) notice: Transition 115 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-1006.bz2): Complete
Oct 09 23:41:38 pplxnsms02 pacemaker-controld [2418] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 09 23:41:38 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd
Oct 09 23:56:38 pplxnsms02 pacemaker-controld [2418] (crm_timer_popped) info: Cluster Recheck Timer just popped | input=I_PE_CALC time=900000ms
Oct 09 23:56:38 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped
Oct 09 23:56:38 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 09 23:56:38 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) info: Watchdog-based self-fencing will be performed via SBD if fencing is required and stonith-watchdog-timeout is nonzero
Oct 09 23:56:38 pplxnsms02 pacemaker-schedulerd[2417] (unpack_config) notice: On loss of quorum: Ignore
Oct 09 23:56:38 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms02 is active
Oct 09 23:56:38 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms02 is online
Oct 09 23:56:38 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status_fencing) info: Node pplxnsms01 is active
Oct 09 23:56:38 pplxnsms02 pacemaker-schedulerd[2417] (determine_online_status) info: Node pplxnsms01 is online
Oct 09 23:56:38 pplxnsms02 pacemaker-schedulerd[2417] (unpack_rsc_op_failure) warning: Unexpected result (error) was recorded for start of nco_itnm on pplxnsms02 at Oct 8 20:15:42 2024 | rc=1 id=nco_itnm_last_failure_0
Oct 09 23:56:38 pplxnsms02 pacemaker-schedulerd[2417] (remap_operation) info: Probe found itm_vip active on pplxnsms01 at Oct 8 20:12:15 2024
Oct 09 23:56:38 pplxnsms02 pacemaker-schedulerd[2417] (pe_get_failcount) info: nco_itnm has failed INFINITY times on pplxnsms02
Oct 09 23:56:38 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__threshold_reached) warning: nco_itnm cannot run on pplxnsms02 due to reaching migration threshold (clean up resource to allow again)| failures=1000000 migration-threshold=1000000
Oct 09 23:56:38 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_mariadb cannot run anywhere
Oct 09 23:56:38 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__native_allocate) info: Resource web_matomo cannot run anywhere
Oct 09 23:56:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_vip (Started pplxnsms01)
Oct 09 23:56:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_lvm (Started pplxnsms01)
Oct 09 23:56:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs (Started pplxnsms01)
Oct 09 23:56:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs2 (Started pplxnsms01)
Oct 09 23:56:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave itm_fs3 (Started pplxnsms01)
Oct 09 23:56:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_db2 (Started pplxnsms01)
Oct 09 23:56:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_omni (Started pplxnsms01)
Oct 09 23:56:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_itnm (Started pplxnsms01)
Oct 09 23:56:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave nco_cognos (Started pplxnsms01)
Oct 09 23:56:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_vip (Started pplxnsms01)
Oct 09 23:56:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_lvm (Started pplxnsms01)
Oct 09 23:56:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_fs (Started pplxnsms01)
Oct 09 23:56:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave siem_rsyslog (Started pplxnsms01)
Oct 09 23:56:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_mariadb (Stopped)
Oct 09 23:56:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave web_matomo (Stopped)
Oct 09 23:56:38 pplxnsms02 pacemaker-schedulerd[2417] (rsc_action_default) info: Leave fence-sbd (Started pplxnsms02)
Oct 09 23:56:38 pplxnsms02 pacemaker-schedulerd[2417] (pcmk__log_transition_summary) notice: Calculated transition 116, saving inputs in /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 23:56:38 pplxnsms02 pacemaker-schedulerd[2417] (handle_pecalc_op) info: Input has not changed since last time, not saving to disk
Oct 09 23:56:38 pplxnsms02 pacemaker-controld [2418] (do_state_transition) info: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response
Oct 09 23:56:38 pplxnsms02 pacemaker-controld [2418] (do_te_invoke) info: Processing graph 116 (ref=pe_calc-dc-1728489398-244) derived from /var/lib/pacemaker/pengine/pe-input-1006.bz2
Oct 09 23:56:38 pplxnsms02 pacemaker-controld [2418] (pcmk__execute_graph) notice: Transition 116 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-1006.bz2): Complete
Oct 09 23:56:38 pplxnsms02 pacemaker-controld [2418] (do_log) info: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd
Oct 09 23:56:38 pplxnsms02 pacemaker-controld [2418] (do_state_transition) notice: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd