Overnight Alerts/Recent Events Delayed

[GrandWizard]

We had a bit of a double-whammy overnight which caused email events to be delayed by hours and subsequently not being shown in the Recent Events tab. Our upstream email forwarder had an issue, which is now resolved, that backlogged most of our alert traffic. The reason for the events not being shown in the Recent Events tab is under investigation.

Service as of 13:00 UTC was normal.

UPDATE: The missing events in the Recent Events tabs are stuck in what is called a "log shipment". These will be restored today. It is not clear if this is related to the email delays but seems unlikely.

At no time did this affect Envisalarms customers. The only delays were with Envisalerts and the alerting servers were and are operating normally.

Sorry for any inconvenience this may have had.

UPDATE: All events have been restored to the Recent Events database and all alerts from 01:00 UTC onward have been delivered.

[Crikey]

Thanks for the update, GW!