Inside hosted service - for nsq


Started the consumer service and handler for NSQ


Notification event with message ID 17f1ebc7ceac3000 received: {"TemplateId":7,"EntityType":"safety_alerts","EventType":null,"NotifyRoleId":582,"NotifyUserId":null,"NotifyDynamicActor":null,"EntityContext":{"Parameters":{"alertId":"388","orgId":"259","alertLink":"https://sandbox.oqsha.com/#/safety-alerts-v2/edit-safety-alert-v2/388","EmailFooter":"OQSHA Team","UserName":"Giselle Angle"}},"ActorContext":null,"Metadata":null}


Started processing notification for message ID 17f1ebc7ceac3000


Looking up the notification handler for message ID 17f1ebc7ceac3000


Event handling in process for message ID 17f1ebc7ceac3000


Dispatching the notifications for message ID 17f1ebc7ceac3000


Successfully processed notification for message ID 17f1ebc7ceac3000


Notification event with message ID 17f1ebc7ceec3000 received: {"TemplateId":5,"EntityType":"safety_alerts","EventType":null,"NotifyRoleId":582,"NotifyUserId":null,"NotifyDynamicActor":null,"EntityContext":{"Parameters":{"alertId":"388","orgId":"259","alertLink":"https://sandbox.oqsha.com/#/safety-alerts-v2/edit-safety-alert-v2/388","EmailFooter":"OQSHA Team","UserName":"Giselle Angle"}},"ActorContext":null,"Metadata":null}


Started processing notification for message ID 17f1ebc7ceec3000


Looking up the notification handler for message ID 17f1ebc7ceec3000


Event handling in process for message ID 17f1ebc7ceec3000


Dispatching the notifications for message ID 17f1ebc7ceec3000


Successfully processed notification for message ID 17f1ebc7ceec3000


Notification event with message ID 17f1eccf282c3000 received: {"TemplateId":6,"EntityType":"safety_alerts","EventType":null,"NotifyRoleId":null,"NotifyUserId":null,"NotifyDynamicActor":"AssignTo","EntityContext":{"Parameters":{"alertId":"388","orgId":"259","alertLink":"https://sandbox.oqsha.com/#/safety-alerts-v2/edit-safety-alert-v2/388","EmailFooter":"OQSHA Team","UserName":" ","Changes":"gfds"}},"ActorContext":{"AssignTo":[14144]},"Metadata":null}


Started processing notification for message ID 17f1eccf282c3000


Looking up the notification handler for message ID 17f1eccf282c3000


Event handling in process for message ID 17f1eccf282c3000


Dispatching the notifications for message ID 17f1eccf282c3000


Successfully processed notification for message ID 17f1eccf282c3000


Notification event with message ID 17f1eccf286c3000 received: {"TemplateId":8,"EntityType":"safety_alerts","EventType":null,"NotifyRoleId":null,"NotifyUserId":null,"NotifyDynamicActor":"AssignTo","EntityContext":{"Parameters":{"alertId":"388","orgId":"259","alertLink":"https://sandbox.oqsha.com/#/safety-alerts-v2/edit-safety-alert-v2/388","EmailFooter":"OQSHA Team","UserName":" ","Changes":"gfds"}},"ActorContext":{"AssignTo":[14144]},"Metadata":null}


Started processing notification for message ID 17f1eccf286c3000


Looking up the notification handler for message ID 17f1eccf286c3000


Event handling in process for message ID 17f1eccf286c3000


Dispatching the notifications for message ID 17f1eccf286c3000


Successfully processed notification for message ID 17f1eccf286c3000


Notification event with message ID 17f1ee0119ec3000 received: {"TemplateId":6,"EntityType":"safety_alerts","EventType":null,"NotifyRoleId":582,"NotifyUserId":null,"NotifyDynamicActor":null,"EntityContext":{"Parameters":{"alertId":"388","orgId":"259","alertLink":"https://sandbox.oqsha.com/#/safety-alerts-v2/edit-safety-alert-v2/388","EmailFooter":"OQSHA Team","UserName":" ","Changes":"Testtttt"}},"ActorContext":{"AssignTo":[14144]},"Metadata":null}


Started processing notification for message ID 17f1ee0119ec3000


Looking up the notification handler for message ID 17f1ee0119ec3000


Event handling in process for message ID 17f1ee0119ec3000


Dispatching the notifications for message ID 17f1ee0119ec3000


Successfully processed notification for message ID 17f1ee0119ec3000


Notification event with message ID 17f1ee0119ec3001 received: {"TemplateId":8,"EntityType":"safety_alerts","EventType":null,"NotifyRoleId":582,"NotifyUserId":null,"NotifyDynamicActor":null,"EntityContext":{"Parameters":{"alertId":"388","orgId":"259","alertLink":"https://sandbox.oqsha.com/#/safety-alerts-v2/edit-safety-alert-v2/388","EmailFooter":"OQSHA Team","UserName":" ","Changes":"Testtttt"}},"ActorContext":{"AssignTo":[14144]},"Metadata":null}


Started processing notification for message ID 17f1ee0119ec3001


Looking up the notification handler for message ID 17f1ee0119ec3001


Event handling in process for message ID 17f1ee0119ec3001


Dispatching the notifications for message ID 17f1ee0119ec3001


Successfully processed notification for message ID 17f1ee0119ec3001


Notification event with message ID 17f1ef5b1dec3000 received: {"TemplateId":7,"EntityType":"safety_alerts","EventType":null,"NotifyRoleId":582,"NotifyUserId":null,"NotifyDynamicActor":null,"EntityContext":{"Parameters":{"alertId":"390","orgId":"259","alertLink":"https://sandbox.oqsha.com/#/safety-alerts-v2/edit-safety-alert-v2/390","EmailFooter":"OQSHA Team","UserName":"Giselle Angle"}},"ActorContext":null,"Metadata":null}


Started processing notification for message ID 17f1ef5b1dec3000


Looking up the notification handler for message ID 17f1ef5b1dec3000


Event handling in process for message ID 17f1ef5b1dec3000


Dispatching the notifications for message ID 17f1ef5b1dec3000


Successfully processed notification for message ID 17f1ef5b1dec3000


Notification event with message ID 17f1ef5b1e6c3000 received: {"TemplateId":5,"EntityType":"safety_alerts","EventType":null,"NotifyRoleId":582,"NotifyUserId":null,"NotifyDynamicActor":null,"EntityContext":{"Parameters":{"alertId":"390","orgId":"259","alertLink":"https://sandbox.oqsha.com/#/safety-alerts-v2/edit-safety-alert-v2/390","EmailFooter":"OQSHA Team","UserName":"Giselle Angle"}},"ActorContext":null,"Metadata":null}


Started processing notification for message ID 17f1ef5b1e6c3000


Looking up the notification handler for message ID 17f1ef5b1e6c3000


Event handling in process for message ID 17f1ef5b1e6c3000


Dispatching the notifications for message ID 17f1ef5b1e6c3000


Successfully processed notification for message ID 17f1ef5b1e6c3000


Notification event with message ID 17f1f045e06c3000 received: {"TemplateId":6,"EntityType":"safety_alerts","EventType":null,"NotifyRoleId":null,"NotifyUserId":null,"NotifyDynamicActor":"AssignTo","EntityContext":{"Parameters":{"alertId":"390","orgId":"259","alertLink":"https://sandbox.oqsha.com/#/safety-alerts-v2/edit-safety-alert-v2/390","EmailFooter":"OQSHA Team","UserName":" ","Changes":"Testin comment"}},"ActorContext":{"AssignTo":[14144]},"Metadata":null}


Started processing notification for message ID 17f1f045e06c3000


Looking up the notification handler for message ID 17f1f045e06c3000


Event handling in process for message ID 17f1f045e06c3000


Dispatching the notifications for message ID 17f1f045e06c3000


Successfully processed notification for message ID 17f1f045e06c3000


Notification event with message ID 17f1f045e0ec3000 received: {"TemplateId":8,"EntityType":"safety_alerts","EventType":null,"NotifyRoleId":null,"NotifyUserId":null,"NotifyDynamicActor":"AssignTo","EntityContext":{"Parameters":{"alertId":"390","orgId":"259","alertLink":"https://sandbox.oqsha.com/#/safety-alerts-v2/edit-safety-alert-v2/390","EmailFooter":"OQSHA Team","UserName":" ","Changes":"Testin comment"}},"ActorContext":{"AssignTo":[14144]},"Metadata":null}


Started processing notification for message ID 17f1f045e0ec3000


Looking up the notification handler for message ID 17f1f045e0ec3000


Event handling in process for message ID 17f1f045e0ec3000


Dispatching the notifications for message ID 17f1f045e0ec3000


Successfully processed notification for message ID 17f1f045e0ec3000


Started processing notification for message ID 17f1f266382c3000


Looking up the notification handler for message ID 17f1f266382c3000


Event handling in process for message ID 17f1f266382c3000


Dispatching the notifications for message ID 17f1f266382c3000


Successfully processed notification for message ID 17f1f266382c3000


Started processing notification for message ID 17f1f266382c3001


Looking up the notification handler for message ID 17f1f266382c3001


Event handling in process for message ID 17f1f266382c3001


Dispatching the notifications for message ID 17f1f266382c3001


Successfully processed notification for message ID 17f1f266382c3001


Started processing notification for message ID 17f1f266386c3000


Looking up the notification handler for message ID 17f1f266386c3000


Event handling in process for message ID 17f1f266386c3000


Dispatching the notifications for message ID 17f1f266386c3000


Successfully processed notification for message ID 17f1f266386c3000


Started processing notification for message ID 17f1f26638ac3000


Looking up the notification handler for message ID 17f1f26638ac3000


Event handling in process for message ID 17f1f26638ac3000


Dispatching the notifications for message ID 17f1f26638ac3000


Successfully processed notification for message ID 17f1f26638ac3000


Started processing notification for message ID 17f1f26638ac3001


Looking up the notification handler for message ID 17f1f26638ac3001


Event handling in process for message ID 17f1f26638ac3001


Dispatching the notifications for message ID 17f1f26638ac3001


Successfully processed notification for message ID 17f1f26638ac3001


Started processing notification for message ID 17f1f26638ac3002


Looking up the notification handler for message ID 17f1f26638ac3002


Event handling in process for message ID 17f1f26638ac3002


Dispatching the notifications for message ID 17f1f26638ac3002


Successfully processed notification for message ID 17f1f26638ac3002


Started processing notification for message ID 17f1f2d721ec3000


Looking up the notification handler for message ID 17f1f2d721ec3000


Event handling in process for message ID 17f1f2d721ec3000


Dispatching the notifications for message ID 17f1f2d721ec3000


Successfully processed notification for message ID 17f1f2d721ec3000


Started processing notification for message ID 17f1f2d721ec3001


Looking up the notification handler for message ID 17f1f2d721ec3001


Event handling in process for message ID 17f1f2d721ec3001


Dispatching the notifications for message ID 17f1f2d721ec3001


Successfully processed notification for message ID 17f1f2d721ec3001


Started processing notification for message ID 17f1f43b572c3000


Looking up the notification handler for message ID 17f1f43b572c3000


Event handling in process for message ID 17f1f43b572c3000


Dispatching the notifications for message ID 17f1f43b572c3000


Successfully processed notification for message ID 17f1f43b572c3000


Started processing notification for message ID 17f1f43b572c3001


Looking up the notification handler for message ID 17f1f43b572c3001


Event handling in process for message ID 17f1f43b572c3001


Dispatching the notifications for message ID 17f1f43b572c3001


Successfully processed notification for message ID 17f1f43b572c3001


Started processing notification for message ID 17f1f5ae0b6c3000


Looking up the notification handler for message ID 17f1f5ae0b6c3000


Event handling in process for message ID 17f1f5ae0b6c3000


Dispatching the notifications for message ID 17f1f5ae0b6c3000


Successfully processed notification for message ID 17f1f5ae0b6c3000


Started processing notification for message ID 17f1f5ae0b6c3001


Looking up the notification handler for message ID 17f1f5ae0b6c3001


Event handling in process for message ID 17f1f5ae0b6c3001


Dispatching the notifications for message ID 17f1f5ae0b6c3001


Successfully processed notification for message ID 17f1f5ae0b6c3001


Started processing notification for message ID 17f1f5ae0bec3000


Looking up the notification handler for message ID 17f1f5ae0bec3000


Event handling in process for message ID 17f1f5ae0bec3000


Dispatching the notifications for message ID 17f1f5ae0bec3000


Successfully processed notification for message ID 17f1f5ae0bec3000


Started processing notification for message ID 17f1f5ae0bec3001


Looking up the notification handler for message ID 17f1f5ae0bec3001


Event handling in process for message ID 17f1f5ae0bec3001


Dispatching the notifications for message ID 17f1f5ae0bec3001


Successfully processed notification for message ID 17f1f5ae0bec3001


Started processing notification for message ID 17f1f5ae0bec3002


Looking up the notification handler for message ID 17f1f5ae0bec3002


Event handling in process for message ID 17f1f5ae0bec3002


Dispatching the notifications for message ID 17f1f5ae0bec3002


Successfully processed notification for message ID 17f1f5ae0bec3002


Started processing notification for message ID 17f1f5ae0bec3003


Looking up the notification handler for message ID 17f1f5ae0bec3003


Event handling in process for message ID 17f1f5ae0bec3003


Dispatching the notifications for message ID 17f1f5ae0bec3003


Successfully processed notification for message ID 17f1f5ae0bec3003


Started processing notification for message ID 17f1f5ae0bec3004


Looking up the notification handler for message ID 17f1f5ae0bec3004


Event handling in process for message ID 17f1f5ae0bec3004


Dispatching the notifications for message ID 17f1f5ae0bec3004


Successfully processed notification for message ID 17f1f5ae0bec3004


Started processing notification for message ID 17f1f5ae0bec3005


Looking up the notification handler for message ID 17f1f5ae0bec3005


Event handling in process for message ID 17f1f5ae0bec3005


Dispatching the notifications for message ID 17f1f5ae0bec3005


Successfully processed notification for message ID 17f1f5ae0bec3005


Notification event with message ID 17f1f5bb156c3000 received: {"TemplateId":7,"EntityType":"safety_alerts","EventType":null,"NotifyRoleId":582,"NotifyUserId":null,"NotifyDynamicActor":null,"EntityContext":{"Parameters":{"alertId":"392","orgId":"259","alertLink":"https://sandbox.oqsha.com/#/safety-alerts-v2/edit-safety-alert-v2/392","EmailFooter":"OQSHA Team","UserName":"Giselle Angle"}},"ActorContext":null,"Metadata":null}


Started processing notification for message ID 17f1f5bb156c3000


Looking up the notification handler for message ID 17f1f5bb156c3000


Event handling in process for message ID 17f1f5bb156c3000


Dispatching the notifications for message ID 17f1f5bb156c3000


Successfully processed notification for message ID 17f1f5bb156c3000


Notification event with message ID 17f1f5bb156c3001 received: {"TemplateId":5,"EntityType":"safety_alerts","EventType":null,"NotifyRoleId":582,"NotifyUserId":null,"NotifyDynamicActor":null,"EntityContext":{"Parameters":{"alertId":"392","orgId":"259","alertLink":"https://sandbox.oqsha.com/#/safety-alerts-v2/edit-safety-alert-v2/392","EmailFooter":"OQSHA Team","UserName":"Giselle Angle"}},"ActorContext":null,"Metadata":null}


Started processing notification for message ID 17f1f5bb156c3001


Looking up the notification handler for message ID 17f1f5bb156c3001


Event handling in process for message ID 17f1f5bb156c3001


Dispatching the notifications for message ID 17f1f5bb156c3001


Successfully processed notification for message ID 17f1f5bb156c3001


Notification event with message ID 17f1f5d802ec3000 received: {"TemplateId":6,"EntityType":"safety_alerts","EventType":null,"NotifyRoleId":null,"NotifyUserId":null,"NotifyDynamicActor":"AssignTo","EntityContext":{"Parameters":{"alertId":"392","orgId":"259","alertLink":"https://sandbox.oqsha.com/#/safety-alerts-v2/edit-safety-alert-v2/392","EmailFooter":"OQSHA Team","UserName":" ","Changes":"hgfds"}},"ActorContext":{"AssignTo":[14144]},"Metadata":null}


Started processing notification for message ID 17f1f5d802ec3000


Looking up the notification handler for message ID 17f1f5d802ec3000


Event handling in process for message ID 17f1f5d802ec3000


Dispatching the notifications for message ID 17f1f5d802ec3000


Successfully processed notification for message ID 17f1f5d802ec3000


Notification event with message ID 17f1f5d8032c3000 received: {"TemplateId":8,"EntityType":"safety_alerts","EventType":null,"NotifyRoleId":null,"NotifyUserId":null,"NotifyDynamicActor":"AssignTo","EntityContext":{"Parameters":{"alertId":"392","orgId":"259","alertLink":"https://sandbox.oqsha.com/#/safety-alerts-v2/edit-safety-alert-v2/392","EmailFooter":"OQSHA Team","UserName":" ","Changes":"hgfds"}},"ActorContext":{"AssignTo":[14144]},"Metadata":null}


Started processing notification for message ID 17f1f5d8032c3000


Looking up the notification handler for message ID 17f1f5d8032c3000


Event handling in process for message ID 17f1f5d8032c3000


Dispatching the notifications for message ID 17f1f5d8032c3000


Successfully processed notification for message ID 17f1f5d8032c3000


Started processing notification for message ID 17f1f6b16cec3000


Looking up the notification handler for message ID 17f1f6b16cec3000


Event handling in process for message ID 17f1f6b16cec3000


Dispatching the notifications for message ID 17f1f6b16cec3000


Successfully processed notification for message ID 17f1f6b16cec3000


Started processing notification for message ID 17f1f6b16cec3001


Looking up the notification handler for message ID 17f1f6b16cec3001


Event handling in process for message ID 17f1f6b16cec3001


Dispatching the notifications for message ID 17f1f6b16cec3001


Successfully processed notification for message ID 17f1f6b16cec3001


Started processing notification for message ID 17f1f78c94ac3000


Looking up the notification handler for message ID 17f1f78c94ac3000


Event handling in process for message ID 17f1f78c94ac3000


Dispatching the notifications for message ID 17f1f78c94ac3000


Successfully processed notification for message ID 17f1f78c94ac3000


Started processing notification for message ID 17f1f78c94ac3001


Looking up the notification handler for message ID 17f1f78c94ac3001


Event handling in process for message ID 17f1f78c94ac3001


Dispatching the notifications for message ID 17f1f78c94ac3001


Successfully processed notification for message ID 17f1f78c94ac3001


Started processing notification for message ID 17f1f78c94ac3002


Looking up the notification handler for message ID 17f1f78c94ac3002


Event handling in process for message ID 17f1f78c94ac3002


Dispatching the notifications for message ID 17f1f78c94ac3002


Successfully processed notification for message ID 17f1f78c94ac3002


Started processing notification for message ID 17f1f78c94ac3003


Looking up the notification handler for message ID 17f1f78c94ac3003


Event handling in process for message ID 17f1f78c94ac3003


Dispatching the notifications for message ID 17f1f78c94ac3003


Successfully processed notification for message ID 17f1f78c94ac3003


Started processing notification for message ID 17f1f78c94ac3004


Looking up the notification handler for message ID 17f1f78c94ac3004


Event handling in process for message ID 17f1f78c94ac3004


Dispatching the notifications for message ID 17f1f78c94ac3004


Successfully processed notification for message ID 17f1f78c94ac3004


Started processing notification for message ID 17f1f78c95ac3000


Looking up the notification handler for message ID 17f1f78c95ac3000


Event handling in process for message ID 17f1f78c95ac3000


Dispatching the notifications for message ID 17f1f78c95ac3000


Successfully processed notification for message ID 17f1f78c95ac3000


Started processing notification for message ID 17f1f798372c3000


Looking up the notification handler for message ID 17f1f798372c3000


Event handling in process for message ID 17f1f798372c3000


Dispatching the notifications for message ID 17f1f798372c3000


Successfully processed notification for message ID 17f1f798372c3000


Started processing notification for message ID 17f1f798372c3001


Looking up the notification handler for message ID 17f1f798372c3001


Event handling in process for message ID 17f1f798372c3001


Dispatching the notifications for message ID 17f1f798372c3001


Successfully processed notification for message ID 17f1f798372c3001


Inside hosted service - for nsq


Started the consumer service and handler for NSQ


Notification event with message ID 17f20126a2ec3000 received: {"TemplateId":1,"EntityType":"inspection_v2","EventType":"inspection_v2.inspection_created","NotifyRoleId":null,"NotifyUserId":267,"NotifyDynamicActor":null,"EntityContext":{"Parameters":{"inspectionId":"39","orgId":"262","inspectionLink":"https://qa-staging-2.oqsha.com/#/inspection-v2/view/262/39","emailFooter":"OQSHA Team","userName":"Sal Eaton"}},"ActorContext":null,"Metadata":null}


Started processing notification for message ID 17f20126a2ec3000


Looking up the notification handler for message ID 17f20126a2ec3000


Event handling in process for message ID 17f20126a2ec3000


Dispatch failed for message ID 17f20126a2ec3000 at attempt MySqlConnector.MySqlException (0x80004005): Table 'qa_stg_oqsha_4.notification_templates' doesn't exist
   at MySqlConnector.Core.ServerSession.ReceiveReplyAsync(IOBehavior ioBehavior, CancellationToken cancellationToken) in /_/src/MySqlConnector/Core/ServerSession.cs:line 1081
   at MySqlConnector.Core.ResultSet.ReadResultSetHeaderAsync(IOBehavior ioBehavior) in /_/src/MySqlConnector/Core/ResultSet.cs:line 37
   at MySqlConnector.MySqlDataReader.ActivateResultSet(CancellationToken cancellationToken) in /_/src/MySqlConnector/MySqlDataReader.cs:line 131
   at MySqlConnector.MySqlDataReader.InitAsync(CommandListPosition commandListPosition, ICommandPayloadCreator payloadCreator, IDictionary`2 cachedProcedures, IMySqlCommand command, CommandBehavior behavior, Activity activity, IOBehavior ioBehavior, CancellationToken cancellationToken) in /_/src/MySqlConnector/MySqlDataReader.cs:line 487
   at MySqlConnector.Core.CommandExecutor.ExecuteReaderAsync(CommandListPosition commandListPosition, ICommandPayloadCreator payloadCreator, CommandBehavior behavior, Activity activity, IOBehavior ioBehavior, CancellationToken cancellationToken) in /_/src/MySqlConnector/Core/CommandExecutor.cs:line 56
   at MySqlConnector.MySqlCommand.ExecuteReaderAsync(CommandBehavior behavior, IOBehavior ioBehavior, CancellationToken cancellationToken) in /_/src/MySqlConnector/MySqlCommand.cs:line 357
   at MySqlConnector.MySqlCommand.ExecuteDbDataReaderAsync(CommandBehavior behavior, CancellationToken cancellationToken) in /_/src/MySqlConnector/MySqlCommand.cs:line 350
   at Microsoft.EntityFrameworkCore.Storage.RelationalCommand.ExecuteReaderAsync(RelationalCommandParameterObject parameterObject, CancellationToken cancellationToken)
   at Microsoft.EntityFrameworkCore.Storage.RelationalCommand.ExecuteReaderAsync(RelationalCommandParameterObject parameterObject, CancellationToken cancellationToken)
   at Microsoft.EntityFrameworkCore.Query.Internal.SingleQueryingEnumerable`1.AsyncEnumerator.InitializeReaderAsync(AsyncEnumerator enumerator, CancellationToken cancellationToken)
   at Pomelo.EntityFrameworkCore.MySql.Storage.Internal.MySqlExecutionStrategy.ExecuteAsync[TState,TResult](TState state, Func`4 operation, Func`4 verifySucceeded, CancellationToken cancellationToken)
   at Microsoft.EntityFrameworkCore.Query.Internal.SingleQueryingEnumerable`1.AsyncEnumerator.MoveNextAsync()
   at Microsoft.EntityFrameworkCore.Query.ShapedQueryCompilingExpressionVisitor.SingleOrDefaultAsync[TSource](IAsyncEnumerable`1 asyncEnumerable, CancellationToken cancellationToken)
   at Microsoft.EntityFrameworkCore.Query.ShapedQueryCompilingExpressionVisitor.SingleOrDefaultAsync[TSource](IAsyncEnumerable`1 asyncEnumerable, CancellationToken cancellationToken)
   at OQSHA.Notification.Orchestrator.Repositories.NotificationTemplatesRepository.GetByTemplateIdAsync(Int32 id) in C:\GitLab-Runner\builds\27n6lYj0J\0\incident-reporter\incident-reporter-api\IncidentReporter\OQSHA.Notification.Orchestrator\Repositories\NotificationTemplatesRepository.cs:line 20
   at OQSHA.Notification.Orchestrator.Services.NotificationTemplatesService.GetByTemplateIdAsync(Int32 id) in C:\GitLab-Runner\builds\27n6lYj0J\0\incident-reporter\incident-reporter-api\IncidentReporter\OQSHA.Notification.Orchestrator\Services\NotificationTemplatesService.cs:line 20
   at OQSHA.Notification.Orchestrator.NotificationHandlers.InspectionV2NotificationHandler.HandleTemplateBasedNotificationAsync(String messageId, NotificationEventDto request) in C:\GitLab-Runner\builds\27n6lYj0J\0\incident-reporter\incident-reporter-api\IncidentReporter\OQSHA.Notification.Orchestrator\NotificationHandlers\InspectionV2NotificationHandler.cs:line 75
   at OQSHA.Notification.Orchestrator.NotificationHandlers.InspectionV2NotificationHandler.ProcessEventAsync(String messageId, NotificationEventDto request) in C:\GitLab-Runner\builds\27n6lYj0J\0\incident-reporter\incident-reporter-api\IncidentReporter\OQSHA.Notification.Orchestrator\NotificationHandlers\InspectionV2NotificationHandler.cs:line 56
   at OQSHA.Notification.Orchestrator.Routing.EventRouter.ExecuteAsync(String messageId, NotificationEventDto request) in C:\GitLab-Runner\builds\27n6lYj0J\0\incident-reporter\incident-reporter-api\IncidentReporter\OQSHA.Notification.Orchestrator\Routing\EventRouter.cs:line 38
   at OQSHA.Notification.Orchestrator.Worker.OrchestratorMessageHandler.HandleMessage(IMessage message) in C:\GitLab-Runner\builds\27n6lYj0J\0\incident-reporter\incident-reporter-api\IncidentReporter\OQSHA.Notification.Orchestrator\Worker\OrchestratorMessageHandler.cs:line 44 and exception: {ex.Message}


Requeued message ID 17f20126a2ec3000


Sending message ID 17f20126a2ec3000 to DLQ


Dead letter envelope for DLQ message: {"SourceTopic":"notification.orchestrator","SourceChannel":"notification-orchestrator","FailedAtUtc":"2026-06-30T06:54:01.2718583Z","Attempts":5,"ErrorType":"MySqlConnector.MySqlException","ErrorMessage":"Table 'qa_stg_oqsha_4.notification_templates' doesn't exist","StackTrace":"   at MySqlConnector.Core.ServerSession.ReceiveReplyAsync(IOBehavior ioBehavior, CancellationToken cancellationToken) in /_/src/MySqlConnector/Core/ServerSession.cs:line 1081\r\n   at MySqlConnector.Core.ResultSet.ReadResultSetHeaderAsync(IOBehavior ioBehavior) in /_/src/MySqlConnector/Core/ResultSet.cs:line 37\r\n   at MySqlConnector.MySqlDataReader.ActivateResultSet(CancellationToken cancellationToken) in /_/src/MySqlConnector/MySqlDataReader.cs:line 131\r\n   at MySqlConnector.MySqlDataReader.InitAsync(CommandListPosition commandListPosition, ICommandPayloadCreator payloadCreator, IDictionary`2 cachedProcedures, IMySqlCommand command, CommandBehavior behavior, Activity activity, IOBehavior ioBehavior, CancellationToken cancellationToken) in /_/src/MySqlConnector/MySqlDataReader.cs:line 487\r\n   at MySqlConnector.Core.CommandExecutor.ExecuteReaderAsync(CommandListPosition commandListPosition, ICommandPayloadCreator payloadCreator, CommandBehavior behavior, Activity activity, IOBehavior ioBehavior, CancellationToken cancellationToken) in /_/src/MySqlConnector/Core/CommandExecutor.cs:line 56\r\n   at MySqlConnector.MySqlCommand.ExecuteReaderAsync(CommandBehavior behavior, IOBehavior ioBehavior, CancellationToken cancellationToken) in /_/src/MySqlConnector/MySqlCommand.cs:line 357\r\n   at MySqlConnector.MySqlCommand.ExecuteDbDataReaderAsync(CommandBehavior behavior, CancellationToken cancellationToken) in /_/src/MySqlConnector/MySqlCommand.cs:line 350\r\n   at Microsoft.EntityFrameworkCore.Storage.RelationalCommand.ExecuteReaderAsync(RelationalCommandParameterObject parameterObject, CancellationToken cancellationToken)\r\n   at Microsoft.EntityFrameworkCore.Storage.RelationalCommand.ExecuteReaderAsync(RelationalCommandParameterObject parameterObject, CancellationToken cancellationToken)\r\n   at Microsoft.EntityFrameworkCore.Query.Internal.SingleQueryingEnumerable`1.AsyncEnumerator.InitializeReaderAsync(AsyncEnumerator enumerator, CancellationToken cancellationToken)\r\n   at Pomelo.EntityFrameworkCore.MySql.Storage.Internal.MySqlExecutionStrategy.ExecuteAsync[TState,TResult](TState state, Func`4 operation, Func`4 verifySucceeded, CancellationToken cancellationToken)\r\n   at Microsoft.EntityFrameworkCore.Query.Internal.SingleQueryingEnumerable`1.AsyncEnumerator.MoveNextAsync()\r\n   at Microsoft.EntityFrameworkCore.Query.ShapedQueryCompilingExpressionVisitor.SingleOrDefaultAsync[TSource](IAsyncEnumerable`1 asyncEnumerable, CancellationToken cancellationToken)\r\n   at Microsoft.EntityFrameworkCore.Query.ShapedQueryCompilingExpressionVisitor.SingleOrDefaultAsync[TSource](IAsyncEnumerable`1 asyncEnumerable, CancellationToken cancellationToken)\r\n   at OQSHA.Notification.Orchestrator.Repositories.NotificationTemplatesRepository.GetByTemplateIdAsync(Int32 id) in C:\\GitLab-Runner\\builds\\27n6lYj0J\\0\\incident-reporter\\incident-reporter-api\\IncidentReporter\\OQSHA.Notification.Orchestrator\\Repositories\\NotificationTemplatesRepository.cs:line 20\r\n   at OQSHA.Notification.Orchestrator.Services.NotificationTemplatesService.GetByTemplateIdAsync(Int32 id) in C:\\GitLab-Runner\\builds\\27n6lYj0J\\0\\incident-reporter\\incident-reporter-api\\IncidentReporter\\OQSHA.Notification.Orchestrator\\Services\\NotificationTemplatesService.cs:line 20\r\n   at OQSHA.Notification.Orchestrator.NotificationHandlers.InspectionV2NotificationHandler.HandleTemplateBasedNotificationAsync(String messageId, NotificationEventDto request) in C:\\GitLab-Runner\\builds\\27n6lYj0J\\0\\incident-reporter\\incident-reporter-api\\IncidentReporter\\OQSHA.Notification.Orchestrator\\NotificationHandlers\\InspectionV2NotificationHandler.cs:line 75\r\n   at OQSHA.Notification.Orchestrator.NotificationHandlers.InspectionV2NotificationHandler.ProcessEventAsync(String messageId, NotificationEventDto request) in C:\\GitLab-Runner\\builds\\27n6lYj0J\\0\\incident-reporter\\incident-reporter-api\\IncidentReporter\\OQSHA.Notification.Orchestrator\\NotificationHandlers\\InspectionV2NotificationHandler.cs:line 56\r\n   at OQSHA.Notification.Orchestrator.Routing.EventRouter.ExecuteAsync(String messageId, NotificationEventDto request) in C:\\GitLab-Runner\\builds\\27n6lYj0J\\0\\incident-reporter\\incident-reporter-api\\IncidentReporter\\OQSHA.Notification.Orchestrator\\Routing\\EventRouter.cs:line 38\r\n   at OQSHA.Notification.Orchestrator.Worker.OrchestratorMessageHandler.HandleMessage(IMessage message) in C:\\GitLab-Runner\\builds\\27n6lYj0J\\0\\incident-reporter\\incident-reporter-api\\IncidentReporter\\OQSHA.Notification.Orchestrator\\Worker\\OrchestratorMessageHandler.cs:line 44","OriginalBody":"{\"TemplateId\":1,\"EntityType\":\"inspection_v2\",\"EventType\":\"inspection_v2.inspection_created\",\"NotifyRoleId\":null,\"NotifyUserId\":267,\"NotifyDynamicActor\":null,\"EntityContext\":{\"Parameters\":{\"inspectionId\":\"39\",\"orgId\":\"262\",\"inspectionLink\":\"https://qa-staging-2.oqsha.com/#/inspection-v2/view/262/39\",\"emailFooter\":\"OQSHA Team\",\"userName\":\"Sal Eaton\"}},\"ActorContext\":null,\"Metadata\":null}"}


Sent message ID 17f20126a2ec3000 to DLQ


Notification event with message ID 17f2137cdd6c3000 received: {"TemplateId":24,"EntityType":"safety_alerts","EventType":null,"NotifyRoleId":582,"NotifyUserId":null,"NotifyDynamicActor":null,"EntityContext":{"Parameters":{"alertId":"387","orgId":"259","alertLink":"https://sandbox.oqsha.com/#/safety-alerts-v2/edit-safety-alert-v2/387","EmailFooter":"OQSHA Team","UserName":"Giselle Angle","description":""}},"ActorContext":null,"Metadata":null}


Started processing notification for message ID 17f2137cdd6c3000


Looking up the notification handler for message ID 17f2137cdd6c3000


Event handling in process for message ID 17f2137cdd6c3000


Dispatching the notifications for message ID 17f2137cdd6c3000


Successfully processed notification for message ID 17f2137cdd6c3000


Notification event with message ID 17f2137cddac3000 received: {"TemplateId":5,"EntityType":"safety_alerts","EventType":null,"NotifyRoleId":582,"NotifyUserId":null,"NotifyDynamicActor":null,"EntityContext":{"Parameters":{"alertId":"387","orgId":"259","alertLink":"https://sandbox.oqsha.com/#/safety-alerts-v2/edit-safety-alert-v2/387","EmailFooter":"OQSHA Team","UserName":"Giselle Angle","description":""}},"ActorContext":null,"Metadata":null}


Started processing notification for message ID 17f2137cddac3000


Looking up the notification handler for message ID 17f2137cddac3000


Event handling in process for message ID 17f2137cddac3000


Dispatching the notifications for message ID 17f2137cddac3000


Successfully processed notification for message ID 17f2137cddac3000


Inside hosted service - for nsq


Started the consumer service and handler for NSQ


Notification event with message ID 17f215c9866c3000 received: {"TemplateId":6,"EntityType":"safety_alerts","EventType":null,"NotifyRoleId":null,"NotifyUserId":null,"NotifyDynamicActor":"AssignTo","EntityContext":{"Parameters":{"alertId":"365","orgId":"259","alertLink":"https://sandbox.oqsha.com/#/safety-alerts-v2/edit-safety-alert-v2/365","EmailFooter":"OQSHA Team","UserName":" ","Changes":"Testinggggggg","description":""}},"ActorContext":{"AssignTo":[14144]},"Metadata":null}


Started processing notification for message ID 17f215c9866c3000


Looking up the notification handler for message ID 17f215c9866c3000


Event handling in process for message ID 17f215c9866c3000


Dispatching the notifications for message ID 17f215c9866c3000


Successfully processed notification for message ID 17f215c9866c3000


Notification event with message ID 17f215c986ac3000 received: {"TemplateId":25,"EntityType":"safety_alerts","EventType":null,"NotifyRoleId":null,"NotifyUserId":null,"NotifyDynamicActor":"AssignTo","EntityContext":{"Parameters":{"alertId":"365","orgId":"259","alertLink":"https://sandbox.oqsha.com/#/safety-alerts-v2/edit-safety-alert-v2/365","EmailFooter":"OQSHA Team","UserName":" ","Changes":"Testinggggggg","description":""}},"ActorContext":{"AssignTo":[14144]},"Metadata":null}


Started processing notification for message ID 17f215c986ac3000


Looking up the notification handler for message ID 17f215c986ac3000


Event handling in process for message ID 17f215c986ac3000


Dispatching the notifications for message ID 17f215c986ac3000


Successfully processed notification for message ID 17f215c986ac3000


Notification event with message ID 17f21863c4ac3000 received: {"TemplateId":5,"EntityType":"safety_alerts","EventType":null,"NotifyRoleId":582,"NotifyUserId":null,"NotifyDynamicActor":null,"EntityContext":{"Parameters":{"alertId":"388","orgId":"259","alertLink":"https://sandbox.oqsha.com/#/safety-alerts-v2/edit-safety-alert-v2/388","EmailFooter":"OQSHA Team","UserName":"Giselle Angle","description":""}},"ActorContext":null,"Metadata":null}


Started processing notification for message ID 17f21863c4ac3000


Looking up the notification handler for message ID 17f21863c4ac3000


Event handling in process for message ID 17f21863c4ac3000


Dispatching the notifications for message ID 17f21863c4ac3000


Successfully processed notification for message ID 17f21863c4ac3000


Notification event with message ID 17f21863c4ac3001 received: {"TemplateId":24,"EntityType":"safety_alerts","EventType":null,"NotifyRoleId":582,"NotifyUserId":null,"NotifyDynamicActor":null,"EntityContext":{"Parameters":{"alertId":"388","orgId":"259","alertLink":"https://sandbox.oqsha.com/#/safety-alerts-v2/edit-safety-alert-v2/388","EmailFooter":"OQSHA Team","UserName":"Giselle Angle","description":""}},"ActorContext":null,"Metadata":null}


Started processing notification for message ID 17f21863c4ac3001


Looking up the notification handler for message ID 17f21863c4ac3001


Event handling in process for message ID 17f21863c4ac3001


Dispatching the notifications for message ID 17f21863c4ac3001


Successfully processed notification for message ID 17f21863c4ac3001


Notification event with message ID 17f2187e8e2c3000 received: {"TemplateId":6,"EntityType":"safety_alerts","EventType":null,"NotifyRoleId":null,"NotifyUserId":null,"NotifyDynamicActor":"AssignTo","EntityContext":{"Parameters":{"alertId":"388","orgId":"259","alertLink":"https://sandbox.oqsha.com/#/safety-alerts-v2/edit-safety-alert-v2/388","EmailFooter":"OQSHA Team","UserName":" ","Changes":"765432","description":""}},"ActorContext":{"AssignTo":[14144]},"Metadata":null}


Started processing notification for message ID 17f2187e8e2c3000


Looking up the notification handler for message ID 17f2187e8e2c3000


Event handling in process for message ID 17f2187e8e2c3000


Dispatching the notifications for message ID 17f2187e8e2c3000


Successfully processed notification for message ID 17f2187e8e2c3000


Notification event with message ID 17f2187e8e6c3000 received: {"TemplateId":25,"EntityType":"safety_alerts","EventType":null,"NotifyRoleId":null,"NotifyUserId":null,"NotifyDynamicActor":"AssignTo","EntityContext":{"Parameters":{"alertId":"388","orgId":"259","alertLink":"https://sandbox.oqsha.com/#/safety-alerts-v2/edit-safety-alert-v2/388","EmailFooter":"OQSHA Team","UserName":" ","Changes":"765432","description":""}},"ActorContext":{"AssignTo":[14144]},"Metadata":null}


Started processing notification for message ID 17f2187e8e6c3000


Looking up the notification handler for message ID 17f2187e8e6c3000


Event handling in process for message ID 17f2187e8e6c3000


Dispatching the notifications for message ID 17f2187e8e6c3000


Successfully processed notification for message ID 17f2187e8e6c3000


Inside hosted service - for nsq


Started the consumer service and handler for NSQ


Notification event with message ID 17f21912552c3000 received: {"TemplateId":6,"EntityType":"safety_alerts","EventType":null,"NotifyRoleId":582,"NotifyUserId":null,"NotifyDynamicActor":null,"EntityContext":{"Parameters":{"alertId":"365","orgId":"259","alertLink":"https://sandbox.oqsha.com/#/safety-alerts-v2/edit-safety-alert-v2/365","EmailFooter":"OQSHA Team","UserName":" ","Changes":"hgfdsdfg","description":""}},"ActorContext":{"AssignTo":[14144]},"Metadata":null}


Started processing notification for message ID 17f21912552c3000


Looking up the notification handler for message ID 17f21912552c3000


Event handling in process for message ID 17f21912552c3000


Dispatching the notifications for message ID 17f21912552c3000


Successfully processed notification for message ID 17f21912552c3000


Notification event with message ID 17f21912556c3000 received: {"TemplateId":25,"EntityType":"safety_alerts","EventType":null,"NotifyRoleId":582,"NotifyUserId":null,"NotifyDynamicActor":null,"EntityContext":{"Parameters":{"alertId":"365","orgId":"259","alertLink":"https://sandbox.oqsha.com/#/safety-alerts-v2/edit-safety-alert-v2/365","EmailFooter":"OQSHA Team","UserName":" ","Changes":"hgfdsdfg","description":""}},"ActorContext":{"AssignTo":[14144]},"Metadata":null}


Started processing notification for message ID 17f21912556c3000


Looking up the notification handler for message ID 17f21912556c3000


Event handling in process for message ID 17f21912556c3000


Dispatching the notifications for message ID 17f21912556c3000


Successfully processed notification for message ID 17f21912556c3000


Notification event with message ID 17f21a38836c3000 received: {"TemplateId":5,"EntityType":"safety_alerts","EventType":null,"NotifyRoleId":582,"NotifyUserId":null,"NotifyDynamicActor":null,"EntityContext":{"Parameters":{"alertId":"389","orgId":"259","alertLink":"https://sandbox.oqsha.com/#/safety-alerts-v2/edit-safety-alert-v2/389","EmailFooter":"OQSHA Team","UserName":"Giselle Angle","description":"Testinggggg"}},"ActorContext":null,"Metadata":null}


Started processing notification for message ID 17f21a38836c3000


Looking up the notification handler for message ID 17f21a38836c3000


Event handling in process for message ID 17f21a38836c3000


Dispatching the notifications for message ID 17f21a38836c3000


Successfully processed notification for message ID 17f21a38836c3000


Notification event with message ID 17f21a3883ac3000 received: {"TemplateId":24,"EntityType":"safety_alerts","EventType":null,"NotifyRoleId":582,"NotifyUserId":null,"NotifyDynamicActor":null,"EntityContext":{"Parameters":{"alertId":"389","orgId":"259","alertLink":"https://sandbox.oqsha.com/#/safety-alerts-v2/edit-safety-alert-v2/389","EmailFooter":"OQSHA Team","UserName":"Giselle Angle","description":"Testinggggg"}},"ActorContext":null,"Metadata":null}


Started processing notification for message ID 17f21a3883ac3000


Looking up the notification handler for message ID 17f21a3883ac3000


Event handling in process for message ID 17f21a3883ac3000


Dispatching the notifications for message ID 17f21a3883ac3000


Successfully processed notification for message ID 17f21a3883ac3000


Inside hosted service - for nsq


Started the consumer service and handler for NSQ


Notification event with message ID 17f21e9bb0ac3000 received: {"TemplateId":5,"EntityType":"safety_alerts","EventType":null,"NotifyRoleId":582,"NotifyUserId":null,"NotifyDynamicActor":null,"EntityContext":{"Parameters":{"alertId":"390","orgId":"259","alertLink":"https://sandbox.oqsha.com/#/safety-alerts-v2/edit-safety-alert-v2/390","EmailFooter":"OQSHA Team","UserName":"Giselle Angle","description":"Tesintgggggg description"}},"ActorContext":null,"Metadata":null}


Started processing notification for message ID 17f21e9bb0ac3000


Looking up the notification handler for message ID 17f21e9bb0ac3000


Event handling in process for message ID 17f21e9bb0ac3000


Dispatching the notifications for message ID 17f21e9bb0ac3000


Successfully processed notification for message ID 17f21e9bb0ac3000


Notification event with message ID 17f21e9bb0ec3000 received: {"TemplateId":24,"EntityType":"safety_alerts","EventType":null,"NotifyRoleId":582,"NotifyUserId":null,"NotifyDynamicActor":null,"EntityContext":{"Parameters":{"alertId":"390","orgId":"259","alertLink":"https://sandbox.oqsha.com/#/safety-alerts-v2/edit-safety-alert-v2/390","EmailFooter":"OQSHA Team","UserName":"Giselle Angle","description":"Tesintgggggg description"}},"ActorContext":null,"Metadata":null}


Started processing notification for message ID 17f21e9bb0ec3000


Looking up the notification handler for message ID 17f21e9bb0ec3000


Event handling in process for message ID 17f21e9bb0ec3000


Dispatching the notifications for message ID 17f21e9bb0ec3000


Successfully processed notification for message ID 17f21e9bb0ec3000


Notification event with message ID 17f22df56d6c3000 received: {"TemplateId":1,"EntityType":"inspection_v2","EventType":"inspection_v2.inspection_created","NotifyRoleId":null,"NotifyUserId":267,"NotifyDynamicActor":null,"EntityContext":{"Parameters":{"inspectionId":"36","orgId":"262","inspectionLink":"https://sandbox.oqsha.com/#/inspection-v2/view/262/36","emailFooter":"OQSHA Team","userName":"Sal Eaton"}},"ActorContext":null,"Metadata":null}


Started processing notification for message ID 17f22df56d6c3000


Looking up the notification handler for message ID 17f22df56d6c3000


Event handling in process for message ID 17f22df56d6c3000


Dispatching the notifications for message ID 17f22df56d6c3000


Successfully processed notification for message ID 17f22df56d6c3000


Notification event with message ID 17f22e11a76c3000 received: {"TemplateId":1,"EntityType":"inspection_v2","EventType":"inspection_v2.inspection_created","NotifyRoleId":null,"NotifyUserId":267,"NotifyDynamicActor":null,"EntityContext":{"Parameters":{"inspectionId":"37","orgId":"262","inspectionLink":"https://sandbox.oqsha.com/#/inspection-v2/view/262/37","emailFooter":"OQSHA Team","userName":"Sal Eaton"}},"ActorContext":null,"Metadata":null}


Started processing notification for message ID 17f22e11a76c3000


Looking up the notification handler for message ID 17f22e11a76c3000


Event handling in process for message ID 17f22e11a76c3000


Dispatching the notifications for message ID 17f22e11a76c3000


Successfully processed notification for message ID 17f22e11a76c3000


Started processing notification for message ID 17f242d8296c3000


Looking up the notification handler for message ID 17f242d8296c3000


Event handling in process for message ID 17f242d8296c3000


Dispatching the notifications for message ID 17f242d8296c3000


Successfully processed notification for message ID 17f242d8296c3000


Started processing notification for message ID 17f242d8296c3001


Looking up the notification handler for message ID 17f242d8296c3001


Event handling in process for message ID 17f242d8296c3001


Dispatching the notifications for message ID 17f242d8296c3001


Successfully processed notification for message ID 17f242d8296c3001


Started processing notification for message ID 17f242d8296c3002


Looking up the notification handler for message ID 17f242d8296c3002


Event handling in process for message ID 17f242d8296c3002


Dispatching the notifications for message ID 17f242d8296c3002


Successfully processed notification for message ID 17f242d8296c3002


Started processing notification for message ID 17f242d8296c3003


Looking up the notification handler for message ID 17f242d8296c3003


Event handling in process for message ID 17f242d8296c3003


Dispatching the notifications for message ID 17f242d8296c3003


Successfully processed notification for message ID 17f242d8296c3003


Started processing notification for message ID 17f242d82a6c3000


Looking up the notification handler for message ID 17f242d82a6c3000


Event handling in process for message ID 17f242d82a6c3000


Dispatching the notifications for message ID 17f242d82a6c3000


Successfully processed notification for message ID 17f242d82a6c3000


Started processing notification for message ID 17f242d82aac3000


Looking up the notification handler for message ID 17f242d82aac3000


Event handling in process for message ID 17f242d82aac3000


Dispatching the notifications for message ID 17f242d82aac3000


Successfully processed notification for message ID 17f242d82aac3000


Notification event with message ID 17f2480ccc6c3000 received: {"TemplateId":1,"EntityType":"inspection_v2","EventType":"inspection_v2.inspection_created","NotifyRoleId":null,"NotifyUserId":267,"NotifyDynamicActor":null,"EntityContext":{"Parameters":{"inspectionId":"41","orgId":"262","inspectionLink":"https://qa-staging-2.oqsha.com/#/inspection-v2/view/262/41","emailFooter":"OQSHA Team","userName":"Sal Eaton"}},"ActorContext":null,"Metadata":null}


Started processing notification for message ID 17f2480ccc6c3000


Looking up the notification handler for message ID 17f2480ccc6c3000


Event handling in process for message ID 17f2480ccc6c3000


Sending message ID 17f2480ccc6c3000 to DLQ


Dead letter envelope for DLQ message: {"SourceTopic":"notification.orchestrator","SourceChannel":"notification-orchestrator","FailedAtUtc":"2026-06-30T12:13:48.7723569Z","Attempts":1,"ErrorType":"OQSHA.Notification.Orchestrator.Exceptions.PermanentOrchestratorException","ErrorMessage":"Inspection V2 ID 41 not found for message ID 17f2480ccc6c3000","StackTrace":"   at OQSHA.Notification.Orchestrator.NotificationHandlers.InspectionV2NotificationHandler.FetchInspectionAsync(String messageId, Int32 orgId, Int32 inspectionId) in C:\\GitLab-Runner\\builds\\27n6lYj0J\\0\\incident-reporter\\incident-reporter-api\\IncidentReporter\\OQSHA.Notification.Orchestrator\\NotificationHandlers\\InspectionV2NotificationHandler.cs:line 268\r\n   at OQSHA.Notification.Orchestrator.NotificationHandlers.InspectionV2NotificationHandler.HandleTemplateBasedNotificationAsync(String messageId, NotificationEventDto request) in C:\\GitLab-Runner\\builds\\27n6lYj0J\\0\\incident-reporter\\incident-reporter-api\\IncidentReporter\\OQSHA.Notification.Orchestrator\\NotificationHandlers\\InspectionV2NotificationHandler.cs:line 93\r\n   at OQSHA.Notification.Orchestrator.NotificationHandlers.InspectionV2NotificationHandler.ProcessEventAsync(String messageId, NotificationEventDto request) in C:\\GitLab-Runner\\builds\\27n6lYj0J\\0\\incident-reporter\\incident-reporter-api\\IncidentReporter\\OQSHA.Notification.Orchestrator\\NotificationHandlers\\InspectionV2NotificationHandler.cs:line 56\r\n   at OQSHA.Notification.Orchestrator.Routing.EventRouter.ExecuteAsync(String messageId, NotificationEventDto request) in C:\\GitLab-Runner\\builds\\27n6lYj0J\\0\\incident-reporter\\incident-reporter-api\\IncidentReporter\\OQSHA.Notification.Orchestrator\\Routing\\EventRouter.cs:line 38\r\n   at OQSHA.Notification.Orchestrator.Worker.OrchestratorMessageHandler.HandleMessage(IMessage message) in C:\\GitLab-Runner\\builds\\27n6lYj0J\\0\\incident-reporter\\incident-reporter-api\\IncidentReporter\\OQSHA.Notification.Orchestrator\\Worker\\OrchestratorMessageHandler.cs:line 44","OriginalBody":"{\"TemplateId\":1,\"EntityType\":\"inspection_v2\",\"EventType\":\"inspection_v2.inspection_created\",\"NotifyRoleId\":null,\"NotifyUserId\":267,\"NotifyDynamicActor\":null,\"EntityContext\":{\"Parameters\":{\"inspectionId\":\"41\",\"orgId\":\"262\",\"inspectionLink\":\"https://qa-staging-2.oqsha.com/#/inspection-v2/view/262/41\",\"emailFooter\":\"OQSHA Team\",\"userName\":\"Sal Eaton\"}},\"ActorContext\":null,\"Metadata\":null}"}


Sent message ID 17f2480ccc6c3000 to DLQ


Notification event with message ID 17f2480ccc6c3001 received: {"TemplateId":1,"EntityType":"inspection_v2","EventType":"inspection_v2.inspection_created","NotifyRoleId":null,"NotifyUserId":267,"NotifyDynamicActor":null,"EntityContext":{"Parameters":{"inspectionId":"40","orgId":"262","inspectionLink":"https://qa-staging-2.oqsha.com/#/inspection-v2/view/262/40","emailFooter":"OQSHA Team","userName":"Sal Eaton"}},"ActorContext":null,"Metadata":null}


Started processing notification for message ID 17f2480ccc6c3001


Looking up the notification handler for message ID 17f2480ccc6c3001


Event handling in process for message ID 17f2480ccc6c3001


Sending message ID 17f2480ccc6c3001 to DLQ


Dead letter envelope for DLQ message: {"SourceTopic":"notification.orchestrator","SourceChannel":"notification-orchestrator","FailedAtUtc":"2026-06-30T12:13:48.8531738Z","Attempts":1,"ErrorType":"OQSHA.Notification.Orchestrator.Exceptions.PermanentOrchestratorException","ErrorMessage":"Inspection V2 ID 40 not found for message ID 17f2480ccc6c3001","StackTrace":"   at OQSHA.Notification.Orchestrator.NotificationHandlers.InspectionV2NotificationHandler.FetchInspectionAsync(String messageId, Int32 orgId, Int32 inspectionId) in C:\\GitLab-Runner\\builds\\27n6lYj0J\\0\\incident-reporter\\incident-reporter-api\\IncidentReporter\\OQSHA.Notification.Orchestrator\\NotificationHandlers\\InspectionV2NotificationHandler.cs:line 268\r\n   at OQSHA.Notification.Orchestrator.NotificationHandlers.InspectionV2NotificationHandler.HandleTemplateBasedNotificationAsync(String messageId, NotificationEventDto request) in C:\\GitLab-Runner\\builds\\27n6lYj0J\\0\\incident-reporter\\incident-reporter-api\\IncidentReporter\\OQSHA.Notification.Orchestrator\\NotificationHandlers\\InspectionV2NotificationHandler.cs:line 93\r\n   at OQSHA.Notification.Orchestrator.NotificationHandlers.InspectionV2NotificationHandler.ProcessEventAsync(String messageId, NotificationEventDto request) in C:\\GitLab-Runner\\builds\\27n6lYj0J\\0\\incident-reporter\\incident-reporter-api\\IncidentReporter\\OQSHA.Notification.Orchestrator\\NotificationHandlers\\InspectionV2NotificationHandler.cs:line 56\r\n   at OQSHA.Notification.Orchestrator.Routing.EventRouter.ExecuteAsync(String messageId, NotificationEventDto request) in C:\\GitLab-Runner\\builds\\27n6lYj0J\\0\\incident-reporter\\incident-reporter-api\\IncidentReporter\\OQSHA.Notification.Orchestrator\\Routing\\EventRouter.cs:line 38\r\n   at OQSHA.Notification.Orchestrator.Worker.OrchestratorMessageHandler.HandleMessage(IMessage message) in C:\\GitLab-Runner\\builds\\27n6lYj0J\\0\\incident-reporter\\incident-reporter-api\\IncidentReporter\\OQSHA.Notification.Orchestrator\\Worker\\OrchestratorMessageHandler.cs:line 44","OriginalBody":"{\"TemplateId\":1,\"EntityType\":\"inspection_v2\",\"EventType\":\"inspection_v2.inspection_created\",\"NotifyRoleId\":null,\"NotifyUserId\":267,\"NotifyDynamicActor\":null,\"EntityContext\":{\"Parameters\":{\"inspectionId\":\"40\",\"orgId\":\"262\",\"inspectionLink\":\"https://qa-staging-2.oqsha.com/#/inspection-v2/view/262/40\",\"emailFooter\":\"OQSHA Team\",\"userName\":\"Sal Eaton\"}},\"ActorContext\":null,\"Metadata\":null}"}


Sent message ID 17f2480ccc6c3001 to DLQ


Started processing notification for message ID 17f2522cf86c3000


Looking up the notification handler for message ID 17f2522cf86c3000


Event handling in process for message ID 17f2522cf86c3000


Dispatching the notifications for message ID 17f2522cf86c3000


Successfully processed notification for message ID 17f2522cf86c3000


Started processing notification for message ID 17f2522cf92c3000


Looking up the notification handler for message ID 17f2522cf92c3000


Event handling in process for message ID 17f2522cf92c3000


Dispatching the notifications for message ID 17f2522cf92c3000


Successfully processed notification for message ID 17f2522cf92c3000


Inside hosted service - for nsq


Started the consumer service and handler for NSQ


Started processing notification for message ID 17f257c44aec3000


Looking up the notification handler for message ID 17f257c44aec3000


Event handling in process for message ID 17f257c44aec3000


Dispatching the notifications for message ID 17f257c44aec3000


Successfully processed notification for message ID 17f257c44aec3000


Started processing notification for message ID 17f257c44b2c3000


Looking up the notification handler for message ID 17f257c44b2c3000


Event handling in process for message ID 17f257c44b2c3000


Dispatching the notifications for message ID 17f257c44b2c3000


Successfully processed notification for message ID 17f257c44b2c3000


Started processing notification for message ID 17f2582556ac3000


Looking up the notification handler for message ID 17f2582556ac3000


Event handling in process for message ID 17f2582556ac3000


Dispatching the notifications for message ID 17f2582556ac3000


Successfully processed notification for message ID 17f2582556ac3000


Started processing notification for message ID 17f2582556ac3001


Looking up the notification handler for message ID 17f2582556ac3001


Event handling in process for message ID 17f2582556ac3001


Dispatching the notifications for message ID 17f2582556ac3001


Successfully processed notification for message ID 17f2582556ac3001


Started processing notification for message ID 17f25913c56c3000


Looking up the notification handler for message ID 17f25913c56c3000


Event handling in process for message ID 17f25913c56c3000


Dispatching the notifications for message ID 17f25913c56c3000


Successfully processed notification for message ID 17f25913c56c3000


Started processing notification for message ID 17f25913c56c3001


Looking up the notification handler for message ID 17f25913c56c3001


Event handling in process for message ID 17f25913c56c3001


Dispatching the notifications for message ID 17f25913c56c3001


Successfully processed notification for message ID 17f25913c56c3001


Started processing notification for message ID 17f2596a8d6c3000


Looking up the notification handler for message ID 17f2596a8d6c3000


Event handling in process for message ID 17f2596a8d6c3000


Sending message ID 17f2596a8d6c3000 to DLQ


Dead letter envelope for DLQ message: {"SourceTopic":"notification.orchestrator","SourceChannel":"notification-orchestrator","FailedAtUtc":"2026-06-30T13:33:22.3615454Z","Attempts":1,"ErrorType":"OQSHA.Notification.Orchestrator.Exceptions.PermanentOrchestratorException","ErrorMessage":"Unable to find any user IDs for dynamic actor Work_Permit_Authorization_Department_Head for message ID 17f2596a8d6c3000","StackTrace":"   at OQSHA.Notification.Orchestrator.Services.UsersService.ResolveRecipientsAsync(String messageId, Int32 orgId, NotificationEventDto request) in C:\\GitLab-Runner\\builds\\27n6lYj0J\\0\\incident-reporter\\incident-reporter-api\\IncidentReporter\\OQSHA.Notification.Orchestrator\\Services\\UsersService.cs:line 71\r\n   at OQSHA.Notification.Orchestrator.Services.UsersService.GetRecipientsWithDetailsAsync(String messageId, Int32 orgId, NotificationEventDto request, NotificationTemplatesDbo notificationTemplate) in C:\\GitLab-Runner\\builds\\27n6lYj0J\\0\\incident-reporter\\incident-reporter-api\\IncidentReporter\\OQSHA.Notification.Orchestrator\\Services\\UsersService.cs:line 134\r\n   at OQSHA.Notification.Orchestrator.NotificationHandlers.WorkPermitV2NotificationHandler.HandleAsync(String messageId, NotificationEventDto request) in C:\\GitLab-Runner\\builds\\27n6lYj0J\\0\\incident-reporter\\incident-reporter-api\\IncidentReporter\\OQSHA.Notification.Orchestrator\\NotificationHandlers\\WorkPermitV2NotificationHandler.cs:line 62\r\n   at OQSHA.Notification.Orchestrator.NotificationHandlers.WorkPermitV2NotificationHandler.ProcessEventAsync(String messageId, NotificationEventDto request) in C:\\GitLab-Runner\\builds\\27n6lYj0J\\0\\incident-reporter\\incident-reporter-api\\IncidentReporter\\OQSHA.Notification.Orchestrator\\NotificationHandlers\\WorkPermitV2NotificationHandler.cs:line 46\r\n   at OQSHA.Notification.Orchestrator.Routing.EventRouter.ExecuteAsync(String messageId, NotificationEventDto request) in C:\\GitLab-Runner\\builds\\27n6lYj0J\\0\\incident-reporter\\incident-reporter-api\\IncidentReporter\\OQSHA.Notification.Orchestrator\\Routing\\EventRouter.cs:line 38\r\n   at OQSHA.Notification.Orchestrator.Worker.OrchestratorMessageHandler.HandleMessage(IMessage message) in C:\\GitLab-Runner\\builds\\27n6lYj0J\\0\\incident-reporter\\incident-reporter-api\\IncidentReporter\\OQSHA.Notification.Orchestrator\\Worker\\OrchestratorMessageHandler.cs:line 44","OriginalBody":"{\"TemplateId\":16,\"EntityType\":\"work_permit_v2\",\"EventType\":null,\"NotifyRoleId\":null,\"NotifyUserId\":null,\"NotifyDynamicActor\":\"Work_Permit_Authorization_Department_Head\",\"EntityContext\":{\"Parameters\":{\"workPermitId\":\"349\",\"workPermitV2Id\":\"349\",\"orgId\":\"264\",\"viewLink\":\"https://sandbox.oqsha.com/#/work-permit-v2/view-work-permit/264/349?dlType=viewWorkPermitV2\",\"workPermitLink\":\"https://sandbox.oqsha.com/#/work-permit-v2/view-work-permit/264/349?dlType=viewWorkPermitV2\",\"emailFooter\":\"OQSHA Team\"}},\"ActorContext\":{\"Requestor\":[678]},\"Metadata\":null}"}


Sent message ID 17f2596a8d6c3000 to DLQ


Started processing notification for message ID 17f2596a8d6c3001


Looking up the notification handler for message ID 17f2596a8d6c3001


Event handling in process for message ID 17f2596a8d6c3001


Sending message ID 17f2596a8d6c3001 to DLQ


Dead letter envelope for DLQ message: {"SourceTopic":"notification.orchestrator","SourceChannel":"notification-orchestrator","FailedAtUtc":"2026-06-30T13:33:22.3962765Z","Attempts":1,"ErrorType":"OQSHA.Notification.Orchestrator.Exceptions.PermanentOrchestratorException","ErrorMessage":"Unable to find any user IDs for dynamic actor Work_Permit_Authorization_Department_Head for message ID 17f2596a8d6c3001","StackTrace":"   at OQSHA.Notification.Orchestrator.Services.UsersService.ResolveRecipientsAsync(String messageId, Int32 orgId, NotificationEventDto request) in C:\\GitLab-Runner\\builds\\27n6lYj0J\\0\\incident-reporter\\incident-reporter-api\\IncidentReporter\\OQSHA.Notification.Orchestrator\\Services\\UsersService.cs:line 71\r\n   at OQSHA.Notification.Orchestrator.Services.UsersService.GetRecipientsWithDetailsAsync(String messageId, Int32 orgId, NotificationEventDto request, NotificationTemplatesDbo notificationTemplate) in C:\\GitLab-Runner\\builds\\27n6lYj0J\\0\\incident-reporter\\incident-reporter-api\\IncidentReporter\\OQSHA.Notification.Orchestrator\\Services\\UsersService.cs:line 134\r\n   at OQSHA.Notification.Orchestrator.NotificationHandlers.WorkPermitV2NotificationHandler.HandleAsync(String messageId, NotificationEventDto request) in C:\\GitLab-Runner\\builds\\27n6lYj0J\\0\\incident-reporter\\incident-reporter-api\\IncidentReporter\\OQSHA.Notification.Orchestrator\\NotificationHandlers\\WorkPermitV2NotificationHandler.cs:line 62\r\n   at OQSHA.Notification.Orchestrator.NotificationHandlers.WorkPermitV2NotificationHandler.ProcessEventAsync(String messageId, NotificationEventDto request) in C:\\GitLab-Runner\\builds\\27n6lYj0J\\0\\incident-reporter\\incident-reporter-api\\IncidentReporter\\OQSHA.Notification.Orchestrator\\NotificationHandlers\\WorkPermitV2NotificationHandler.cs:line 46\r\n   at OQSHA.Notification.Orchestrator.Routing.EventRouter.ExecuteAsync(String messageId, NotificationEventDto request) in C:\\GitLab-Runner\\builds\\27n6lYj0J\\0\\incident-reporter\\incident-reporter-api\\IncidentReporter\\OQSHA.Notification.Orchestrator\\Routing\\EventRouter.cs:line 38\r\n   at OQSHA.Notification.Orchestrator.Worker.OrchestratorMessageHandler.HandleMessage(IMessage message) in C:\\GitLab-Runner\\builds\\27n6lYj0J\\0\\incident-reporter\\incident-reporter-api\\IncidentReporter\\OQSHA.Notification.Orchestrator\\Worker\\OrchestratorMessageHandler.cs:line 44","OriginalBody":"{\"TemplateId\":17,\"EntityType\":\"work_permit_v2\",\"EventType\":null,\"NotifyRoleId\":null,\"NotifyUserId\":null,\"NotifyDynamicActor\":\"Work_Permit_Authorization_Department_Head\",\"EntityContext\":{\"Parameters\":{\"workPermitId\":\"349\",\"workPermitV2Id\":\"349\",\"orgId\":\"264\",\"viewLink\":\"https://sandbox.oqsha.com/#/work-permit-v2/view-work-permit/264/349?dlType=viewWorkPermitV2\",\"workPermitLink\":\"https://sandbox.oqsha.com/#/work-permit-v2/view-work-permit/264/349?dlType=viewWorkPermitV2\",\"emailFooter\":\"OQSHA Team\"}},\"ActorContext\":{\"Requestor\":[678]},\"Metadata\":null}"}


Sent message ID 17f2596a8d6c3001 to DLQ


Started processing notification for message ID 17f2597a626c3000


Looking up the notification handler for message ID 17f2597a626c3000


Event handling in process for message ID 17f2597a626c3000


Dispatching the notifications for message ID 17f2597a626c3000


Successfully processed notification for message ID 17f2597a626c3000


Started processing notification for message ID 17f2597a626c3001


Looking up the notification handler for message ID 17f2597a626c3001


Event handling in process for message ID 17f2597a626c3001


Dispatching the notifications for message ID 17f2597a626c3001


Successfully processed notification for message ID 17f2597a626c3001


Started processing notification for message ID 17f259a992ec3000


Looking up the notification handler for message ID 17f259a992ec3000


Event handling in process for message ID 17f259a992ec3000


Dispatching the notifications for message ID 17f259a992ec3000


Successfully processed notification for message ID 17f259a992ec3000


Started processing notification for message ID 17f259a992ec3001


Looking up the notification handler for message ID 17f259a992ec3001


Event handling in process for message ID 17f259a992ec3001


Dispatching the notifications for message ID 17f259a992ec3001


Successfully processed notification for message ID 17f259a992ec3001


Started processing notification for message ID 17f25a322dac3000


Looking up the notification handler for message ID 17f25a322dac3000


Event handling in process for message ID 17f25a322dac3000


Sending message ID 17f25a322dac3000 to DLQ


Dead letter envelope for DLQ message: {"SourceTopic":"notification.orchestrator","SourceChannel":"notification-orchestrator","FailedAtUtc":"2026-06-30T13:36:56.7049195Z","Attempts":1,"ErrorType":"OQSHA.Notification.Orchestrator.Exceptions.PermanentOrchestratorException","ErrorMessage":"No recipients received for message ID 17f25a322dac3000","StackTrace":"   at OQSHA.Notification.Orchestrator.Services.UsersService.ResolveRecipientsAsync(String messageId, Int32 orgId, NotificationEventDto request) in C:\\GitLab-Runner\\builds\\27n6lYj0J\\0\\incident-reporter\\incident-reporter-api\\IncidentReporter\\OQSHA.Notification.Orchestrator\\Services\\UsersService.cs:line 84\r\n   at OQSHA.Notification.Orchestrator.Services.UsersService.GetRecipientsWithDetailsAsync(String messageId, Int32 orgId, NotificationEventDto request, NotificationTemplatesDbo notificationTemplate) in C:\\GitLab-Runner\\builds\\27n6lYj0J\\0\\incident-reporter\\incident-reporter-api\\IncidentReporter\\OQSHA.Notification.Orchestrator\\Services\\UsersService.cs:line 134\r\n   at OQSHA.Notification.Orchestrator.NotificationHandlers.WorkPermitV2NotificationHandler.HandleAsync(String messageId, NotificationEventDto request) in C:\\GitLab-Runner\\builds\\27n6lYj0J\\0\\incident-reporter\\incident-reporter-api\\IncidentReporter\\OQSHA.Notification.Orchestrator\\NotificationHandlers\\WorkPermitV2NotificationHandler.cs:line 62\r\n   at OQSHA.Notification.Orchestrator.NotificationHandlers.WorkPermitV2NotificationHandler.ProcessEventAsync(String messageId, NotificationEventDto request) in C:\\GitLab-Runner\\builds\\27n6lYj0J\\0\\incident-reporter\\incident-reporter-api\\IncidentReporter\\OQSHA.Notification.Orchestrator\\NotificationHandlers\\WorkPermitV2NotificationHandler.cs:line 46\r\n   at OQSHA.Notification.Orchestrator.Routing.EventRouter.ExecuteAsync(String messageId, NotificationEventDto request) in C:\\GitLab-Runner\\builds\\27n6lYj0J\\0\\incident-reporter\\incident-reporter-api\\IncidentReporter\\OQSHA.Notification.Orchestrator\\Routing\\EventRouter.cs:line 38\r\n   at OQSHA.Notification.Orchestrator.Worker.OrchestratorMessageHandler.HandleMessage(IMessage message) in C:\\GitLab-Runner\\builds\\27n6lYj0J\\0\\incident-reporter\\incident-reporter-api\\IncidentReporter\\OQSHA.Notification.Orchestrator\\Worker\\OrchestratorMessageHandler.cs:line 44","OriginalBody":"{\"TemplateId\":17,\"EntityType\":\"work_permit_v2\",\"EventType\":null,\"NotifyRoleId\":null,\"NotifyUserId\":null,\"NotifyDynamicActor\":\"Work_Permit_Authorization_Department_Head\",\"EntityContext\":{\"Parameters\":{\"workPermitId\":\"351\",\"workPermitV2Id\":\"351\",\"orgId\":\"264\",\"viewLink\":\"https://sandbox.oqsha.com/#/work-permit-v2/view-work-permit/264/351?dlType=viewWorkPermitV2\",\"workPermitLink\":\"https://sandbox.oqsha.com/#/work-permit-v2/view-work-permit/264/351?dlType=viewWorkPermitV2\",\"emailFooter\":\"OQSHA Team\"}},\"ActorContext\":null,\"Metadata\":null}"}


Sent message ID 17f25a322dac3000 to DLQ


Started processing notification for message ID 17f25a322dac3001


Looking up the notification handler for message ID 17f25a322dac3001


Event handling in process for message ID 17f25a322dac3001


Sending message ID 17f25a322dac3001 to DLQ


Dead letter envelope for DLQ message: {"SourceTopic":"notification.orchestrator","SourceChannel":"notification-orchestrator","FailedAtUtc":"2026-06-30T13:36:56.891798Z","Attempts":1,"ErrorType":"OQSHA.Notification.Orchestrator.Exceptions.PermanentOrchestratorException","ErrorMessage":"No recipients received for message ID 17f25a322dac3001","StackTrace":"   at OQSHA.Notification.Orchestrator.Services.UsersService.ResolveRecipientsAsync(String messageId, Int32 orgId, NotificationEventDto request) in C:\\GitLab-Runner\\builds\\27n6lYj0J\\0\\incident-reporter\\incident-reporter-api\\IncidentReporter\\OQSHA.Notification.Orchestrator\\Services\\UsersService.cs:line 84\r\n   at OQSHA.Notification.Orchestrator.Services.UsersService.GetRecipientsWithDetailsAsync(String messageId, Int32 orgId, NotificationEventDto request, NotificationTemplatesDbo notificationTemplate) in C:\\GitLab-Runner\\builds\\27n6lYj0J\\0\\incident-reporter\\incident-reporter-api\\IncidentReporter\\OQSHA.Notification.Orchestrator\\Services\\UsersService.cs:line 134\r\n   at OQSHA.Notification.Orchestrator.NotificationHandlers.WorkPermitV2NotificationHandler.HandleAsync(String messageId, NotificationEventDto request) in C:\\GitLab-Runner\\builds\\27n6lYj0J\\0\\incident-reporter\\incident-reporter-api\\IncidentReporter\\OQSHA.Notification.Orchestrator\\NotificationHandlers\\WorkPermitV2NotificationHandler.cs:line 62\r\n   at OQSHA.Notification.Orchestrator.NotificationHandlers.WorkPermitV2NotificationHandler.ProcessEventAsync(String messageId, NotificationEventDto request) in C:\\GitLab-Runner\\builds\\27n6lYj0J\\0\\incident-reporter\\incident-reporter-api\\IncidentReporter\\OQSHA.Notification.Orchestrator\\NotificationHandlers\\WorkPermitV2NotificationHandler.cs:line 46\r\n   at OQSHA.Notification.Orchestrator.Routing.EventRouter.ExecuteAsync(String messageId, NotificationEventDto request) in C:\\GitLab-Runner\\builds\\27n6lYj0J\\0\\incident-reporter\\incident-reporter-api\\IncidentReporter\\OQSHA.Notification.Orchestrator\\Routing\\EventRouter.cs:line 38\r\n   at OQSHA.Notification.Orchestrator.Worker.OrchestratorMessageHandler.HandleMessage(IMessage message) in C:\\GitLab-Runner\\builds\\27n6lYj0J\\0\\incident-reporter\\incident-reporter-api\\IncidentReporter\\OQSHA.Notification.Orchestrator\\Worker\\OrchestratorMessageHandler.cs:line 44","OriginalBody":"{\"TemplateId\":16,\"EntityType\":\"work_permit_v2\",\"EventType\":null,\"NotifyRoleId\":null,\"NotifyUserId\":null,\"NotifyDynamicActor\":\"Work_Permit_Authorization_Department_Head\",\"EntityContext\":{\"Parameters\":{\"workPermitId\":\"351\",\"workPermitV2Id\":\"351\",\"orgId\":\"264\",\"viewLink\":\"https://sandbox.oqsha.com/#/work-permit-v2/view-work-permit/264/351?dlType=viewWorkPermitV2\",\"workPermitLink\":\"https://sandbox.oqsha.com/#/work-permit-v2/view-work-permit/264/351?dlType=viewWorkPermitV2\",\"emailFooter\":\"OQSHA Team\"}},\"ActorContext\":null,\"Metadata\":null}"}


Sent message ID 17f25a322dac3001 to DLQ


Started processing notification for message ID 17f25a50eaec3000


Looking up the notification handler for message ID 17f25a50eaec3000


Event handling in process for message ID 17f25a50eaec3000


Dispatching the notifications for message ID 17f25a50eaec3000


Successfully processed notification for message ID 17f25a50eaec3000


Started processing notification for message ID 17f25a50eaec3001


Looking up the notification handler for message ID 17f25a50eaec3001


Event handling in process for message ID 17f25a50eaec3001


Dispatching the notifications for message ID 17f25a50eaec3001


Successfully processed notification for message ID 17f25a50eaec3001


Started processing notification for message ID 17f25ff2b22c3000


Looking up the notification handler for message ID 17f25ff2b22c3000


Event handling in process for message ID 17f25ff2b22c3000


Sending message ID 17f25ff2b22c3000 to DLQ


Dead letter envelope for DLQ message: {"SourceTopic":"notification.orchestrator","SourceChannel":"notification-orchestrator","FailedAtUtc":"2026-06-30T14:03:17.8119094Z","Attempts":1,"ErrorType":"OQSHA.Notification.Orchestrator.Exceptions.PermanentOrchestratorException","ErrorMessage":"Unable to find any user IDs for dynamic actor Work_Permit_Authorization_Department_Head for message ID 17f25ff2b22c3000","StackTrace":"   at OQSHA.Notification.Orchestrator.Services.UsersService.ResolveRecipientsAsync(String messageId, Int32 orgId, NotificationEventDto request) in C:\\GitLab-Runner\\builds\\27n6lYj0J\\0\\incident-reporter\\incident-reporter-api\\IncidentReporter\\OQSHA.Notification.Orchestrator\\Services\\UsersService.cs:line 71\r\n   at OQSHA.Notification.Orchestrator.Services.UsersService.GetRecipientsWithDetailsAsync(String messageId, Int32 orgId, NotificationEventDto request, NotificationTemplatesDbo notificationTemplate) in C:\\GitLab-Runner\\builds\\27n6lYj0J\\0\\incident-reporter\\incident-reporter-api\\IncidentReporter\\OQSHA.Notification.Orchestrator\\Services\\UsersService.cs:line 134\r\n   at OQSHA.Notification.Orchestrator.NotificationHandlers.WorkPermitV2NotificationHandler.HandleAsync(String messageId, NotificationEventDto request) in C:\\GitLab-Runner\\builds\\27n6lYj0J\\0\\incident-reporter\\incident-reporter-api\\IncidentReporter\\OQSHA.Notification.Orchestrator\\NotificationHandlers\\WorkPermitV2NotificationHandler.cs:line 62\r\n   at OQSHA.Notification.Orchestrator.NotificationHandlers.WorkPermitV2NotificationHandler.ProcessEventAsync(String messageId, NotificationEventDto request) in C:\\GitLab-Runner\\builds\\27n6lYj0J\\0\\incident-reporter\\incident-reporter-api\\IncidentReporter\\OQSHA.Notification.Orchestrator\\NotificationHandlers\\WorkPermitV2NotificationHandler.cs:line 46\r\n   at OQSHA.Notification.Orchestrator.Routing.EventRouter.ExecuteAsync(String messageId, NotificationEventDto request) in C:\\GitLab-Runner\\builds\\27n6lYj0J\\0\\incident-reporter\\incident-reporter-api\\IncidentReporter\\OQSHA.Notification.Orchestrator\\Routing\\EventRouter.cs:line 38\r\n   at OQSHA.Notification.Orchestrator.Worker.OrchestratorMessageHandler.HandleMessage(IMessage message) in C:\\GitLab-Runner\\builds\\27n6lYj0J\\0\\incident-reporter\\incident-reporter-api\\IncidentReporter\\OQSHA.Notification.Orchestrator\\Worker\\OrchestratorMessageHandler.cs:line 44","OriginalBody":"{\"TemplateId\":16,\"EntityType\":\"work_permit_v2\",\"EventType\":null,\"NotifyRoleId\":null,\"NotifyUserId\":null,\"NotifyDynamicActor\":\"Work_Permit_Authorization_Department_Head\",\"EntityContext\":{\"Parameters\":{\"workPermitId\":\"355\",\"workPermitV2Id\":\"355\",\"orgId\":\"264\",\"viewLink\":\"https://sandbox.oqsha.com/#/work-permit-v2/view-work-permit/264/355?dlType=viewWorkPermitV2\",\"workPermitLink\":\"https://sandbox.oqsha.com/#/work-permit-v2/view-work-permit/264/355?dlType=viewWorkPermitV2\",\"emailFooter\":\"OQSHA Team\"}},\"ActorContext\":{\"Requestor\":[678]},\"Metadata\":null}"}


Sent message ID 17f25ff2b22c3000 to DLQ


Started processing notification for message ID 17f25ff2b26c3000


Looking up the notification handler for message ID 17f25ff2b26c3000


Event handling in process for message ID 17f25ff2b26c3000


Sending message ID 17f25ff2b26c3000 to DLQ


Dead letter envelope for DLQ message: {"SourceTopic":"notification.orchestrator","SourceChannel":"notification-orchestrator","FailedAtUtc":"2026-06-30T14:03:17.8740595Z","Attempts":1,"ErrorType":"OQSHA.Notification.Orchestrator.Exceptions.PermanentOrchestratorException","ErrorMessage":"Unable to find any user IDs for dynamic actor Work_Permit_Authorization_Department_Head for message ID 17f25ff2b26c3000","StackTrace":"   at OQSHA.Notification.Orchestrator.Services.UsersService.ResolveRecipientsAsync(String messageId, Int32 orgId, NotificationEventDto request) in C:\\GitLab-Runner\\builds\\27n6lYj0J\\0\\incident-reporter\\incident-reporter-api\\IncidentReporter\\OQSHA.Notification.Orchestrator\\Services\\UsersService.cs:line 71\r\n   at OQSHA.Notification.Orchestrator.Services.UsersService.GetRecipientsWithDetailsAsync(String messageId, Int32 orgId, NotificationEventDto request, NotificationTemplatesDbo notificationTemplate) in C:\\GitLab-Runner\\builds\\27n6lYj0J\\0\\incident-reporter\\incident-reporter-api\\IncidentReporter\\OQSHA.Notification.Orchestrator\\Services\\UsersService.cs:line 134\r\n   at OQSHA.Notification.Orchestrator.NotificationHandlers.WorkPermitV2NotificationHandler.HandleAsync(String messageId, NotificationEventDto request) in C:\\GitLab-Runner\\builds\\27n6lYj0J\\0\\incident-reporter\\incident-reporter-api\\IncidentReporter\\OQSHA.Notification.Orchestrator\\NotificationHandlers\\WorkPermitV2NotificationHandler.cs:line 62\r\n   at OQSHA.Notification.Orchestrator.NotificationHandlers.WorkPermitV2NotificationHandler.ProcessEventAsync(String messageId, NotificationEventDto request) in C:\\GitLab-Runner\\builds\\27n6lYj0J\\0\\incident-reporter\\incident-reporter-api\\IncidentReporter\\OQSHA.Notification.Orchestrator\\NotificationHandlers\\WorkPermitV2NotificationHandler.cs:line 46\r\n   at OQSHA.Notification.Orchestrator.Routing.EventRouter.ExecuteAsync(String messageId, NotificationEventDto request) in C:\\GitLab-Runner\\builds\\27n6lYj0J\\0\\incident-reporter\\incident-reporter-api\\IncidentReporter\\OQSHA.Notification.Orchestrator\\Routing\\EventRouter.cs:line 38\r\n   at OQSHA.Notification.Orchestrator.Worker.OrchestratorMessageHandler.HandleMessage(IMessage message) in C:\\GitLab-Runner\\builds\\27n6lYj0J\\0\\incident-reporter\\incident-reporter-api\\IncidentReporter\\OQSHA.Notification.Orchestrator\\Worker\\OrchestratorMessageHandler.cs:line 44","OriginalBody":"{\"TemplateId\":17,\"EntityType\":\"work_permit_v2\",\"EventType\":null,\"NotifyRoleId\":null,\"NotifyUserId\":null,\"NotifyDynamicActor\":\"Work_Permit_Authorization_Department_Head\",\"EntityContext\":{\"Parameters\":{\"workPermitId\":\"355\",\"workPermitV2Id\":\"355\",\"orgId\":\"264\",\"viewLink\":\"https://sandbox.oqsha.com/#/work-permit-v2/view-work-permit/264/355?dlType=viewWorkPermitV2\",\"workPermitLink\":\"https://sandbox.oqsha.com/#/work-permit-v2/view-work-permit/264/355?dlType=viewWorkPermitV2\",\"emailFooter\":\"OQSHA Team\"}},\"ActorContext\":{\"Requestor\":[678]},\"Metadata\":null}"}


Sent message ID 17f25ff2b26c3000 to DLQ


Inside hosted service - for nsq


Started the consumer service and handler for NSQ


Notification event with message ID 17f2888fff6c3000 received: {"TemplateId":1,"EntityType":"inspection_v2","EventType":"inspection_v2.inspection_created","NotifyRoleId":null,"NotifyUserId":267,"NotifyDynamicActor":null,"EntityContext":{"Parameters":{"inspectionId":"38","orgId":"257","inspectionLink":"https://sandbox.oqsha.com/#/inspection-v2/view/257/38","emailFooter":"OQSHA Team","userName":"Sal Eaton"}},"ActorContext":null,"Metadata":null}


Started processing notification for message ID 17f2888fff6c3000


Looking up the notification handler for message ID 17f2888fff6c3000


Event handling in process for message ID 17f2888fff6c3000


Dispatching the notifications for message ID 17f2888fff6c3000


Successfully processed notification for message ID 17f2888fff6c3000


Notification event with message ID 17f2890342ac3000 received: {"TemplateId":1,"EntityType":"inspection_v2","EventType":"inspection_v2.inspection_created","NotifyRoleId":null,"NotifyUserId":267,"NotifyDynamicActor":null,"EntityContext":{"Parameters":{"inspectionId":"39","orgId":"257","inspectionLink":"https://sandbox.oqsha.com/#/inspection-v2/view/257/39","emailFooter":"OQSHA Team","userName":"Sal Eaton"}},"ActorContext":null,"Metadata":null}


Started processing notification for message ID 17f2890342ac3000


Looking up the notification handler for message ID 17f2890342ac3000


Event handling in process for message ID 17f2890342ac3000


Dispatching the notifications for message ID 17f2890342ac3000


Successfully processed notification for message ID 17f2890342ac3000


Notification event with message ID 17f2897961ec3000 received: {"TemplateId":1,"EntityType":"inspection_v2","EventType":"inspection_v2.inspection_created","NotifyRoleId":null,"NotifyUserId":267,"NotifyDynamicActor":null,"EntityContext":{"Parameters":{"inspectionId":"40","orgId":"257","inspectionLink":"https://sandbox.oqsha.com/#/inspection-v2/view/257/40","emailFooter":"OQSHA Team","userName":"Sal Eaton"}},"ActorContext":null,"Metadata":null}


Started processing notification for message ID 17f2897961ec3000


Looking up the notification handler for message ID 17f2897961ec3000


Event handling in process for message ID 17f2897961ec3000


Dispatching the notifications for message ID 17f2897961ec3000


Successfully processed notification for message ID 17f2897961ec3000


Notification event with message ID 17f28f34052c3000 received: {"TemplateId":1,"EntityType":"inspection_v2","EventType":"inspection_v2.inspection_created","NotifyRoleId":null,"NotifyUserId":267,"NotifyDynamicActor":null,"EntityContext":{"Parameters":{"inspectionId":"41","orgId":"257","inspectionLink":"https://sandbox.oqsha.com/#/inspection-v2/view/257/41","emailFooter":"OQSHA Team","userName":"Sal Eaton"}},"ActorContext":null,"Metadata":null}


Started processing notification for message ID 17f28f34052c3000


Looking up the notification handler for message ID 17f28f34052c3000


Event handling in process for message ID 17f28f34052c3000


Dispatching the notifications for message ID 17f28f34052c3000


Successfully processed notification for message ID 17f28f34052c3000