alliantONE Hangfire Dashboard

ICDTTProjectFinalCompletionNotificationTask.Run

// Job ID: #357878
using AG.A1.Scheduler.Project.Contracts.Contracts.Project;

var cDTTProjectFinalCompletionNotificationTask = Activate<ICDTTProjectFinalCompletionNotificationTask>();
await cDTTProjectFinalCompletionNotificationTask.Run(null, null);

Parameters

CurrentCulture 
"en-US"
CurrentUICulture 
"en-US"
RecurringJobId 
"CDTT-SOW-Final"
RetryCount 
10
Time 
1763265610

State

11/16/2025 8:29:42 AM (+303ms) Failed

An exception occurred during performance of the job.

System.Net.Http.HttpRequestException

Request failed with status code InternalServerError

System.Net.Http.HttpRequestException: Request failed with status code InternalServerError
   at AG.A1.Framework.Rest.RESTClient.HandleResponse[T](RestResponse restResponse) in C:\agent\_work\1\s\A1Solution\src-framework\AG.A1.Framework\Rest\RESTClient.cs:line 389
   at AG.A1.Framework.Rest.RESTClient.GetInternalAsync[T](IRESTEndpoint apiEndpoint, IDictionary`2 headers, String expectedRootElement, IDictionary`2 parameters) in C:\agent\_work\1\s\A1Solution\src-framework\AG.A1.Framework\Rest\RESTClient.cs:line 210
   at AG.Integrations.RESTClients.AlliantOneApiREST.EmailControllers.EmailA1ApiClientController.SendCDTTFinalEmailNotification() in C:\agent\_work\1\s\A1Solution\src-integrations\AG.Integrations.RESTClients\AlliantOneApiREST\EmailControllers\EmailA1ApiClientController.cs:line 86
   at AG.A1.Scheduler.Project.Application.Features.CDTT.CDTTProjectFinalCompletionNotificationTask.Run(PerformContext performContext, IJobCancellationToken cancellationToken) in C:\agent\_work\1\s\A1Solution\src-schedulers\AG.A1.Scheduler.Project.Application\Features\CDTT\CDTTProjectFinalCompletionNotificationTask.cs:line 20
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)

+20ms Processing

Server:
dw1sdwk000ecq:6412
Worker:
9bc37efa
+252msCDTT ProjectCompletionNotification - Failed at 11/16/2025 8:29:42 AM

+1h 53m Enqueued

Triggered by DelayedJobScheduler

Queue:
default

+3ms Scheduled

Retry attempt 10 of 10: Request failed with status code InternalServerErr…

Enqueue at:
11/16/2025 8:29:40 AM

+387ms Failed

An exception occurred during performance of the job.

System.Net.Http.HttpRequestException

Request failed with status code InternalServerError

System.Net.Http.HttpRequestException: Request failed with status code InternalServerError
   at AG.A1.Framework.Rest.RESTClient.HandleResponse[T](RestResponse restResponse) in C:\agent\_work\1\s\A1Solution\src-framework\AG.A1.Framework\Rest\RESTClient.cs:line 389
   at AG.A1.Framework.Rest.RESTClient.GetInternalAsync[T](IRESTEndpoint apiEndpoint, IDictionary`2 headers, String expectedRootElement, IDictionary`2 parameters) in C:\agent\_work\1\s\A1Solution\src-framework\AG.A1.Framework\Rest\RESTClient.cs:line 210
   at AG.Integrations.RESTClients.AlliantOneApiREST.EmailControllers.EmailA1ApiClientController.SendCDTTFinalEmailNotification() in C:\agent\_work\1\s\A1Solution\src-integrations\AG.Integrations.RESTClients\AlliantOneApiREST\EmailControllers\EmailA1ApiClientController.cs:line 86
   at AG.A1.Scheduler.Project.Application.Features.CDTT.CDTTProjectFinalCompletionNotificationTask.Run(PerformContext performContext, IJobCancellationToken cancellationToken) in C:\agent\_work\1\s\A1Solution\src-schedulers\AG.A1.Scheduler.Project.Application\Features\CDTT\CDTTProjectFinalCompletionNotificationTask.cs:line 20
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)

+17ms Processing

Server:
dw1sdwk000ecq:6412
Worker:
9bc37efa
+338msCDTT ProjectCompletionNotification - Failed at 11/16/2025 6:36:34 AM

+1h 11m Enqueued

Triggered by DelayedJobScheduler

Queue:
default

+10ms Scheduled

Retry attempt 9 of 10: Request failed with status code InternalServerErr…

Enqueue at:
11/16/2025 6:36:33 AM

+307ms Failed

An exception occurred during performance of the job.

System.Net.Http.HttpRequestException

Request failed with status code InternalServerError

System.Net.Http.HttpRequestException: Request failed with status code InternalServerError
   at AG.A1.Framework.Rest.RESTClient.HandleResponse[T](RestResponse restResponse) in C:\agent\_work\1\s\A1Solution\src-framework\AG.A1.Framework\Rest\RESTClient.cs:line 389
   at AG.A1.Framework.Rest.RESTClient.GetInternalAsync[T](IRESTEndpoint apiEndpoint, IDictionary`2 headers, String expectedRootElement, IDictionary`2 parameters) in C:\agent\_work\1\s\A1Solution\src-framework\AG.A1.Framework\Rest\RESTClient.cs:line 210
   at AG.Integrations.RESTClients.AlliantOneApiREST.EmailControllers.EmailA1ApiClientController.SendCDTTFinalEmailNotification() in C:\agent\_work\1\s\A1Solution\src-integrations\AG.Integrations.RESTClients\AlliantOneApiREST\EmailControllers\EmailA1ApiClientController.cs:line 86
   at AG.A1.Scheduler.Project.Application.Features.CDTT.CDTTProjectFinalCompletionNotificationTask.Run(PerformContext performContext, IJobCancellationToken cancellationToken) in C:\agent\_work\1\s\A1Solution\src-schedulers\AG.A1.Scheduler.Project.Application\Features\CDTT\CDTTProjectFinalCompletionNotificationTask.cs:line 20
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)

+20ms Processing

Server:
dw1sdwk000ecq:6412
Worker:
1d258485
+239msCDTT ProjectCompletionNotification - Failed at 11/16/2025 5:24:44 AM

+40m 47.543s Enqueued

Triggered by DelayedJobScheduler

Queue:
default

+3ms Scheduled

Retry attempt 8 of 10: Request failed with status code InternalServerErr…

Enqueue at:
11/16/2025 5:24:36 AM

+240ms Failed

An exception occurred during performance of the job.

System.Net.Http.HttpRequestException

Request failed with status code InternalServerError

System.Net.Http.HttpRequestException: Request failed with status code InternalServerError
   at AG.A1.Framework.Rest.RESTClient.HandleResponse[T](RestResponse restResponse) in C:\agent\_work\1\s\A1Solution\src-framework\AG.A1.Framework\Rest\RESTClient.cs:line 389
   at AG.A1.Framework.Rest.RESTClient.GetInternalAsync[T](IRESTEndpoint apiEndpoint, IDictionary`2 headers, String expectedRootElement, IDictionary`2 parameters) in C:\agent\_work\1\s\A1Solution\src-framework\AG.A1.Framework\Rest\RESTClient.cs:line 210
   at AG.Integrations.RESTClients.AlliantOneApiREST.EmailControllers.EmailA1ApiClientController.SendCDTTFinalEmailNotification() in C:\agent\_work\1\s\A1Solution\src-integrations\AG.Integrations.RESTClients\AlliantOneApiREST\EmailControllers\EmailA1ApiClientController.cs:line 86
   at AG.A1.Scheduler.Project.Application.Features.CDTT.CDTTProjectFinalCompletionNotificationTask.Run(PerformContext performContext, IJobCancellationToken cancellationToken) in C:\agent\_work\1\s\A1Solution\src-schedulers\AG.A1.Scheduler.Project.Application\Features\CDTT\CDTTProjectFinalCompletionNotificationTask.cs:line 20
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)

+20ms Processing

Server:
dw1sdwk000ecq:6412
Worker:
c917f518
+183msCDTT ProjectCompletionNotification - Failed at 11/16/2025 4:43:56 AM

+23m 30.780s Enqueued

Triggered by DelayedJobScheduler

Queue:
default

+7ms Scheduled

Retry attempt 7 of 10: Request failed with status code InternalServerErr…

Enqueue at:
11/16/2025 4:43:47 AM

+963ms Failed

An exception occurred during performance of the job.

System.Net.Http.HttpRequestException

Request failed with status code InternalServerError

System.Net.Http.HttpRequestException: Request failed with status code InternalServerError
   at AG.A1.Framework.Rest.RESTClient.HandleResponse[T](RestResponse restResponse) in C:\agent\_work\1\s\A1Solution\src-framework\AG.A1.Framework\Rest\RESTClient.cs:line 389
   at AG.A1.Framework.Rest.RESTClient.GetInternalAsync[T](IRESTEndpoint apiEndpoint, IDictionary`2 headers, String expectedRootElement, IDictionary`2 parameters) in C:\agent\_work\1\s\A1Solution\src-framework\AG.A1.Framework\Rest\RESTClient.cs:line 210
   at AG.Integrations.RESTClients.AlliantOneApiREST.EmailControllers.EmailA1ApiClientController.SendCDTTFinalEmailNotification() in C:\agent\_work\1\s\A1Solution\src-integrations\AG.Integrations.RESTClients\AlliantOneApiREST\EmailControllers\EmailA1ApiClientController.cs:line 86
   at AG.A1.Scheduler.Project.Application.Features.CDTT.CDTTProjectFinalCompletionNotificationTask.Run(PerformContext performContext, IJobCancellationToken cancellationToken) in C:\agent\_work\1\s\A1Solution\src-schedulers\AG.A1.Scheduler.Project.Application\Features\CDTT\CDTTProjectFinalCompletionNotificationTask.cs:line 20
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)

+27ms Processing

Server:
dw1sdwk000ecq:6412
Worker:
94806c26
+938msCDTT ProjectCompletionNotification - Failed at 11/16/2025 4:20:25 AM

+11m 403ms Enqueued

Triggered by DelayedJobScheduler

Queue:
default

+4ms Scheduled

Retry attempt 6 of 10: Request failed with status code InternalServerErr…

Enqueue at:
11/16/2025 4:20:22 AM

+190ms Failed

An exception occurred during performance of the job.

System.Net.Http.HttpRequestException

Request failed with status code InternalServerError

System.Net.Http.HttpRequestException: Request failed with status code InternalServerError
   at AG.A1.Framework.Rest.RESTClient.HandleResponse[T](RestResponse restResponse) in C:\agent\_work\1\s\A1Solution\src-framework\AG.A1.Framework\Rest\RESTClient.cs:line 389
   at AG.A1.Framework.Rest.RESTClient.GetInternalAsync[T](IRESTEndpoint apiEndpoint, IDictionary`2 headers, String expectedRootElement, IDictionary`2 parameters) in C:\agent\_work\1\s\A1Solution\src-framework\AG.A1.Framework\Rest\RESTClient.cs:line 210
   at AG.Integrations.RESTClients.AlliantOneApiREST.EmailControllers.EmailA1ApiClientController.SendCDTTFinalEmailNotification() in C:\agent\_work\1\s\A1Solution\src-integrations\AG.Integrations.RESTClients\AlliantOneApiREST\EmailControllers\EmailA1ApiClientController.cs:line 86
   at AG.A1.Scheduler.Project.Application.Features.CDTT.CDTTProjectFinalCompletionNotificationTask.Run(PerformContext performContext, IJobCancellationToken cancellationToken) in C:\agent\_work\1\s\A1Solution\src-schedulers\AG.A1.Scheduler.Project.Application\Features\CDTT\CDTTProjectFinalCompletionNotificationTask.cs:line 20
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)

+20ms Processing

Server:
dw1sdwk000ecq:6412
Worker:
76e1b8d1
+133msCDTT ProjectCompletionNotification - Failed at 11/16/2025 4:09:24 AM

+5m 30.233s Enqueued

Triggered by DelayedJobScheduler

Queue:
default

+3ms Scheduled

Retry attempt 5 of 10: Request failed with status code InternalServerErr…

Enqueue at:
11/16/2025 4:09:20 AM

+117ms Failed

An exception occurred during performance of the job.

System.Net.Http.HttpRequestException

Request failed with status code InternalServerError

System.Net.Http.HttpRequestException: Request failed with status code InternalServerError
   at AG.A1.Framework.Rest.RESTClient.HandleResponse[T](RestResponse restResponse) in C:\agent\_work\1\s\A1Solution\src-framework\AG.A1.Framework\Rest\RESTClient.cs:line 389
   at AG.A1.Framework.Rest.RESTClient.GetInternalAsync[T](IRESTEndpoint apiEndpoint, IDictionary`2 headers, String expectedRootElement, IDictionary`2 parameters) in C:\agent\_work\1\s\A1Solution\src-framework\AG.A1.Framework\Rest\RESTClient.cs:line 210
   at AG.Integrations.RESTClients.AlliantOneApiREST.EmailControllers.EmailA1ApiClientController.SendCDTTFinalEmailNotification() in C:\agent\_work\1\s\A1Solution\src-integrations\AG.Integrations.RESTClients\AlliantOneApiREST\EmailControllers\EmailA1ApiClientController.cs:line 86
   at AG.A1.Scheduler.Project.Application.Features.CDTT.CDTTProjectFinalCompletionNotificationTask.Run(PerformContext performContext, IJobCancellationToken cancellationToken) in C:\agent\_work\1\s\A1Solution\src-schedulers\AG.A1.Scheduler.Project.Application\Features\CDTT\CDTTProjectFinalCompletionNotificationTask.cs:line 20
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)

+23ms Processing

Server:
dw1sdwk000ecq:6412
Worker:
76e1b8d1
+90msCDTT ProjectCompletionNotification - Failed at 11/16/2025 4:03:54 AM

+2m 74ms Enqueued

Triggered by DelayedJobScheduler

Queue:
default

+3ms Scheduled

Retry attempt 4 of 10: Request failed with status code InternalServerErr…

Enqueue at:
11/16/2025 4:03:45 AM

+187ms Failed

An exception occurred during performance of the job.

System.Net.Http.HttpRequestException

Request failed with status code InternalServerError

System.Net.Http.HttpRequestException: Request failed with status code InternalServerError
   at AG.A1.Framework.Rest.RESTClient.HandleResponse[T](RestResponse restResponse) in C:\agent\_work\1\s\A1Solution\src-framework\AG.A1.Framework\Rest\RESTClient.cs:line 389
   at AG.A1.Framework.Rest.RESTClient.GetInternalAsync[T](IRESTEndpoint apiEndpoint, IDictionary`2 headers, String expectedRootElement, IDictionary`2 parameters) in C:\agent\_work\1\s\A1Solution\src-framework\AG.A1.Framework\Rest\RESTClient.cs:line 210
   at AG.Integrations.RESTClients.AlliantOneApiREST.EmailControllers.EmailA1ApiClientController.SendCDTTFinalEmailNotification() in C:\agent\_work\1\s\A1Solution\src-integrations\AG.Integrations.RESTClients\AlliantOneApiREST\EmailControllers\EmailA1ApiClientController.cs:line 86
   at AG.A1.Scheduler.Project.Application.Features.CDTT.CDTTProjectFinalCompletionNotificationTask.Run(PerformContext performContext, IJobCancellationToken cancellationToken) in C:\agent\_work\1\s\A1Solution\src-schedulers\AG.A1.Scheduler.Project.Application\Features\CDTT\CDTTProjectFinalCompletionNotificationTask.cs:line 20
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)

+20ms Processing

Server:
dw1sdwk000ecq:6412
Worker:
76e1b8d1
+139msCDTT ProjectCompletionNotification - Failed at 11/16/2025 4:01:53 AM

+44.946s Enqueued

Triggered by DelayedJobScheduler

Queue:
default

+4ms Scheduled

Retry attempt 3 of 10: Request failed with status code InternalServerErr…

Enqueue at:
11/16/2025 4:01:39 AM

+123ms Failed

An exception occurred during performance of the job.

System.Net.Http.HttpRequestException

Request failed with status code InternalServerError

System.Net.Http.HttpRequestException: Request failed with status code InternalServerError
   at AG.A1.Framework.Rest.RESTClient.HandleResponse[T](RestResponse restResponse) in C:\agent\_work\1\s\A1Solution\src-framework\AG.A1.Framework\Rest\RESTClient.cs:line 389
   at AG.A1.Framework.Rest.RESTClient.GetInternalAsync[T](IRESTEndpoint apiEndpoint, IDictionary`2 headers, String expectedRootElement, IDictionary`2 parameters) in C:\agent\_work\1\s\A1Solution\src-framework\AG.A1.Framework\Rest\RESTClient.cs:line 210
   at AG.Integrations.RESTClients.AlliantOneApiREST.EmailControllers.EmailA1ApiClientController.SendCDTTFinalEmailNotification() in C:\agent\_work\1\s\A1Solution\src-integrations\AG.Integrations.RESTClients\AlliantOneApiREST\EmailControllers\EmailA1ApiClientController.cs:line 86
   at AG.A1.Scheduler.Project.Application.Features.CDTT.CDTTProjectFinalCompletionNotificationTask.Run(PerformContext performContext, IJobCancellationToken cancellationToken) in C:\agent\_work\1\s\A1Solution\src-schedulers\AG.A1.Scheduler.Project.Application\Features\CDTT\CDTTProjectFinalCompletionNotificationTask.cs:line 20
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)

+20ms Processing

Server:
dw1sdwk000ecq:6412
Worker:
9bc37efa
+85msCDTT ProjectCompletionNotification - Failed at 11/16/2025 4:01:08 AM

+29.927s Enqueued

Triggered by DelayedJobScheduler

Queue:
default

+10ms Scheduled

Retry attempt 2 of 10: Request failed with status code InternalServerErr…

Enqueue at:
11/16/2025 4:00:54 AM

+136ms Failed

An exception occurred during performance of the job.

System.Net.Http.HttpRequestException

Request failed with status code InternalServerError

System.Net.Http.HttpRequestException: Request failed with status code InternalServerError
   at AG.A1.Framework.Rest.RESTClient.HandleResponse[T](RestResponse restResponse) in C:\agent\_work\1\s\A1Solution\src-framework\AG.A1.Framework\Rest\RESTClient.cs:line 389
   at AG.A1.Framework.Rest.RESTClient.GetInternalAsync[T](IRESTEndpoint apiEndpoint, IDictionary`2 headers, String expectedRootElement, IDictionary`2 parameters) in C:\agent\_work\1\s\A1Solution\src-framework\AG.A1.Framework\Rest\RESTClient.cs:line 210
   at AG.Integrations.RESTClients.AlliantOneApiREST.EmailControllers.EmailA1ApiClientController.SendCDTTFinalEmailNotification() in C:\agent\_work\1\s\A1Solution\src-integrations\AG.Integrations.RESTClients\AlliantOneApiREST\EmailControllers\EmailA1ApiClientController.cs:line 86
   at AG.A1.Scheduler.Project.Application.Features.CDTT.CDTTProjectFinalCompletionNotificationTask.Run(PerformContext performContext, IJobCancellationToken cancellationToken) in C:\agent\_work\1\s\A1Solution\src-schedulers\AG.A1.Scheduler.Project.Application\Features\CDTT\CDTTProjectFinalCompletionNotificationTask.cs:line 20
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)

+14ms Processing

Server:
dw1sdwk000ecq:6412
Worker:
76e1b8d1
+95msCDTT ProjectCompletionNotification - Failed at 11/16/2025 4:00:38 AM

+24.666s Enqueued

Triggered by DelayedJobScheduler

Queue:
default

+7ms Scheduled

Retry attempt 1 of 10: Request failed with status code InternalServerErr…

Enqueue at:
11/16/2025 4:00:34 AM

+2.913s Failed

An exception occurred during performance of the job.

System.Net.Http.HttpRequestException

Request failed with status code InternalServerError

System.Net.Http.HttpRequestException: Request failed with status code InternalServerError
   at AG.A1.Framework.Rest.RESTClient.HandleResponse[T](RestResponse restResponse) in C:\agent\_work\1\s\A1Solution\src-framework\AG.A1.Framework\Rest\RESTClient.cs:line 389
   at AG.A1.Framework.Rest.RESTClient.GetInternalAsync[T](IRESTEndpoint apiEndpoint, IDictionary`2 headers, String expectedRootElement, IDictionary`2 parameters) in C:\agent\_work\1\s\A1Solution\src-framework\AG.A1.Framework\Rest\RESTClient.cs:line 210
   at AG.Integrations.RESTClients.AlliantOneApiREST.EmailControllers.EmailA1ApiClientController.SendCDTTFinalEmailNotification() in C:\agent\_work\1\s\A1Solution\src-integrations\AG.Integrations.RESTClients\AlliantOneApiREST\EmailControllers\EmailA1ApiClientController.cs:line 86
   at AG.A1.Scheduler.Project.Application.Features.CDTT.CDTTProjectFinalCompletionNotificationTask.Run(PerformContext performContext, IJobCancellationToken cancellationToken) in C:\agent\_work\1\s\A1Solution\src-schedulers\AG.A1.Scheduler.Project.Application\Features\CDTT\CDTTProjectFinalCompletionNotificationTask.cs:line 20
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)

+137ms Processing

Server:
dw1sdwk000ecq:6412
Worker:
9bc37efa
+2.888sCDTT ProjectCompletionNotification - Failed at 11/16/2025 4:00:13 AM

+10ms Enqueued

Triggered by recurring job scheduler

Queue:
a1-cdtt-queue

11/16/2025 4:00:10 AM Created